Evaluator 848

2019-05-07 16:17:01+00:00

2019-05-07 16:17:29+00:00

0:00:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.0997578523375163
error_L2	0.016483801875089764

No reset possible

21550

3213

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-05-06 12:07:37+00:00

2019-05-06 12:12:05+00:00

0:04:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.13277976989746093
agent_compute-ego_mean	0.12529749905597892
agent_compute-ego_median	0.12454814246938198
agent_compute-ego_min	0.11480262700249166
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08621787583386456, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04979421032799615, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1222011027512727, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07590265185744674, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.031414517649897826, "sim_compute_performance-ego": 0.053667805812976976, "sim_compute_robot_state-ego": 0.05931867935039379}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.09096865093006808, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04837534474391563, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1321558531592874, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.07752206746269674, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.033566587111529184, "sim_compute_performance-ego": 0.056575560102275775, "sim_compute_robot_state-ego": 0.058432148952110144}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.08889815386603861, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.046444065430585074, "in-drivable-lane": 0, "agent_compute-ego": 0.11480262700249166, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07533979415893555, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02770593587089987, "sim_compute_performance-ego": 0.053612134035895855, "sim_compute_robot_state-ego": 0.05467535467708812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.10329648971557616, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05401134490966797, "in-drivable-lane": 0, "agent_compute-ego": 0.13277976989746093, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0761920166015625, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.032450904846191404, "sim_compute_performance-ego": 0.056399259567260746, "sim_compute_robot_state-ego": 0.059465494155883786}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.08659834499600567, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.053051224237755885, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.12454814246938198, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.07626673541491545, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03087385093109517, "sim_compute_performance-ego": 0.05493733249133146, "sim_compute_robot_state-ego": 0.060096804099746895}}
set_robot_commands_max	0.07752206746269674
set_robot_commands_mean	0.0762446530991114
set_robot_commands_median	0.0761920166015625
set_robot_commands_min	0.07533979415893555
sim_compute_performance-ego_max	0.056575560102275775
sim_compute_performance-ego_mean	0.05503841840194816
sim_compute_performance-ego_median	0.05493733249133146
sim_compute_performance-ego_min	0.053612134035895855
sim_compute_robot_state-ego_max	0.060096804099746895
sim_compute_robot_state-ego_mean	0.05839769624704455
sim_compute_robot_state-ego_median	0.05931867935039379
sim_compute_robot_state-ego_min	0.05467535467708812
sim_compute_sim_state_max	0.033566587111529184
sim_compute_sim_state_mean	0.031202359281922692
sim_compute_sim_state_median	0.031414517649897826
sim_compute_sim_state_min	0.02770593587089987
sim_physics_max	0.10329648971557616
sim_physics_mean	0.09119590306831062
sim_physics_median	0.08889815386603861
sim_physics_min	0.08621787583386456
sim_render-ego_max	0.05401134490966797
sim_render-ego_mean	0.05033523792998414
sim_render-ego_median	0.04979421032799615
sim_render-ego_min	0.046444065430585074
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21506

3196

Anastasiya Nikolskaya 🇷🇺

NN Solution

step1-simulation

host-error

2019-05-05 15:51:58+00:00

2019-05-05 16:00:05+00:00

0:08:07

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3196/step1-simulation-ip-172-31-25-98-2348-job21506/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21480

3175

Ian Li 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-03 13:14:52+00:00

2019-05-03 13:15:25+00:00

0:00:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10991503543675256
error_L2	0.018992278826151187

No reset possible

21440

3138

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-30 15:15:15+00:00

2019-04-30 15:21:40+00:00

0:06:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.1640001671223701
agent_compute-ego_mean	0.15934481992966415
agent_compute-ego_median	0.16035306930541993
agent_compute-ego_min	0.15447009311002843
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12349511958934643, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.064423817175406, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16060280358349835, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10366338712197765, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04128964300508852, "sim_compute_performance-ego": 0.07386675587406864, "sim_compute_robot_state-ego": 0.07733216550615099}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11713063015657312, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06546717531540815, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15729796652700387, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10140512036342247, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.040314244289024206, "sim_compute_performance-ego": 0.07360358799205106, "sim_compute_robot_state-ego": 0.07762878548865225}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13421350366928997, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.061842245214125686, "in-drivable-lane": 0, "agent_compute-ego": 0.15447009311002843, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09536853958578673, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03886696871589212, "sim_compute_performance-ego": 0.07471830704632927, "sim_compute_robot_state-ego": 0.08016084222232595}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13063616752624513, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06684412956237792, "in-drivable-lane": 0, "agent_compute-ego": 0.16035306930541993, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1034584903717041, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04112382888793945, "sim_compute_performance-ego": 0.07414597511291504, "sim_compute_robot_state-ego": 0.07624435424804688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.128906708729418, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0678709790676455, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1640001671223701, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10373797295968744, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.043034586725355706, "sim_compute_performance-ego": 0.07401121115382714, "sim_compute_robot_state-ego": 0.08201897295215461}}
set_robot_commands_max	0.10373797295968744
set_robot_commands_mean	0.10152670208051567
set_robot_commands_median	0.1034584903717041
set_robot_commands_min	0.09536853958578673
sim_compute_performance-ego_max	0.07471830704632927
sim_compute_performance-ego_mean	0.07406916743583823
sim_compute_performance-ego_median	0.07401121115382714
sim_compute_performance-ego_min	0.07360358799205106
sim_compute_robot_state-ego_max	0.08201897295215461
sim_compute_robot_state-ego_mean	0.07867702408346613
sim_compute_robot_state-ego_median	0.07762878548865225
sim_compute_robot_state-ego_min	0.07624435424804688
sim_compute_sim_state_max	0.043034586725355706
sim_compute_sim_state_mean	0.04092585432466
sim_compute_sim_state_median	0.04112382888793945
sim_compute_sim_state_min	0.03886696871589212
sim_physics_max	0.13421350366928997
sim_physics_mean	0.12687642593417453
sim_physics_median	0.128906708729418
sim_physics_min	0.11713063015657312
sim_render-ego_max	0.0678709790676455
sim_render-ego_mean	0.06528966926699264
sim_render-ego_median	0.06546717531540815
sim_render-ego_min	0.061842245214125686
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21388

2362

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-28 02:05:48+00:00

2019-04-28 02:25:03+00:00

0:19:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.16301537027546004
agent_compute-ego_mean	0.15417471142010805
agent_compute-ego_median	0.15414883652511907
agent_compute-ego_min	0.1459214687347412
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13404042190975612, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.07016197840372722, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15240873230828178, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10962934847231263, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.043340184070445875, "sim_compute_performance-ego": 0.0783308567824187, "sim_compute_robot_state-ego": 0.08501322622652407}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1352709695404651, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.07111232888464834, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16301537027546004, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.11884732807383816, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04432292545542998, "sim_compute_performance-ego": 0.08224188112745098, "sim_compute_robot_state-ego": 0.09276191861021751}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14066236159380743, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06334024317124311, "in-drivable-lane": 0, "agent_compute-ego": 0.1459214687347412, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10286575205185834, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04051014956306009, "sim_compute_performance-ego": 0.07702075733857996, "sim_compute_robot_state-ego": 0.08431684269624598}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.15175375938415528, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.07317835807800294, "in-drivable-lane": 0, "agent_compute-ego": 0.15824491500854493, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.11896610260009766, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04536511421203613, "sim_compute_performance-ego": 0.08040236473083497, "sim_compute_robot_state-ego": 0.09177809715270996}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1357417227346686, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06743741639052765, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15209927136384988, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.11033314692823191, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04144410543803927, "sim_compute_performance-ego": 0.07658251026008703, "sim_compute_robot_state-ego": 0.08260308338116996}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.12535741377849968, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06951082482629893, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15414883652511907, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10964191203214683, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.0409813608442034, "sim_compute_performance-ego": 0.07775806894107741, "sim_compute_robot_state-ego": 0.0853379405274683}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12601950764656067, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06927497046334403, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1526123114994594, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10889776263918197, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04120628748621259, "sim_compute_performance-ego": 0.07448410136359078, "sim_compute_robot_state-ego": 0.08388432434626988}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.16584453128633045, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.07217879522414435, "in-drivable-lane": 0, "agent_compute-ego": 0.16019763265337264, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.113821960630871, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04421386264619373, "sim_compute_performance-ego": 0.0848987443106515, "sim_compute_robot_state-ego": 0.10122654551551456}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.1429888757608705, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06954278784283137, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1491199105472888, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10697974188853118, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.0431281146356615, "sim_compute_performance-ego": 0.07547530885470116, "sim_compute_robot_state-ego": 0.08374168105044608}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.15020509199662643, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.07048316868868741, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15800168297507547, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.11360958272760564, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04405683170665394, "sim_compute_performance-ego": 0.08056992617520418, "sim_compute_robot_state-ego": 0.09728380116549404}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.13651355210836832, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06976333221831879, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14856982540774655, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.11489610548143264, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04374512449487463, "sim_compute_performance-ego": 0.07527124107658088, "sim_compute_robot_state-ego": 0.08338348586837967}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.14474100725991385, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06873346226555961, "in-drivable-lane": 0, "agent_compute-ego": 0.15652241025652203, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.11523344687053136, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04232284000941685, "sim_compute_performance-ego": 0.07774343660899571, "sim_compute_robot_state-ego": 0.0823258672441755}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.13532447347453996, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06789671673494227, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1504825190001843, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10792181538600548, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04243170981313668, "sim_compute_performance-ego": 0.07735859179029278, "sim_compute_robot_state-ego": 0.08578329460293639}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.140449153052436, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0662598345014784, "in-drivable-lane": 0, "agent_compute-ego": 0.15497325084827565, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.1083222848397714, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.041542009071067525, "sim_compute_performance-ego": 0.0776786274380154, "sim_compute_robot_state-ego": 0.08682953869854962}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.1292970110388363, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.07136310315599628, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1563025338976991, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.11109270769007064, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04427838325500488, "sim_compute_performance-ego": 0.0772406587413713, "sim_compute_robot_state-ego": 0.08779261626449286}}
set_robot_commands_max	0.11896610260009766
set_robot_commands_mean	0.11140393322083247
set_robot_commands_median	0.11033314692823191
set_robot_commands_min	0.10286575205185834
sim_compute_performance-ego_max	0.0848987443106515
sim_compute_performance-ego_mean	0.07820380503599017
sim_compute_performance-ego_median	0.0776786274380154
sim_compute_performance-ego_min	0.07448410136359078
sim_compute_robot_state-ego_max	0.10122654551551456
sim_compute_robot_state-ego_mean	0.08760415089003963
sim_compute_robot_state-ego_median	0.0853379405274683
sim_compute_robot_state-ego_min	0.0823258672441755
sim_compute_sim_state_max	0.04536511421203613
sim_compute_sim_state_mean	0.04285926684676247
sim_compute_sim_state_median	0.0431281146356615
sim_compute_sim_state_min	0.04051014956306009
sim_physics_max	0.16584453128633045
sim_physics_mean	0.13961399017105564
sim_physics_median	0.13651355210836832
sim_physics_min	0.12535741377849968
sim_render-ego_max	0.07317835807800294
sim_render-ego_mean	0.06934915472331672
sim_render-ego_median	0.06954278784283137
sim_render-ego_min	0.06334024317124311
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21357

2371

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-28 01:00:37+00:00

2019-04-28 01:58:38+00:00

0:58:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4278874896529574
survival_time_median	7.049999999999983
deviation-center-line_median	0.336080725822317
in-drivable-lane_median	1.999999999999993

other stats

agent_compute-ego_max	0.166347751077616
agent_compute-ego_mean	0.16020932298061472
agent_compute-ego_median	0.1618060762920077
agent_compute-ego_min	0.1484904475245915
deviation-center-line_max	0.6395179658578088
deviation-center-line_mean	0.3376081825040823
deviation-center-line_min	0.18432680552089345
deviation-heading_max	2.5988183506786204
deviation-heading_mean	1.1439412496731016
deviation-heading_median	1.0007157377877205
deviation-heading_min	0.4339628546397995
driven_any_max	2.1824083368295137
driven_any_mean	1.041548572842095
driven_any_median	1.002289442536604
driven_any_min	0.3471148409579561
driven_lanedir_consec_max	1.2416141769078073
driven_lanedir_consec_mean	0.5855696461150995
driven_lanedir_consec_min	0.32724226781545207
driven_lanedir_max	1.2416141769078073
driven_lanedir_mean	0.5855696461150995
driven_lanedir_median	0.4278874896529574
driven_lanedir_min	0.32724226781545207
in-drivable-lane_max	10.500000000000064
in-drivable-lane_mean	2.776666666666675
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.1903588137180685, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06670906560884106, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1661206801160634, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.10366697448620692, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03968672615161045, "sim_compute_performance-ego": 0.07491579844797258, "sim_compute_robot_state-ego": 0.08161543427611427, "sim_compute_robot_state-npc0": 0.07152837300472123, "sim_compute_robot_state-npc1": 0.0716087955365078, "sim_compute_robot_state-npc2": 0.07182335510528345, "sim_compute_robot_state-npc3": 0.07297088773988133}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.20737253673492917, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06609216947404165, "in-drivable-lane": 0, "agent_compute-ego": 0.16341634780641587, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.10627087714180114, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.04196333506750682, "sim_compute_performance-ego": 0.07464494024004255, "sim_compute_robot_state-ego": 0.07924758820306688, "sim_compute_robot_state-npc0": 0.07473040005517384, "sim_compute_robot_state-npc1": 0.07393854761880542, "sim_compute_robot_state-npc2": 0.07562311111934601, "sim_compute_robot_state-npc3": 0.07368848437354678}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.17421057807074652, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06126226743062337, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.15472804387410485, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.09784761746724446, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.039520806206597224, "sim_compute_performance-ego": 0.07038638750712077, "sim_compute_robot_state-ego": 0.07633963055080838, "sim_compute_robot_state-npc0": 0.06821095254686144, "sim_compute_robot_state-npc1": 0.07265581236945258, "sim_compute_robot_state-npc2": 0.06971927113003201, "sim_compute_robot_state-npc3": 0.07071134567260742}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.1843766814552694, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.06572433770526939, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.16235641949737126, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.1038050651550293, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.04093486482646608, "sim_compute_performance-ego": 0.07326658530169368, "sim_compute_robot_state-ego": 0.0792028244739304, "sim_compute_robot_state-npc0": 0.07266201181895172, "sim_compute_robot_state-npc1": 0.07301559426268125, "sim_compute_robot_state-npc2": 0.07249100636776691, "sim_compute_robot_state-npc3": 0.07429098863206152}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.1817115034375872, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.06213484491620745, "in-drivable-lane": 0, "agent_compute-ego": 0.16220746721540177, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.1022553595285567, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.0420467285882859, "sim_compute_performance-ego": 0.07284356298900786, "sim_compute_robot_state-ego": 0.07937381759522454, "sim_compute_robot_state-npc0": 0.07107939795842247, "sim_compute_robot_state-npc1": 0.07261081725832015, "sim_compute_robot_state-npc2": 0.07237156610640269, "sim_compute_robot_state-npc3": 0.0716051525539822}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0504010241155275, "sim_physics": 0.1821382649957317, "survival_time": 7.299999999999982, "driven_lanedir": 0.39597378214039874, "sim_render-ego": 0.06571898395068025, "in-drivable-lane": 3.5499999999999874, "agent_compute-ego": 0.16187674705296343, "deviation-heading": 2.3434677844360583, "set_robot_commands": 0.10238284770756552, "deviation-center-line": 0.37507737640988825, "driven_lanedir_consec": 0.39597378214039874, "sim_compute_sim_state": 0.04002907341473723, "sim_compute_performance-ego": 0.07419231003277922, "sim_compute_robot_state-ego": 0.07963056433690738, "sim_compute_robot_state-npc0": 0.07525010631509023, "sim_compute_robot_state-npc1": 0.07224949745282735, "sim_compute_robot_state-npc2": 0.07162355070244776, "sim_compute_robot_state-npc3": 0.07198097117959637}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9925466226450728, "sim_physics": 0.17832533232599712, "survival_time": 6.949999999999983, "driven_lanedir": 0.647038156506072, "sim_render-ego": 0.06406082352288335, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1598572833932561, "deviation-heading": 1.5590891377390808, "set_robot_commands": 0.09867278963541812, "deviation-center-line": 0.37918470593477854, "driven_lanedir_consec": 0.647038156506072, "sim_compute_sim_state": 0.04093786795362294, "sim_compute_performance-ego": 0.07262150160700297, "sim_compute_robot_state-ego": 0.07672525481354418, "sim_compute_robot_state-npc0": 0.07185548158000699, "sim_compute_robot_state-npc1": 0.07295788106300848, "sim_compute_robot_state-npc2": 0.07114026357801698, "sim_compute_robot_state-npc3": 0.07272772994830454}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5143195051826088, "sim_physics": 0.1930832532033966, "survival_time": 10.450000000000014, "driven_lanedir": 0.5946085645782655, "sim_render-ego": 0.06446365534403678, "in-drivable-lane": 6.050000000000021, "agent_compute-ego": 0.1646585532923064, "deviation-heading": 1.0074551066905668, "set_robot_commands": 0.1015162182766855, "deviation-center-line": 0.31096291732963327, "driven_lanedir_consec": 0.5946085645782655, "sim_compute_sim_state": 0.04126174598219292, "sim_compute_performance-ego": 0.07111651589425556, "sim_compute_robot_state-ego": 0.07960157873527855, "sim_compute_robot_state-npc0": 0.07081033054151033, "sim_compute_robot_state-npc1": 0.0728912022695587, "sim_compute_robot_state-npc2": 0.07189494685122841, "sim_compute_robot_state-npc3": 0.07274684723484459}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0526053931137378, "sim_physics": 0.15453075389472806, "survival_time": 7.349999999999982, "driven_lanedir": 0.35306598250901233, "sim_render-ego": 0.05837835908747044, "in-drivable-lane": 4.599999999999984, "agent_compute-ego": 0.1498620737166632, "deviation-heading": 0.7493734577809043, "set_robot_commands": 0.09542817161196754, "deviation-center-line": 0.2543770508936741, "driven_lanedir_consec": 0.35306598250901233, "sim_compute_sim_state": 0.03783705283184441, "sim_compute_performance-ego": 0.06652706010001046, "sim_compute_robot_state-ego": 0.07226603858324947, "sim_compute_robot_state-npc0": 0.06764216163531453, "sim_compute_robot_state-npc1": 0.06773491457206052, "sim_compute_robot_state-npc2": 0.07003786612530144, "sim_compute_robot_state-npc3": 0.06684630095553236}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4247089136171447, "sim_physics": 0.17909156330048093, "survival_time": 3.149999999999997, "driven_lanedir": 0.4065794545774155, "sim_render-ego": 0.06624937814379496, "in-drivable-lane": 0, "agent_compute-ego": 0.1618060762920077, "deviation-heading": 0.9116478049678652, "set_robot_commands": 0.10472418391515338, "deviation-center-line": 0.20984142395940591, "driven_lanedir_consec": 0.4065794545774155, "sim_compute_sim_state": 0.04083309097895547, "sim_compute_performance-ego": 0.07267392627776616, "sim_compute_robot_state-ego": 0.07753860382806688, "sim_compute_robot_state-npc0": 0.07368204707191103, "sim_compute_robot_state-npc1": 0.07746285105508471, "sim_compute_robot_state-npc2": 0.07486608671763587, "sim_compute_robot_state-npc3": 0.07575979308476524}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3471148409579561, "sim_physics": 0.21094100880173017, "survival_time": 2.6499999999999986, "driven_lanedir": 0.32724226781545207, "sim_render-ego": 0.06939114714568516, "in-drivable-lane": 0, "agent_compute-ego": 0.166347751077616, "deviation-heading": 0.8969790273027586, "set_robot_commands": 0.10723953427008864, "deviation-center-line": 0.18432680552089345, "driven_lanedir_consec": 0.32724226781545207, "sim_compute_sim_state": 0.04248569596488521, "sim_compute_performance-ego": 0.074243666990748, "sim_compute_robot_state-ego": 0.08296077206449688, "sim_compute_robot_state-npc0": 0.07485756784115198, "sim_compute_robot_state-npc1": 0.07172947559716567, "sim_compute_robot_state-npc2": 0.0746167650762594, "sim_compute_robot_state-npc3": 0.07452455556617593}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.43182353608565555, "sim_physics": 0.17165333777666092, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4278874896529574, "sim_render-ego": 0.06042895093560219, "in-drivable-lane": 0, "agent_compute-ego": 0.16036446392536163, "deviation-heading": 0.4339628546397995, "set_robot_commands": 0.10664435103535652, "deviation-center-line": 0.336080725822317, "driven_lanedir_consec": 0.4278874896529574, "sim_compute_sim_state": 0.04072321578860283, "sim_compute_performance-ego": 0.06878132745623589, "sim_compute_robot_state-ego": 0.07644640654325485, "sim_compute_robot_state-npc0": 0.07064978405833244, "sim_compute_robot_state-npc1": 0.07051508873701096, "sim_compute_robot_state-npc2": 0.06961655616760254, "sim_compute_robot_state-npc3": 0.06810386851429939}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.002289442536604, "sim_physics": 0.17184927108439993, "survival_time": 7.049999999999983, "driven_lanedir": 0.3465233549666594, "sim_render-ego": 0.05928310942142568, "in-drivable-lane": 4.3499999999999845, "agent_compute-ego": 0.1484904475245915, "deviation-heading": 0.5501933908035521, "set_robot_commands": 0.08989416453855258, "deviation-center-line": 0.33321411572814535, "driven_lanedir_consec": 0.3465233549666594, "sim_compute_sim_state": 0.03655922159235528, "sim_compute_performance-ego": 0.06525555570074852, "sim_compute_robot_state-ego": 0.07055455403970488, "sim_compute_robot_state-npc0": 0.06259327070087406, "sim_compute_robot_state-npc1": 0.06377789822030575, "sim_compute_robot_state-npc2": 0.06326032868513824, "sim_compute_robot_state-npc3": 0.0638697012096432}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5767327422600936, "sim_physics": 0.17805970539145757, "survival_time": 10.85000000000002, "driven_lanedir": 1.2416141769078073, "sim_render-ego": 0.06537404038389708, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.1598787461557696, "deviation-heading": 1.4083883035350369, "set_robot_commands": 0.1054866456765733, "deviation-center-line": 0.6395179658578088, "driven_lanedir_consec": 1.2416141769078073, "sim_compute_sim_state": 0.04050825488182806, "sim_compute_performance-ego": 0.07238027686896961, "sim_compute_robot_state-ego": 0.07914777175622052, "sim_compute_robot_state-npc0": 0.07176664897373744, "sim_compute_robot_state-npc1": 0.0708557493675689, "sim_compute_robot_state-npc2": 0.07114738692885719, "sim_compute_robot_state-npc3": 0.07239220988365912}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1824083368295137, "sim_physics": 0.19083731651306152, "survival_time": 14.950000000000076, "driven_lanedir": 0.4632121180957165, "sim_render-ego": 0.06548775196075439, "in-drivable-lane": 10.500000000000064, "agent_compute-ego": 0.1611687437693278, "deviation-heading": 2.5988183506786204, "set_robot_commands": 0.10204815864562988, "deviation-center-line": 0.3466574247419256, "driven_lanedir_consec": 0.4632121180957165, "sim_compute_sim_state": 0.041259674231211345, "sim_compute_performance-ego": 0.0712341030438741, "sim_compute_robot_state-ego": 0.08025039513905843, "sim_compute_robot_state-npc0": 0.07137004931767782, "sim_compute_robot_state-npc1": 0.07335213343302409, "sim_compute_robot_state-npc2": 0.07293006181716918, "sim_compute_robot_state-npc3": 0.07408210833867392}}
set_robot_commands_max	0.10723953427008864
set_robot_commands_mean	0.1018588639394553
set_robot_commands_median	0.10238284770756552
set_robot_commands_min	0.08989416453855258
sim_compute_performance-ego_max	0.07491579844797258
sim_compute_performance-ego_mean	0.07167223456388185
sim_compute_performance-ego_median	0.07262150160700297
sim_compute_performance-ego_min	0.06525555570074852
sim_compute_robot_state-ego_max	0.08296077206449688
sim_compute_robot_state-ego_mean	0.07806008232926179
sim_compute_robot_state-ego_median	0.0792028244739304
sim_compute_robot_state-ego_min	0.07055455403970488
sim_compute_robot_state-npc0_max	0.07525010631509023
sim_compute_robot_state-npc0_mean	0.07124590556131584
sim_compute_robot_state-npc0_median	0.07152837300472123
sim_compute_robot_state-npc0_min	0.06259327070087406
sim_compute_robot_state-npc1_max	0.07746285105508471
sim_compute_robot_state-npc1_mean	0.07182375058755883
sim_compute_robot_state-npc1_median	0.07261081725832015
sim_compute_robot_state-npc1_min	0.06377789822030575
sim_compute_robot_state-npc2_max	0.07562311111934601
sim_compute_robot_state-npc2_mean	0.07154414149856586
sim_compute_robot_state-npc2_median	0.07182335510528345
sim_compute_robot_state-npc2_min	0.06326032868513824
sim_compute_robot_state-npc3_max	0.07575979308476524
sim_compute_robot_state-npc3_mean	0.07175339632583827
sim_compute_robot_state-npc3_median	0.07272772994830454
sim_compute_robot_state-npc3_min	0.0638697012096432
sim_compute_sim_state_max	0.04248569596488521
sim_compute_sim_state_mean	0.04043915696404681
sim_compute_sim_state_median	0.04083309097895547
sim_compute_sim_state_min	0.03655922159235528
sim_physics_max	0.21094100880173017
sim_physics_mean	0.18323599471361632
sim_physics_median	0.1817115034375872
sim_physics_min	0.15453075389472806
sim_render-ego_max	0.06939114714568516
sim_render-ego_mean	0.06405059233541423
sim_render-ego_median	0.06537404038389708
sim_render-ego_min	0.05837835908747044
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.283333333333336
survival_time_min	2.6499999999999986

No reset possible

21350

2379

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

2019-04-28 00:48:14+00:00

2019-04-28 01:00:10+00:00

0:11:56

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2379/step1-simulation-ip-172-31-25-98-2348-job21350/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21345

2386

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 00:29:52+00:00

2019-04-28 00:47:21+00:00

0:17:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06286001601013291
survival_time_median	1.4500000000000006
deviation-center-line_median	0.08868230457337024
in-drivable-lane_median	0.5000000000000003

other stats

agent_compute-ego_max	0.22510191489910256
agent_compute-ego_mean	0.20664532854228773
agent_compute-ego_median	0.20022883622542673
agent_compute-ego_min	0.19334477120703392
deviation-center-line_max	0.28779664409787575
deviation-center-line_mean	0.13642829798165587
deviation-center-line_min	0.02697663424431847
deviation-heading_max	5.78841695315075
deviation-heading_mean	2.252129623703735
deviation-heading_median	0.6445801095848621
deviation-heading_min	0.554261896482513
driven_any_max	1.6600169500923296
driven_any_mean	0.615062918364568
driven_any_median	0.14285671180369677
driven_any_min	0.10299046279145392
driven_lanedir_consec_max	0.568886482004257
driven_lanedir_consec_mean	0.2193281645188801
driven_lanedir_consec_min	0.04970005488662543
driven_lanedir_max	0.568886482004257
driven_lanedir_mean	0.2193281645188801
driven_lanedir_median	0.06286001601013291
driven_lanedir_min	0.04970005488662543
in-drivable-lane_max	7.350000000000044
in-drivable-lane_mean	2.510000000000008
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6600169500923296, "sim_physics": 0.20664709250132243, "survival_time": 14.950000000000076, "driven_lanedir": 0.568886482004257, "sim_render-ego": 0.07046858390172323, "in-drivable-lane": 7.350000000000044, "agent_compute-ego": 0.19910770654678345, "deviation-heading": 5.78841695315075, "set_robot_commands": 0.10798128604888917, "deviation-center-line": 0.28779664409787575, "driven_lanedir_consec": 0.568886482004257, "sim_compute_sim_state": 0.04358384927113851, "sim_compute_performance-ego": 0.07955265283584595, "sim_compute_robot_state-ego": 0.0869178326924642, "sim_compute_robot_state-npc0": 0.075844353834788, "sim_compute_robot_state-npc1": 0.07651700178782145, "sim_compute_robot_state-npc2": 0.07706746260325113, "sim_compute_robot_state-npc3": 0.07837745745976767}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0330242542798689, "sim_physics": 0.1900785847024603, "survival_time": 9.099999999999994, "driven_lanedir": 0.3553532550806664, "sim_render-ego": 0.06867630010122781, "in-drivable-lane": 4.299999999999997, "agent_compute-ego": 0.19334477120703392, "deviation-heading": 3.656532742392539, "set_robot_commands": 0.10812927602411626, "deviation-center-line": 0.192367723596138, "driven_lanedir_consec": 0.3553532550806664, "sim_compute_sim_state": 0.04234173533680675, "sim_compute_performance-ego": 0.07611247995397546, "sim_compute_robot_state-ego": 0.08228396321391011, "sim_compute_robot_state-npc0": 0.07609805431994764, "sim_compute_robot_state-npc1": 0.07665163344079322, "sim_compute_robot_state-npc2": 0.07541082979558589, "sim_compute_robot_state-npc3": 0.07816311684283582}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13642621285549064, "sim_physics": 0.22953830094173036, "survival_time": 1.4500000000000006, "driven_lanedir": 0.06286001601013291, "sim_render-ego": 0.07341319117052801, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.22510191489910256, "deviation-heading": 0.554261896482513, "set_robot_commands": 0.10796799330875792, "deviation-center-line": 0.0863181833965769, "driven_lanedir_consec": 0.06286001601013291, "sim_compute_sim_state": 0.04271868179584372, "sim_compute_performance-ego": 0.07933941380730991, "sim_compute_robot_state-ego": 0.0887298583984375, "sim_compute_robot_state-npc0": 0.07980603185193293, "sim_compute_robot_state-npc1": 0.07663421795285981, "sim_compute_robot_state-npc2": 0.07854730507423138, "sim_compute_robot_state-npc3": 0.07704568731373754}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10299046279145392, "sim_physics": 0.2192954913429592, "survival_time": 1.1500000000000004, "driven_lanedir": 0.059841014612718624, "sim_render-ego": 0.06934042598890222, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.20022883622542673, "deviation-heading": 0.6168564169080097, "set_robot_commands": 0.11048077500384788, "deviation-center-line": 0.08868230457337024, "driven_lanedir_consec": 0.059841014612718624, "sim_compute_sim_state": 0.04352440004763396, "sim_compute_performance-ego": 0.08105786986972975, "sim_compute_robot_state-ego": 0.07888950472292693, "sim_compute_robot_state-npc0": 0.07632076221963634, "sim_compute_robot_state-npc1": 0.07947506075320036, "sim_compute_robot_state-npc2": 0.0811572385870892, "sim_compute_robot_state-npc3": 0.07875685069871985}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14285671180369677, "sim_physics": 0.20435681836358432, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04970005488662543, "sim_render-ego": 0.0692681279675714, "in-drivable-lane": 0.5000000000000003, "agent_compute-ego": 0.215443413833092, "deviation-heading": 0.6445801095848621, "set_robot_commands": 0.11416805201563342, "deviation-center-line": 0.02697663424431847, "driven_lanedir_consec": 0.04970005488662543, "sim_compute_sim_state": 0.04047873924518454, "sim_compute_performance-ego": 0.07507362036869444, "sim_compute_robot_state-ego": 0.08654617441111598, "sim_compute_robot_state-npc0": 0.07891298162526098, "sim_compute_robot_state-npc1": 0.08007000232564992, "sim_compute_robot_state-npc2": 0.07704960066696694, "sim_compute_robot_state-npc3": 0.07587244592863938}}
set_robot_commands_max	0.11416805201563342
set_robot_commands_mean	0.10974547648024892
set_robot_commands_median	0.10812927602411626
set_robot_commands_min	0.10796799330875792
sim_compute_performance-ego_max	0.08105786986972975
sim_compute_performance-ego_mean	0.07822720736711111
sim_compute_performance-ego_median	0.07933941380730991
sim_compute_performance-ego_min	0.07507362036869444
sim_compute_robot_state-ego_max	0.0887298583984375
sim_compute_robot_state-ego_mean	0.08467346668777094
sim_compute_robot_state-ego_median	0.08654617441111598
sim_compute_robot_state-ego_min	0.07888950472292693
sim_compute_robot_state-npc0_max	0.07980603185193293
sim_compute_robot_state-npc0_mean	0.07739643677031319
sim_compute_robot_state-npc0_median	0.07632076221963634
sim_compute_robot_state-npc0_min	0.075844353834788
sim_compute_robot_state-npc1_max	0.08007000232564992
sim_compute_robot_state-npc1_mean	0.07786958325206496
sim_compute_robot_state-npc1_median	0.07665163344079322
sim_compute_robot_state-npc1_min	0.07651700178782145
sim_compute_robot_state-npc2_max	0.0811572385870892
sim_compute_robot_state-npc2_mean	0.0778464873454249
sim_compute_robot_state-npc2_median	0.07706746260325113
sim_compute_robot_state-npc2_min	0.07541082979558589
sim_compute_robot_state-npc3_max	0.07875685069871985
sim_compute_robot_state-npc3_mean	0.07764311164874005
sim_compute_robot_state-npc3_median	0.07816311684283582
sim_compute_robot_state-npc3_min	0.07587244592863938
sim_compute_sim_state_max	0.04358384927113851
sim_compute_sim_state_mean	0.04252948113932149
sim_compute_sim_state_median	0.04271868179584372
sim_compute_sim_state_min	0.04047873924518454
sim_physics_max	0.22953830094173036
sim_physics_mean	0.2099832575704113
sim_physics_median	0.20664709250132243
sim_physics_min	0.1900785847024603
sim_render-ego_max	0.07341319117052801
sim_render-ego_mean	0.07023332582599054
sim_render-ego_median	0.06934042598890222
sim_render-ego_min	0.06867630010122781
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.620000000000013
survival_time_min	1.1500000000000004

No reset possible

21343

2387

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 00:10:05+00:00

2019-04-28 00:29:18+00:00

0:19:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.12284590649079008
survival_time_median	1.3000000000000005
deviation-center-line_median	0.08478267287286778
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2167185800416129
agent_compute-ego_mean	0.2002566447382058
agent_compute-ego_median	0.19908850257461136
agent_compute-ego_min	0.1871919631958008
deviation-center-line_max	0.10185623841060208
deviation-center-line_mean	0.08250557119417226
deviation-center-line_min	0.05423445659647585
deviation-heading_max	0.9573810380966624
deviation-heading_mean	0.7200404947131688
deviation-heading_median	0.7318814242683296
deviation-heading_min	0.5021715804568063
driven_any_max	0.275312816434847
driven_any_mean	0.1859152675651686
driven_any_median	0.1797172472319633
driven_any_min	0.11861570215521566
driven_lanedir_consec_max	0.17865592456748525
driven_lanedir_consec_mean	0.1221607762262244
driven_lanedir_consec_min	0.0775343931059842
driven_lanedir_max	0.17865592456748525
driven_lanedir_mean	0.1221607762262244
driven_lanedir_median	0.12284590649079008
driven_lanedir_min	0.0775343931059842
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.09000000000000008
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.2311221001082597, "sim_physics": 0.2157578017260577, "survival_time": 1.850000000000001, "driven_lanedir": 0.09227988832315126, "sim_render-ego": 0.06827268084964237, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.20490160503902952, "deviation-heading": 0.7318814242683296, "set_robot_commands": 0.10497068714451144, "deviation-center-line": 0.06544651152348088, "driven_lanedir_consec": 0.09227988832315126, "sim_compute_sim_state": 0.04255524197140256, "sim_compute_performance-ego": 0.07386064529418945, "sim_compute_robot_state-ego": 0.08442546870257403, "sim_compute_robot_state-npc0": 0.07659308330432789, "sim_compute_robot_state-npc1": 0.07620319160255226, "sim_compute_robot_state-npc2": 0.07804862228599754, "sim_compute_robot_state-npc3": 0.07787950618846996}, "udem1-1-0": {"driven_any": 0.1858295521551483, "sim_physics": 0.2811301165613635, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0775343931059842, "sim_render-ego": 0.07380625297283304, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.19682779805413608, "deviation-heading": 0.9415541120145746, "set_robot_commands": 0.10530275311963312, "deviation-center-line": 0.0655485776071501, "driven_lanedir_consec": 0.0775343931059842, "sim_compute_sim_state": 0.046222127717116784, "sim_compute_performance-ego": 0.07929851268899851, "sim_compute_robot_state-ego": 0.09131394583603432, "sim_compute_robot_state-npc0": 0.07726005028034079, "sim_compute_robot_state-npc1": 0.07751646535149936, "sim_compute_robot_state-npc2": 0.07846047960478685, "sim_compute_robot_state-npc3": 0.08171379977259143}, "udem1-2-0": {"driven_any": 0.12532465917444754, "sim_physics": 0.2887344982313073, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0904835121594778, "sim_render-ego": 0.0718822893889054, "in-drivable-lane": 0, "agent_compute-ego": 0.1871919631958008, "deviation-heading": 0.5404044571006751, "set_robot_commands": 0.10717891610187032, "deviation-center-line": 0.09884292649566552, "driven_lanedir_consec": 0.0904835121594778, "sim_compute_sim_state": 0.040273313936979874, "sim_compute_performance-ego": 0.0776624990546185, "sim_compute_robot_state-ego": 0.08461848549220873, "sim_compute_robot_state-npc0": 0.07639416404392409, "sim_compute_robot_state-npc1": 0.07134569209554921, "sim_compute_robot_state-npc2": 0.07395094373951787, "sim_compute_robot_state-npc3": 0.0755574081255042}, "udem1-3-0": {"driven_any": 0.15554015017270462, "sim_physics": 0.26862656076749164, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12284590649079008, "sim_render-ego": 0.0749297837416331, "in-drivable-lane": 0, "agent_compute-ego": 0.19429375727971396, "deviation-heading": 0.5021715804568063, "set_robot_commands": 0.11195327838261922, "deviation-center-line": 0.09782491135285588, "driven_lanedir_consec": 0.12284590649079008, "sim_compute_sim_state": 0.042737722396850586, "sim_compute_performance-ego": 0.07547666629155476, "sim_compute_robot_state-ego": 0.0912262499332428, "sim_compute_robot_state-npc0": 0.07786031564076741, "sim_compute_robot_state-npc1": 0.07895227273305257, "sim_compute_robot_state-npc2": 0.0749557614326477, "sim_compute_robot_state-npc3": 0.07730745275815327}, "udem1-4-0": {"driven_any": 0.17190973246948074, "sim_physics": 0.23847975730895996, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1234757882657882, "sim_render-ego": 0.06810772895812989, "in-drivable-lane": 0, "agent_compute-ego": 0.19747042655944824, "deviation-heading": 0.7586819683667102, "set_robot_commands": 0.10743769645690918, "deviation-center-line": 0.06920887737503864, "driven_lanedir_consec": 0.1234757882657882, "sim_compute_sim_state": 0.043565711975097655, "sim_compute_performance-ego": 0.07537766456604005, "sim_compute_robot_state-ego": 0.08288761138916016, "sim_compute_robot_state-npc0": 0.07882904052734375, "sim_compute_robot_state-npc1": 0.07817692756652832, "sim_compute_robot_state-npc2": 0.07572099685668945, "sim_compute_robot_state-npc3": 0.0763953971862793}, "udem1-5-0": {"driven_any": 0.275312816434847, "sim_physics": 0.21868104812426445, "survival_time": 1.950000000000001, "driven_lanedir": 0.17653120554698545, "sim_render-ego": 0.073945436722193, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.18912643652695876, "deviation-heading": 0.8873022566230828, "set_robot_commands": 0.1057112522614308, "deviation-center-line": 0.0783072096240522, "driven_lanedir_consec": 0.17653120554698545, "sim_compute_sim_state": 0.04494712902949406, "sim_compute_performance-ego": 0.07777667656922951, "sim_compute_robot_state-ego": 0.07994632843213204, "sim_compute_robot_state-npc0": 0.07837864680167957, "sim_compute_robot_state-npc1": 0.07558598885169396, "sim_compute_robot_state-npc2": 0.07794987849700145, "sim_compute_robot_state-npc3": 0.08047950573456593}, "udem1-6-0": {"driven_any": 0.1797172472319633, "sim_physics": 0.27606799205144245, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14705492663281516, "sim_render-ego": 0.06854282816251119, "in-drivable-lane": 0, "agent_compute-ego": 0.2036798596382141, "deviation-heading": 0.5090445899754261, "set_robot_commands": 0.10575607419013976, "deviation-center-line": 0.09488252622355996, "driven_lanedir_consec": 0.14705492663281516, "sim_compute_sim_state": 0.042882790168126426, "sim_compute_performance-ego": 0.07748896876970927, "sim_compute_robot_state-ego": 0.0877517859141032, "sim_compute_robot_state-npc0": 0.0793485939502716, "sim_compute_robot_state-npc1": 0.07692381739616394, "sim_compute_robot_state-npc2": 0.0757975975672404, "sim_compute_robot_state-npc3": 0.07496771216392517}, "udem1-7-0": {"driven_any": 0.1848358492521261, "sim_physics": 0.27217122486659456, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1476752919793376, "sim_render-ego": 0.07054062400545393, "in-drivable-lane": 0, "agent_compute-ego": 0.2167185800416129, "deviation-heading": 0.6136506287336911, "set_robot_commands": 0.11181023291179112, "deviation-center-line": 0.10185623841060208, "driven_lanedir_consec": 0.1476752919793376, "sim_compute_sim_state": 0.04436911855425153, "sim_compute_performance-ego": 0.08136332886559623, "sim_compute_robot_state-ego": 0.09074364389692034, "sim_compute_robot_state-npc0": 0.08148575680596488, "sim_compute_robot_state-npc1": 0.07874250411987305, "sim_compute_robot_state-npc2": 0.07584300211497716, "sim_compute_robot_state-npc3": 0.07483938762119838}, "udem1-8-0": {"driven_any": 0.25008565416686185, "sim_physics": 0.23640594482421876, "survival_time": 1.7500000000000009, "driven_lanedir": 0.17865592456748525, "sim_render-ego": 0.0735550948551723, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.2063290323529925, "deviation-heading": 0.896962950106705, "set_robot_commands": 0.10837206159319196, "deviation-center-line": 0.0714004194306134, "driven_lanedir_consec": 0.17865592456748525, "sim_compute_sim_state": 0.04254590443202427, "sim_compute_performance-ego": 0.07875588280814035, "sim_compute_robot_state-ego": 0.08639910561697824, "sim_compute_robot_state-npc0": 0.07464786257062639, "sim_compute_robot_state-npc1": 0.07533922876630511, "sim_compute_robot_state-npc2": 0.07741227149963378, "sim_compute_robot_state-npc3": 0.07896994182041712}, "udem1-9-0": {"driven_any": 0.1727961847005455, "sim_physics": 0.2599544341747577, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09523242994118196, "sim_render-ego": 0.08224779825944167, "in-drivable-lane": 0, "agent_compute-ego": 0.1930363545050988, "deviation-heading": 0.9573810380966624, "set_robot_commands": 0.10667376334850603, "deviation-center-line": 0.06683866979129476, "driven_lanedir_consec": 0.09523242994118196, "sim_compute_sim_state": 0.04481587960169865, "sim_compute_performance-ego": 0.07332833913656381, "sim_compute_robot_state-ego": 0.07651591300964355, "sim_compute_robot_state-npc0": 0.07750911896045391, "sim_compute_robot_state-npc1": 0.0707244873046875, "sim_compute_robot_state-npc2": 0.07634560878460224, "sim_compute_robot_state-npc3": 0.07945193694188045}, "udem1-10-0": {"driven_any": 0.1600749674011563, "sim_physics": 0.2547481785649839, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1002788188645587, "sim_render-ego": 0.07210022470225459, "in-drivable-lane": 0, "agent_compute-ego": 0.2027543524037237, "deviation-heading": 0.7946681265507611, "set_robot_commands": 0.1079553106556768, "deviation-center-line": 0.05423445659647585, "driven_lanedir_consec": 0.1002788188645587, "sim_compute_sim_state": 0.044971134351647415, "sim_compute_performance-ego": 0.07328109119249426, "sim_compute_robot_state-ego": 0.08286282290583072, "sim_compute_robot_state-npc0": 0.07593374666960342, "sim_compute_robot_state-npc1": 0.06987253479335619, "sim_compute_robot_state-npc2": 0.08132356146107549, "sim_compute_robot_state-npc3": 0.07710006962651791}, "udem1-11-0": {"driven_any": 0.11861570215521566, "sim_physics": 0.23068945748465405, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08136292640048959, "sim_render-ego": 0.0674487068539574, "in-drivable-lane": 0, "agent_compute-ego": 0.1955101830618722, "deviation-heading": 0.5631089067425451, "set_robot_commands": 0.1083758899143764, "deviation-center-line": 0.09311812734074836, "driven_lanedir_consec": 0.08136292640048959, "sim_compute_sim_state": 0.04533432778858003, "sim_compute_performance-ego": 0.07139151436941964, "sim_compute_robot_state-ego": 0.08429898534502302, "sim_compute_robot_state-npc0": 0.07268955594017393, "sim_compute_robot_state-npc1": 0.0790474982488723, "sim_compute_robot_state-npc2": 0.08352216084798177, "sim_compute_robot_state-npc3": 0.08330270222255162}, "udem1-12-0": {"driven_any": 0.27008472421179003, "sim_physics": 0.25268587550601446, "survival_time": 1.850000000000001, "driven_lanedir": 0.16650756452587956, "sim_render-ego": 0.07237647675179146, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19908850257461136, "deviation-heading": 0.8818151332736833, "set_robot_commands": 0.11233750549522606, "deviation-center-line": 0.09744120531445484, "driven_lanedir_consec": 0.16650756452587956, "sim_compute_sim_state": 0.043823139087573904, "sim_compute_performance-ego": 0.07755125535501016, "sim_compute_robot_state-ego": 0.08387713818936735, "sim_compute_robot_state-npc0": 0.07630119452605376, "sim_compute_robot_state-npc1": 0.07682286726461875, "sim_compute_robot_state-npc2": 0.07596312986837851, "sim_compute_robot_state-npc3": 0.07643961906433105}, "udem1-13-0": {"driven_any": 0.12716082857308672, "sim_physics": 0.2480027133768255, "survival_time": 1.1000000000000003, "driven_lanedir": 0.092336281239235, "sim_render-ego": 0.0725776498967951, "in-drivable-lane": 0, "agent_compute-ego": 0.2058131911537864, "deviation-heading": 0.5171522099840089, "set_robot_commands": 0.11611037904565984, "deviation-center-line": 0.08478267287286778, "driven_lanedir_consec": 0.092336281239235, "sim_compute_sim_state": 0.04412723671306263, "sim_compute_performance-ego": 0.07416563684290106, "sim_compute_robot_state-ego": 0.08093960718675093, "sim_compute_robot_state-npc0": 0.0717159401286732, "sim_compute_robot_state-npc1": 0.07542993805625221, "sim_compute_robot_state-npc2": 0.07406307350505482, "sim_compute_robot_state-npc3": 0.07719425721602007}, "udem1-14-0": {"driven_any": 0.18031884526989608, "sim_physics": 0.262721768447331, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14015678535020593, "sim_render-ego": 0.07165047100612096, "in-drivable-lane": 0, "agent_compute-ego": 0.21110762868608748, "deviation-heading": 0.70482803840387, "set_robot_commands": 0.11283022165298462, "deviation-center-line": 0.09785023795372363, "driven_lanedir_consec": 0.14015678535020593, "sim_compute_sim_state": 0.04428000109536307, "sim_compute_performance-ego": 0.07959666422435216, "sim_compute_robot_state-ego": 0.09127068519592284, "sim_compute_robot_state-npc0": 0.08202415704727173, "sim_compute_robot_state-npc1": 0.08236633028302874, "sim_compute_robot_state-npc2": 0.07930906329836164, "sim_compute_robot_state-npc3": 0.08102025304521833}}
set_robot_commands_max	0.11611037904565984
set_robot_commands_mean	0.10885173481830177
set_robot_commands_median	0.1079553106556768
set_robot_commands_min	0.10497068714451144
sim_compute_performance-ego_max	0.08136332886559623
sim_compute_performance-ego_mean	0.07642502306858785
sim_compute_performance-ego_median	0.07748896876970927
sim_compute_performance-ego_min	0.07139151436941964
sim_compute_robot_state-ego_max	0.09131394583603432
sim_compute_robot_state-ego_mean	0.08527185180305949
sim_compute_robot_state-ego_median	0.08442546870257403
sim_compute_robot_state-ego_min	0.07651591300964355
sim_compute_robot_state-npc0_max	0.08202415704727173
sim_compute_robot_state-npc0_mean	0.0771314151464984
sim_compute_robot_state-npc0_median	0.07726005028034079
sim_compute_robot_state-npc0_min	0.0717159401286732
sim_compute_robot_state-npc1_max	0.08236633028302874
sim_compute_robot_state-npc1_mean	0.07620331629560222
sim_compute_robot_state-npc1_median	0.07682286726461875
sim_compute_robot_state-npc1_min	0.06987253479335619
sim_compute_robot_state-npc2_max	0.08352216084798177
sim_compute_robot_state-npc2_mean	0.07724441009092979
sim_compute_robot_state-npc2_median	0.07634560878460224
sim_compute_robot_state-npc2_min	0.07395094373951787
sim_compute_robot_state-npc3_max	0.08330270222255162
sim_compute_robot_state-npc3_mean	0.07817459663250828
sim_compute_robot_state-npc3_median	0.07730745275815327
sim_compute_robot_state-npc3_min	0.07483938762119838
sim_compute_sim_state_max	0.046222127717116784
sim_compute_sim_state_mean	0.04383005192128463
sim_compute_sim_state_median	0.04412723671306263
sim_compute_sim_state_min	0.040273313936979874
sim_physics_max	0.2887344982313073
sim_physics_mean	0.2536571581344178
sim_physics_median	0.2547481785649839
sim_physics_min	0.2157578017260577
sim_render-ego_max	0.08224779825944167
sim_render-ego_mean	0.0721322698084557
sim_render-ego_median	0.07210022470225459
sim_render-ego_min	0.0674487068539574
simulation-passed	1
survival_time_max	1.950000000000001
survival_time_mean	1.403333333333334
survival_time_min	1.0500000000000005

No reset possible

21339

2388

Andrea Censi 🇨🇭

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 00:00:33+00:00

2019-04-28 00:09:24+00:00

0:08:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1709560810613293
survival_time_median	1.4000000000000006
deviation-center-line_median	0.1036217346293964
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20329051859238567
agent_compute-ego_mean	0.19715551249932256
agent_compute-ego_median	0.19984275102615356
agent_compute-ego_min	0.1841610400907455
deviation-center-line_max	0.13642023816562993
deviation-center-line_mean	0.10408489439010886
deviation-center-line_min	0.07163669003666692
deviation-heading_max	0.9468835365827744
deviation-heading_mean	0.6569057830199696
deviation-heading_median	0.6473769553786441
deviation-heading_min	0.3637214784840652
driven_any_max	0.3160038124302998
driven_any_mean	0.24134688789886705
driven_any_median	0.2434399534769428
driven_any_min	0.1946976822517662
driven_lanedir_consec_max	0.2863614324023278
driven_lanedir_consec_mean	0.1903521361932231
driven_lanedir_consec_min	0.12670927794183662
driven_lanedir_max	0.2863614324023278
driven_lanedir_mean	0.1903521361932231
driven_lanedir_median	0.1709560810613293
driven_lanedir_min	0.12670927794183662
in-drivable-lane_max	0.05000000000000005
in-drivable-lane_mean	0.020000000000000014
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.24838652396507171, "sim_physics": 0.2180960178375244, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1709560810613293, "sim_render-ego": 0.06910123363617927, "in-drivable-lane": 0, "agent_compute-ego": 0.1841610400907455, "deviation-heading": 0.9227907376619362, "set_robot_commands": 0.10509774761815224, "deviation-center-line": 0.1036217346293964, "driven_lanedir_consec": 0.1709560810613293, "sim_compute_sim_state": 0.04005519805415984, "sim_compute_performance-ego": 0.0789545351459134, "sim_compute_robot_state-ego": 0.08085570796843498, "sim_compute_robot_state-npc0": 0.06965678738009545, "sim_compute_robot_state-npc1": 0.07147708246784826, "sim_compute_robot_state-npc2": 0.06900955784705377, "sim_compute_robot_state-npc3": 0.07683615530690839}, "udem1-1-0": {"driven_any": 0.20420646737025483, "sim_physics": 0.2686569599004892, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12670927794183662, "sim_render-ego": 0.07467282735384427, "in-drivable-lane": 0, "agent_compute-ego": 0.1961056269132174, "deviation-heading": 0.9468835365827744, "set_robot_commands": 0.10362802102015568, "deviation-center-line": 0.08654409044217744, "driven_lanedir_consec": 0.12670927794183662, "sim_compute_sim_state": 0.04414728054633507, "sim_compute_performance-ego": 0.08088141221266526, "sim_compute_robot_state-ego": 0.08421624623812161, "sim_compute_robot_state-npc0": 0.0798880595427293, "sim_compute_robot_state-npc1": 0.07959367678715633, "sim_compute_robot_state-npc2": 0.07831375415508564, "sim_compute_robot_state-npc3": 0.07692963343400222}, "udem1-2-0": {"driven_any": 0.2434399534769428, "sim_physics": 0.30217210735593525, "survival_time": 1.4000000000000006, "driven_lanedir": 0.2146663244366196, "sim_render-ego": 0.07506906134741646, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.20237762587411065, "deviation-heading": 0.3637214784840652, "set_robot_commands": 0.10322639771870204, "deviation-center-line": 0.1222017186766736, "driven_lanedir_consec": 0.2146663244366196, "sim_compute_sim_state": 0.04559857504708426, "sim_compute_performance-ego": 0.08028350557599749, "sim_compute_robot_state-ego": 0.0935779469353812, "sim_compute_robot_state-npc0": 0.07810363599232265, "sim_compute_robot_state-npc1": 0.07759764364787511, "sim_compute_robot_state-npc2": 0.07653841802052089, "sim_compute_robot_state-npc3": 0.07662951094763619}, "udem1-3-0": {"driven_any": 0.3160038124302998, "sim_physics": 0.2410963493234971, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2863614324023278, "sim_render-ego": 0.0657970344319063, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.20329051859238567, "deviation-heading": 0.4037562069924281, "set_robot_commands": 0.1143409013748169, "deviation-center-line": 0.13642023816562993, "driven_lanedir_consec": 0.2863614324023278, "sim_compute_sim_state": 0.0403985205818625, "sim_compute_performance-ego": 0.07516680044286392, "sim_compute_robot_state-ego": 0.08174021805033964, "sim_compute_robot_state-npc0": 0.08255619862500359, "sim_compute_robot_state-npc1": 0.07897825100842644, "sim_compute_robot_state-npc2": 0.0796894957037533, "sim_compute_robot_state-npc3": 0.07691299214082606}, "udem1-4-0": {"driven_any": 0.1946976822517662, "sim_physics": 0.2483469843864441, "survival_time": 1.2000000000000004, "driven_lanedir": 0.15306756512400232, "sim_render-ego": 0.0707865556081136, "in-drivable-lane": 0, "agent_compute-ego": 0.19984275102615356, "deviation-heading": 0.6473769553786441, "set_robot_commands": 0.1025655170281728, "deviation-center-line": 0.07163669003666692, "driven_lanedir_consec": 0.15306756512400232, "sim_compute_sim_state": 0.040718913078308105, "sim_compute_performance-ego": 0.08011164267857869, "sim_compute_robot_state-ego": 0.08184019724527995, "sim_compute_robot_state-npc0": 0.09929100672403972, "sim_compute_robot_state-npc1": 0.07794381181399028, "sim_compute_robot_state-npc2": 0.07654582460721333, "sim_compute_robot_state-npc3": 0.07396599650382996}}
set_robot_commands_max	0.1143409013748169
set_robot_commands_mean	0.10577171695199994
set_robot_commands_median	0.10362802102015568
set_robot_commands_min	0.1025655170281728
sim_compute_performance-ego_max	0.08088141221266526
sim_compute_performance-ego_mean	0.07907957921120376
sim_compute_performance-ego_median	0.08011164267857869
sim_compute_performance-ego_min	0.07516680044286392
sim_compute_robot_state-ego_max	0.0935779469353812
sim_compute_robot_state-ego_mean	0.08444606328751149
sim_compute_robot_state-ego_median	0.08184019724527995
sim_compute_robot_state-ego_min	0.08085570796843498
sim_compute_robot_state-npc0_max	0.09929100672403972
sim_compute_robot_state-npc0_mean	0.08189913765283816
sim_compute_robot_state-npc0_median	0.0798880595427293
sim_compute_robot_state-npc0_min	0.06965678738009545
sim_compute_robot_state-npc1_max	0.07959367678715633
sim_compute_robot_state-npc1_mean	0.07711809314505928
sim_compute_robot_state-npc1_median	0.07794381181399028
sim_compute_robot_state-npc1_min	0.07147708246784826
sim_compute_robot_state-npc2_max	0.0796894957037533
sim_compute_robot_state-npc2_mean	0.07601941006672538
sim_compute_robot_state-npc2_median	0.07654582460721333
sim_compute_robot_state-npc2_min	0.06900955784705377
sim_compute_robot_state-npc3_max	0.07692963343400222
sim_compute_robot_state-npc3_mean	0.07625485766664057
sim_compute_robot_state-npc3_median	0.07683615530690839
sim_compute_robot_state-npc3_min	0.07396599650382996
sim_compute_sim_state_max	0.04559857504708426
sim_compute_sim_state_mean	0.04218369746154996
sim_compute_sim_state_median	0.040718913078308105
sim_compute_sim_state_min	0.04005519805415984
sim_physics_max	0.30217210735593525
sim_physics_mean	0.25567368376077804
sim_physics_median	0.2483469843864441
sim_physics_min	0.2180960178375244
sim_render-ego_max	0.07506906134741646
sim_render-ego_mean	0.07108534247549199
sim_render-ego_median	0.0707865556081136
sim_render-ego_min	0.0657970344319063
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.4300000000000006
survival_time_min	1.2000000000000004

No reset possible

21330

2391

Liam Paull 🇨🇦

random_agent

step1-simulation

host-error

2019-04-27 23:55:37+00:00

2019-04-28 00:00:12+00:00

0:04:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2391/step1-simulation-ip-172-31-25-98-2348-job21330/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21329

2392

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-27 23:49:04+00:00

2019-04-27 23:55:11+00:00

0:06:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.16019919339348287
agent_compute-ego_mean	0.14751976196288746
agent_compute-ego_median	0.14925159381914743
agent_compute-ego_min	0.13816934940861722
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12541958137794776, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06400807257051822, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1405321094724867, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09828586048550075, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04180456090856482, "sim_compute_performance-ego": 0.07269019109231455, "sim_compute_robot_state-ego": 0.07769516662315086}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12972148259480795, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06575547947603114, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13816934940861722, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10188614620881922, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04198913948208678, "sim_compute_performance-ego": 0.07561238139283423, "sim_compute_robot_state-ego": 0.08173862625570859}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13842205440296845, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07313035516177907, "in-drivable-lane": 0, "agent_compute-ego": 0.16019919339348287, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.11519875245935776, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0434109884149888, "sim_compute_performance-ego": 0.08071296355303596, "sim_compute_robot_state-ego": 0.09183607381932876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14686190605163574, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06909674644470215, "in-drivable-lane": 0, "agent_compute-ego": 0.1494465637207031, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10961637496948244, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04209525108337402, "sim_compute_performance-ego": 0.07958717346191406, "sim_compute_robot_state-ego": 0.09177922248840333}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11935562725308577, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0656009052373186, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14925159381914743, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10537938528423069, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04186340826976148, "sim_compute_performance-ego": 0.07230252253858349, "sim_compute_robot_state-ego": 0.08210747151435176}}
set_robot_commands_max	0.11519875245935776
set_robot_commands_mean	0.10607330388147816
set_robot_commands_median	0.10537938528423069
set_robot_commands_min	0.09828586048550075
sim_compute_performance-ego_max	0.08071296355303596
sim_compute_performance-ego_mean	0.07618104640773646
sim_compute_performance-ego_median	0.07561238139283423
sim_compute_performance-ego_min	0.07230252253858349
sim_compute_robot_state-ego_max	0.09183607381932876
sim_compute_robot_state-ego_mean	0.08503131214018865
sim_compute_robot_state-ego_median	0.08210747151435176
sim_compute_robot_state-ego_min	0.07769516662315086
sim_compute_sim_state_max	0.0434109884149888
sim_compute_sim_state_mean	0.04223266963175518
sim_compute_sim_state_median	0.04198913948208678
sim_compute_sim_state_min	0.04180456090856482
sim_physics_max	0.14686190605163574
sim_physics_mean	0.13195613033608913
sim_physics_median	0.12972148259480795
sim_physics_min	0.11935562725308577
sim_render-ego_max	0.07313035516177907
sim_render-ego_mean	0.06751831177806983
sim_render-ego_median	0.06575547947603114
sim_render-ego_min	0.06400807257051822
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21327

2396

Liam Paull 🇨🇦

random_agent

step1-simulation

success

2019-04-27 23:39:40+00:00

2019-04-27 23:48:58+00:00

0:09:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.148800906382109
agent_compute-ego_mean	0.14495674313688195
agent_compute-ego_median	0.14772147468373745
agent_compute-ego_min	0.13442754745483398
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17045566770765516, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06440989617948178, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14799783406434236, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10186046141165274, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03956311720388907, "sim_compute_performance-ego": 0.06898218172567862, "sim_compute_robot_state-ego": 0.07796144485473633, "sim_compute_robot_state-npc0": 0.07165999765749331, "sim_compute_robot_state-npc1": 0.07422609682436343, "sim_compute_robot_state-npc2": 0.07193755220483851, "sim_compute_robot_state-npc3": 0.07293048611393681}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.19719676971435543, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06307305335998535, "in-drivable-lane": 0, "agent_compute-ego": 0.13442754745483398, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09990460395812988, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03999252319335937, "sim_compute_performance-ego": 0.07395821571350097, "sim_compute_robot_state-ego": 0.07674040794372558, "sim_compute_robot_state-npc0": 0.07175139427185058, "sim_compute_robot_state-npc1": 0.07140987396240234, "sim_compute_robot_state-npc2": 0.07713311195373534, "sim_compute_robot_state-npc3": 0.07322396278381348}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.2111064634825054, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06694952751460828, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.148800906382109, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10704407252763448, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.042950570583343506, "sim_compute_performance-ego": 0.07476246043255455, "sim_compute_robot_state-ego": 0.08574718550631874, "sim_compute_robot_state-npc0": 0.07628976985027916, "sim_compute_robot_state-npc1": 0.07580091137635081, "sim_compute_robot_state-npc2": 0.07447289793114913, "sim_compute_robot_state-npc3": 0.07530717473281057}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.20320230194284947, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.069329702401463, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14772147468373745, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10264258746859392, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04265196112137806, "sim_compute_performance-ego": 0.07685117480121081, "sim_compute_robot_state-ego": 0.07769879208335394, "sim_compute_robot_state-npc0": 0.07587100282500062, "sim_compute_robot_state-npc1": 0.07387713540958453, "sim_compute_robot_state-npc2": 0.07654249819019172, "sim_compute_robot_state-npc3": 0.07832561263555213}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18537371499197824, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06314256361552648, "in-drivable-lane": 0, "agent_compute-ego": 0.14583595309938704, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10255064283098492, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0441854681287493, "sim_compute_performance-ego": 0.07366506542478289, "sim_compute_robot_state-ego": 0.0786108033997672, "sim_compute_robot_state-npc0": 0.07272485324314662, "sim_compute_robot_state-npc1": 0.0767279863357544, "sim_compute_robot_state-npc2": 0.07743333918707711, "sim_compute_robot_state-npc3": 0.07472971507481166}}
set_robot_commands_max	0.10704407252763448
set_robot_commands_mean	0.1028004736393992
set_robot_commands_median	0.10255064283098492
set_robot_commands_min	0.09990460395812988
sim_compute_performance-ego_max	0.07685117480121081
sim_compute_performance-ego_mean	0.07364381961954557
sim_compute_performance-ego_median	0.07395821571350097
sim_compute_performance-ego_min	0.06898218172567862
sim_compute_robot_state-ego_max	0.08574718550631874
sim_compute_robot_state-ego_mean	0.07935172675758036
sim_compute_robot_state-ego_median	0.07796144485473633
sim_compute_robot_state-ego_min	0.07674040794372558
sim_compute_robot_state-npc0_max	0.07628976985027916
sim_compute_robot_state-npc0_mean	0.07365940356955405
sim_compute_robot_state-npc0_median	0.07272485324314662
sim_compute_robot_state-npc0_min	0.07165999765749331
sim_compute_robot_state-npc1_max	0.0767279863357544
sim_compute_robot_state-npc1_mean	0.0744084007816911
sim_compute_robot_state-npc1_median	0.07422609682436343
sim_compute_robot_state-npc1_min	0.07140987396240234
sim_compute_robot_state-npc2_max	0.07743333918707711
sim_compute_robot_state-npc2_mean	0.07550387989339837
sim_compute_robot_state-npc2_median	0.07654249819019172
sim_compute_robot_state-npc2_min	0.07193755220483851
sim_compute_robot_state-npc3_max	0.07832561263555213
sim_compute_robot_state-npc3_mean	0.07490339026818493
sim_compute_robot_state-npc3_median	0.07472971507481166
sim_compute_robot_state-npc3_min	0.07293048611393681
sim_compute_sim_state_max	0.0441854681287493
sim_compute_sim_state_mean	0.04186872804614386
sim_compute_sim_state_median	0.04265196112137806
sim_compute_sim_state_min	0.03956311720388907
sim_physics_max	0.2111064634825054
sim_physics_mean	0.19346698356786876
sim_physics_median	0.19719676971435543
sim_physics_min	0.17045566770765516
sim_render-ego_max	0.069329702401463
sim_render-ego_mean	0.06538094861421298
sim_render-ego_median	0.06440989617948178
sim_render-ego_min	0.06307305335998535
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

21314

2413

jiang peng

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 23:00:33+00:00

2019-04-27 23:39:32+00:00

0:38:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.339803295303147
survival_time_median	14.950000000000076
deviation-center-line_median	1.0021347592871723
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.22064355214436848
agent_compute-ego_mean	0.1844451103210449
agent_compute-ego_median	0.17718034505844116
agent_compute-ego_min	0.16582769950230916
deviation-center-line_max	1.5296442281508644
deviation-center-line_mean	0.9253718574185378
deviation-center-line_min	0.2826196070981827
deviation-heading_max	8.558153948461719
deviation-heading_mean	7.098260242116498
deviation-heading_median	7.090641611385008
deviation-heading_min	5.695926383403844
driven_any_max	4.3785064440528245
driven_any_mean	4.378506444052816
driven_any_median	4.378506444052819
driven_any_min	4.378506444052804
driven_lanedir_consec_max	-1.272834629261013
driven_lanedir_consec_mean	-1.3313573411979192
driven_lanedir_consec_min	-1.3670060414727203
driven_lanedir_max	-1.366266842110191
driven_lanedir_mean	-2.078204689886424
driven_lanedir_median	-2.260643253811775
driven_lanedir_min	-2.710754983563031
in-drivable-lane_max	7.400000000000039
in-drivable-lane_mean	4.620000000000026
in-drivable-lane_min	2.150000000000011
per-episodes	details {"udem1-0-0": {"driven_any": 4.378506444052811, "sim_physics": 0.24360220750172937, "survival_time": 14.950000000000076, "driven_lanedir": -2.710754983563031, "sim_render-ego": 0.07393469413121541, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.22064355214436848, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.1188448413213094, "deviation-center-line": 1.5195321584534802, "driven_lanedir_consec": -1.3108758978425243, "sim_compute_sim_state": 0.04383124192555746, "sim_compute_performance-ego": 0.08364928563435872, "sim_compute_robot_state-ego": 0.09254330237706504, "sim_compute_robot_state-npc0": 0.08156222105026245, "sim_compute_robot_state-npc1": 0.07889110565185548, "sim_compute_robot_state-npc2": 0.07868495146433513, "sim_compute_robot_state-npc3": 0.07890955766042074}, "udem1-1-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.20752569913864136, "survival_time": 14.950000000000076, "driven_lanedir": -2.686352328474403, "sim_render-ego": 0.06327906211217245, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17433134953180948, "deviation-heading": 8.558153948461719, "set_robot_commands": 0.09926656484603882, "deviation-center-line": 1.5296442281508644, "driven_lanedir_consec": -1.272834629261013, "sim_compute_sim_state": 0.04005428075790405, "sim_compute_performance-ego": 0.07005025307337442, "sim_compute_robot_state-ego": 0.07557531833648681, "sim_compute_robot_state-npc0": 0.06888118743896485, "sim_compute_robot_state-npc1": 0.07007888317108155, "sim_compute_robot_state-npc2": 0.07046968301137288, "sim_compute_robot_state-npc3": 0.06932422240575155}, "udem1-2-0": {"driven_any": 4.378506444052804, "sim_physics": 0.20685929854710897, "survival_time": 14.950000000000076, "driven_lanedir": -1.366266842110191, "sim_render-ego": 0.06306960582733154, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.17718034505844116, "deviation-heading": 5.773684892471283, "set_robot_commands": 0.10036014238993328, "deviation-center-line": 0.29292853410298886, "driven_lanedir_consec": -1.366266842110191, "sim_compute_sim_state": 0.03973434368769328, "sim_compute_performance-ego": 0.07067689021428426, "sim_compute_robot_state-ego": 0.0754962682723999, "sim_compute_robot_state-npc0": 0.07018885294596354, "sim_compute_robot_state-npc1": 0.07135213851928711, "sim_compute_robot_state-npc2": 0.07239890734354655, "sim_compute_robot_state-npc3": 0.07077792565027873}, "udem1-3-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.218648738861084, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670060414727203, "sim_render-ego": 0.0654394006729126, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.1842426053682963, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.09836604197820029, "deviation-center-line": 0.2826196070981827, "driven_lanedir_consec": -1.3670060414727203, "sim_compute_sim_state": 0.040605164368947344, "sim_compute_performance-ego": 0.07176839113235474, "sim_compute_robot_state-ego": 0.07771636962890625, "sim_compute_robot_state-npc0": 0.07159257253011067, "sim_compute_robot_state-npc1": 0.06924052238464355, "sim_compute_robot_state-npc2": 0.07019724686940511, "sim_compute_robot_state-npc3": 0.07071215311686198}, "udem1-4-0": {"driven_any": 4.378506444052819, "sim_physics": 0.18832855304082236, "survival_time": 14.950000000000076, "driven_lanedir": -2.260643253811775, "sim_render-ego": 0.060257879892985027, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.16582769950230916, "deviation-heading": 7.090641611385008, "set_robot_commands": 0.09258795897165936, "deviation-center-line": 1.0021347592871723, "driven_lanedir_consec": -1.339803295303147, "sim_compute_sim_state": 0.036532936890920006, "sim_compute_performance-ego": 0.06540663560231527, "sim_compute_robot_state-ego": 0.06996635595957439, "sim_compute_robot_state-npc0": 0.06677790562311808, "sim_compute_robot_state-npc1": 0.06590136528015136, "sim_compute_robot_state-npc2": 0.06259807030359904, "sim_compute_robot_state-npc3": 0.06349737167358399}}
set_robot_commands_max	0.1188448413213094
set_robot_commands_mean	0.10188510990142824
set_robot_commands_median	0.09926656484603882
set_robot_commands_min	0.09258795897165936
sim_compute_performance-ego_max	0.08364928563435872
sim_compute_performance-ego_mean	0.0723102911313375
sim_compute_performance-ego_median	0.07067689021428426
sim_compute_performance-ego_min	0.06540663560231527
sim_compute_robot_state-ego_max	0.09254330237706504
sim_compute_robot_state-ego_mean	0.07825952291488648
sim_compute_robot_state-ego_median	0.07557531833648681
sim_compute_robot_state-ego_min	0.06996635595957439
sim_compute_robot_state-npc0_max	0.08156222105026245
sim_compute_robot_state-npc0_mean	0.07180054791768392
sim_compute_robot_state-npc0_median	0.07018885294596354
sim_compute_robot_state-npc0_min	0.06677790562311808
sim_compute_robot_state-npc1_max	0.07889110565185548
sim_compute_robot_state-npc1_mean	0.07109280300140382
sim_compute_robot_state-npc1_median	0.07007888317108155
sim_compute_robot_state-npc1_min	0.06590136528015136
sim_compute_robot_state-npc2_max	0.07868495146433513
sim_compute_robot_state-npc2_mean	0.07086977179845175
sim_compute_robot_state-npc2_median	0.07046968301137288
sim_compute_robot_state-npc2_min	0.06259807030359904
sim_compute_robot_state-npc3_max	0.07890955766042074
sim_compute_robot_state-npc3_mean	0.0706442461013794
sim_compute_robot_state-npc3_median	0.07071215311686198
sim_compute_robot_state-npc3_min	0.06349737167358399
sim_compute_sim_state_max	0.04383124192555746
sim_compute_sim_state_mean	0.04015159352620442
sim_compute_sim_state_median	0.04005428075790405
sim_compute_sim_state_min	0.036532936890920006
sim_physics_max	0.24360220750172937
sim_physics_mean	0.2129928994178772
sim_physics_median	0.20752569913864136
sim_physics_min	0.18832855304082236
sim_render-ego_max	0.07393469413121541
sim_render-ego_mean	0.0651961285273234
sim_render-ego_median	0.06327906211217245
sim_render-ego_min	0.060257879892985027
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21302

2411

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 22:58:32+00:00

2019-04-27 23:00:18+00:00

0:01:46

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2411/step1-simulation-ip-172-31-25-98-2348-job21302/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21293

2443

Jacopo Tani

random_agent

step1-simulation

success

2019-04-27 22:24:31+00:00

2019-04-27 22:57:38+00:00

0:33:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.1742130010686022
agent_compute-ego_mean	0.16679178368281206
agent_compute-ego_median	0.16692202993967
agent_compute-ego_min	0.14833842856543406
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.208573709560346, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06625311284125605, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1607921998712081, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10145072997370852, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0395254243778277, "sim_compute_performance-ego": 0.07068697712089442, "sim_compute_robot_state-ego": 0.07612124877639964, "sim_compute_robot_state-npc0": 0.07271626629406892, "sim_compute_robot_state-npc1": 0.07331927818588063, "sim_compute_robot_state-npc2": 0.07566935503030126, "sim_compute_robot_state-npc3": 0.07246275793147992}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2007228902408055, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06256728512900216, "in-drivable-lane": 0, "agent_compute-ego": 0.14833842856543406, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10080158710479736, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04175396476473127, "sim_compute_performance-ego": 0.06977616889136178, "sim_compute_robot_state-ego": 0.07717798437391009, "sim_compute_robot_state-npc0": 0.0702211856842041, "sim_compute_robot_state-npc1": 0.0654485651424953, "sim_compute_robot_state-npc2": 0.06767470496041435, "sim_compute_robot_state-npc3": 0.0695785539490836}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.21222280761570608, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06595295841254077, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1718848237713564, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10466689044989427, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.041416013125077034, "sim_compute_performance-ego": 0.07397689865630808, "sim_compute_robot_state-ego": 0.08207295704813837, "sim_compute_robot_state-npc0": 0.07482252537625507, "sim_compute_robot_state-npc1": 0.0736994743347168, "sim_compute_robot_state-npc2": 0.07413416695826262, "sim_compute_robot_state-npc3": 0.0722848049645285}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.21171746154626211, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0624938557545344, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.164681538939476, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.102616752187411, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03866795698801676, "sim_compute_performance-ego": 0.07554626961549123, "sim_compute_robot_state-ego": 0.07554373145103455, "sim_compute_robot_state-npc0": 0.0744961549838384, "sim_compute_robot_state-npc1": 0.072391872604688, "sim_compute_robot_state-npc2": 0.07006778319676717, "sim_compute_robot_state-npc3": 0.07170714437961578}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.22273442858741396, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06182763690040225, "in-drivable-lane": 0, "agent_compute-ego": 0.16603951227097286, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09818509646824428, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04028869810558501, "sim_compute_performance-ego": 0.07076266833714076, "sim_compute_robot_state-ego": 0.07912609690711611, "sim_compute_robot_state-npc0": 0.06710127421787807, "sim_compute_robot_state-npc1": 0.07106956981477283, "sim_compute_robot_state-npc2": 0.07453905968439012, "sim_compute_robot_state-npc3": 0.07213113421485537}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.20497648159186996, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06483423067424111, "in-drivable-lane": 2, "agent_compute-ego": 0.1658671130677183, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10743887410192432, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04096319289978393, "sim_compute_performance-ego": 0.07333349896048358, "sim_compute_robot_state-ego": 0.0798489933242341, "sim_compute_robot_state-npc0": 0.07355424601160837, "sim_compute_robot_state-npc1": 0.07349594053394067, "sim_compute_robot_state-npc2": 0.07163968343220785, "sim_compute_robot_state-npc3": 0.07345271681597133}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2150454011935632, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0649226174771207, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16692202993967, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10556330727142038, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03967923562503555, "sim_compute_performance-ego": 0.07347624047288617, "sim_compute_robot_state-ego": 0.07610158086980431, "sim_compute_robot_state-npc0": 0.06999925733769982, "sim_compute_robot_state-npc1": 0.0699931556738696, "sim_compute_robot_state-npc2": 0.07274450839144513, "sim_compute_robot_state-npc3": 0.07103874382463474}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.2522567558288574, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06862378597259522, "in-drivable-lane": 0, "agent_compute-ego": 0.1735181140899658, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.10835883140563964, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.04101339817047119, "sim_compute_performance-ego": 0.07425207614898682, "sim_compute_robot_state-ego": 0.0901519250869751, "sim_compute_robot_state-npc0": 0.07358609199523926, "sim_compute_robot_state-npc1": 0.07546551704406738, "sim_compute_robot_state-npc2": 0.07481909275054932, "sim_compute_robot_state-npc3": 0.07380535125732422}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.23726120361915, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06623217692741981, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.17105517020592323, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10665380037747896, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.041324432079608626, "sim_compute_performance-ego": 0.07434353461632362, "sim_compute_robot_state-ego": 0.08519406960560726, "sim_compute_robot_state-npc0": 0.07327145338058472, "sim_compute_robot_state-npc1": 0.07228606480818528, "sim_compute_robot_state-npc2": 0.07214176196318406, "sim_compute_robot_state-npc3": 0.07262217540007371}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.24086124163407543, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.061939697999220625, "in-drivable-lane": 0, "agent_compute-ego": 0.16396010839022124, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09970309184147762, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.038687825202941895, "sim_compute_performance-ego": 0.0695195198059082, "sim_compute_robot_state-ego": 0.07133017136500432, "sim_compute_robot_state-npc0": 0.07345403157747708, "sim_compute_robot_state-npc1": 0.06882201708280124, "sim_compute_robot_state-npc2": 0.06724882125854492, "sim_compute_robot_state-npc3": 0.07144055916712834}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.22688040950081564, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06338826092806729, "in-drivable-lane": 0, "agent_compute-ego": 0.17049406875263562, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.0997427160089666, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04002303426915949, "sim_compute_performance-ego": 0.06833903356031938, "sim_compute_robot_state-ego": 0.07861444083127109, "sim_compute_robot_state-npc0": 0.07103106108578769, "sim_compute_robot_state-npc1": 0.07447759671644731, "sim_compute_robot_state-npc2": 0.07266731695695357, "sim_compute_robot_state-npc3": 0.07674914056604559}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.20809770107269288, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.0647273302078247, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1681465005874634, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.1024174451828003, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04042142868041992, "sim_compute_performance-ego": 0.07252336978912353, "sim_compute_robot_state-ego": 0.08055571079254151, "sim_compute_robot_state-npc0": 0.07217225074768066, "sim_compute_robot_state-npc1": 0.07372903823852539, "sim_compute_robot_state-npc2": 0.07151680469512939, "sim_compute_robot_state-npc3": 0.0706689453125}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.21462537887248587, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06607075194095044, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1742130010686022, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.10731072628751714, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.0440152274801376, "sim_compute_performance-ego": 0.07205510139465332, "sim_compute_robot_state-ego": 0.07927151690138147, "sim_compute_robot_state-npc0": 0.07385372861902764, "sim_compute_robot_state-npc1": 0.07263094567238017, "sim_compute_robot_state-npc2": 0.07351154723065964, "sim_compute_robot_state-npc3": 0.07355170807939895}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.21407048060343817, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06692073895381047, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1721322123820965, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10692068246694712, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.044234550916231595, "sim_compute_performance-ego": 0.07520491801775418, "sim_compute_robot_state-ego": 0.08506414064994225, "sim_compute_robot_state-npc0": 0.07172682652106652, "sim_compute_robot_state-npc1": 0.07689988613128662, "sim_compute_robot_state-npc2": 0.07480659393163827, "sim_compute_robot_state-npc3": 0.07724767464857835}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.20261620112827847, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06570281074160621, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.16383193333943685, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09955653463091169, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.039441124598185225, "sim_compute_performance-ego": 0.07252741541181291, "sim_compute_robot_state-ego": 0.07625101861499604, "sim_compute_robot_state-npc0": 0.07019924436296736, "sim_compute_robot_state-npc1": 0.07210114569891067, "sim_compute_robot_state-npc2": 0.0708493982042585, "sim_compute_robot_state-npc3": 0.0723639828818185}}
set_robot_commands_max	0.10835883140563964
set_robot_commands_mean	0.1034258043839426
set_robot_commands_median	0.102616752187411
set_robot_commands_min	0.09818509646824428
sim_compute_performance-ego_max	0.07554626961549123
sim_compute_performance-ego_mean	0.07242157938662985
sim_compute_performance-ego_median	0.07252741541181291
sim_compute_performance-ego_min	0.06833903356031938
sim_compute_robot_state-ego_max	0.0901519250869751
sim_compute_robot_state-ego_mean	0.07949503910655707
sim_compute_robot_state-ego_median	0.07912609690711611
sim_compute_robot_state-ego_min	0.07133017136500432
sim_compute_robot_state-npc0_max	0.07482252537625507
sim_compute_robot_state-npc0_mean	0.07214703987969223
sim_compute_robot_state-npc0_median	0.07271626629406892
sim_compute_robot_state-npc0_min	0.06710127421787807
sim_compute_robot_state-npc1_max	0.07689988613128662
sim_compute_robot_state-npc1_mean	0.07238867117886452
sim_compute_robot_state-npc1_median	0.07263094567238017
sim_compute_robot_state-npc1_min	0.0654485651424953
sim_compute_robot_state-npc2_max	0.07566935503030126
sim_compute_robot_state-npc2_mean	0.07226870657631373
sim_compute_robot_state-npc2_median	0.07266731695695357
sim_compute_robot_state-npc2_min	0.06724882125854492
sim_compute_robot_state-npc3_max	0.07724767464857835
sim_compute_robot_state-npc3_mean	0.0727403595595358
sim_compute_robot_state-npc3_median	0.0723639828818185
sim_compute_robot_state-npc3_min	0.0695785539490836
sim_compute_sim_state_max	0.044234550916231595
sim_compute_sim_state_mean	0.040763700485547526
sim_compute_sim_state_median	0.04042142868041992
sim_compute_sim_state_min	0.03866795698801676
sim_physics_max	0.2522567558288574
sim_physics_mean	0.218177503506384
sim_physics_median	0.21407048060343817
sim_physics_min	0.2007228902408055
sim_render-ego_max	0.06862378597259522
sim_render-ego_mean	0.06483048339070614
sim_render-ego_median	0.0649226174771207
sim_render-ego_min	0.06182763690040225
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

21279

2441

Jacopo Tani

random_agent

step1-simulation

success

2019-04-27 22:00:42+00:00

2019-04-27 22:23:48+00:00

0:23:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.181801195497866
agent_compute-ego_mean	0.16414485494184797
agent_compute-ego_median	0.16571465686515527
agent_compute-ego_min	0.13303831100463867
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1947617839883875, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.066368716734427, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16746756765577528, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10830641675878454, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04107926068482576, "sim_compute_performance-ego": 0.07615098688337538, "sim_compute_robot_state-ego": 0.07998148600260417, "sim_compute_robot_state-npc0": 0.07186679045359294, "sim_compute_robot_state-npc1": 0.07355539004007976, "sim_compute_robot_state-npc2": 0.0749023093117608, "sim_compute_robot_state-npc3": 0.07293666292119909}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.18580093383789065, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.056376714706420895, "in-drivable-lane": 0, "agent_compute-ego": 0.13303831100463867, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.083958740234375, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.036599864959716795, "sim_compute_performance-ego": 0.05926102638244629, "sim_compute_robot_state-ego": 0.06732625007629395, "sim_compute_robot_state-npc0": 0.0559237003326416, "sim_compute_robot_state-npc1": 0.06712601661682129, "sim_compute_robot_state-npc2": 0.06173588752746582, "sim_compute_robot_state-npc3": 0.06121693611145019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.20386676725588343, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06897015948044627, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.175180805356879, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10538471372503984, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03992810374812076, "sim_compute_performance-ego": 0.07530861779263145, "sim_compute_robot_state-ego": 0.07690784178282085, "sim_compute_robot_state-npc0": 0.07347218613875539, "sim_compute_robot_state-npc1": 0.07311840747532092, "sim_compute_robot_state-npc2": 0.07063567638397217, "sim_compute_robot_state-npc3": 0.07131751587516383}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.19192488284050663, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.0654862681521645, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1602048813542233, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.103343194044089, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.040783215172683136, "sim_compute_performance-ego": 0.07128469249870203, "sim_compute_robot_state-ego": 0.07607686670520637, "sim_compute_robot_state-npc0": 0.07584762875037858, "sim_compute_robot_state-npc1": 0.07457386692868004, "sim_compute_robot_state-npc2": 0.07273235502122324, "sim_compute_robot_state-npc3": 0.07260522963125494}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.2112881796700614, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06521006141390119, "in-drivable-lane": 0, "agent_compute-ego": 0.17505774327686854, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10475202117647445, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04113766125270298, "sim_compute_performance-ego": 0.07853335993630546, "sim_compute_robot_state-ego": 0.08705624512263707, "sim_compute_robot_state-npc0": 0.07449106659208025, "sim_compute_robot_state-npc1": 0.07492138658251081, "sim_compute_robot_state-npc2": 0.07508569955825806, "sim_compute_robot_state-npc3": 0.07585157666887556}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.17890797721015084, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.06474717016573306, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.16571465686515527, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.1021128672140616, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03963938907340721, "sim_compute_performance-ego": 0.0721358546504268, "sim_compute_robot_state-ego": 0.09102056644580982, "sim_compute_robot_state-npc0": 0.06941903962029351, "sim_compute_robot_state-npc1": 0.07341292169358996, "sim_compute_robot_state-npc2": 0.06825681968971535, "sim_compute_robot_state-npc3": 0.07249467019681577}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.19585800612414325, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06726370034394441, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.181801195497866, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.11527298114917896, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.04946213739889639, "sim_compute_performance-ego": 0.07798209013762297, "sim_compute_robot_state-ego": 0.08776198934625697, "sim_compute_robot_state-npc0": 0.07837569713592529, "sim_compute_robot_state-npc1": 0.07612038100207294, "sim_compute_robot_state-npc2": 0.07572926415337457, "sim_compute_robot_state-npc3": 0.07659339904785156}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.2214760939280192, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06619075669182671, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16343288951449925, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10399534437391492, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04173959626091851, "sim_compute_performance-ego": 0.07518859969245063, "sim_compute_robot_state-ego": 0.07981296645270454, "sim_compute_robot_state-npc0": 0.07431400087144639, "sim_compute_robot_state-npc1": 0.07409312989976671, "sim_compute_robot_state-npc2": 0.07608066134982638, "sim_compute_robot_state-npc3": 0.076325257619222}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.17439532798269522, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.066864972529204, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1597905158996582, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.0961120076801466, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04394890951073688, "sim_compute_performance-ego": 0.0701079161270805, "sim_compute_robot_state-ego": 0.07505307508551556, "sim_compute_robot_state-npc0": 0.07307767349740733, "sim_compute_robot_state-npc1": 0.07213828356369682, "sim_compute_robot_state-npc2": 0.07766748511272928, "sim_compute_robot_state-npc3": 0.07613806102586829}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.2181301259994507, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06907067298889161, "in-drivable-lane": 0, "agent_compute-ego": 0.1734747552871704, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10748198509216308, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.042387776374816895, "sim_compute_performance-ego": 0.08374167919158935, "sim_compute_robot_state-ego": 0.09127402305603027, "sim_compute_robot_state-npc0": 0.07739681243896485, "sim_compute_robot_state-npc1": 0.07740591526031494, "sim_compute_robot_state-npc2": 0.07651243686676025, "sim_compute_robot_state-npc3": 0.07669209003448486}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22060288190841676, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06706091165542602, "in-drivable-lane": 0, "agent_compute-ego": 0.16909828186035156, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.10355304479599, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.0408671498298645, "sim_compute_performance-ego": 0.07333743572235107, "sim_compute_robot_state-ego": 0.08200839757919312, "sim_compute_robot_state-npc0": 0.07369333505630493, "sim_compute_robot_state-npc1": 0.0762022614479065, "sim_compute_robot_state-npc2": 0.07367241382598877, "sim_compute_robot_state-npc3": 0.07163398265838623}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1865758644907098, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06258014628761693, "in-drivable-lane": 0, "agent_compute-ego": 0.1614821333634226, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10122404600444591, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04273038161428351, "sim_compute_performance-ego": 0.07414212979768452, "sim_compute_robot_state-ego": 0.07486604389391448, "sim_compute_robot_state-npc0": 0.07088875770568848, "sim_compute_robot_state-npc1": 0.0730264939759907, "sim_compute_robot_state-npc2": 0.07773862387004651, "sim_compute_robot_state-npc3": 0.07958447305779708}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.18805475234985353, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06261041164398193, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.1734788703918457, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.11160842895507812, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04117125511169434, "sim_compute_performance-ego": 0.07321300506591796, "sim_compute_robot_state-ego": 0.08592377185821533, "sim_compute_robot_state-npc0": 0.07735956192016602, "sim_compute_robot_state-npc1": 0.07492129802703858, "sim_compute_robot_state-npc2": 0.07709782123565674, "sim_compute_robot_state-npc3": 0.07814447402954101}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2209623076698997, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06306782635775479, "in-drivable-lane": 0, "agent_compute-ego": 0.15002989768981934, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.09952034733512184, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.040488362312316895, "sim_compute_performance-ego": 0.06655945561148903, "sim_compute_robot_state-ego": 0.0729123895818537, "sim_compute_robot_state-npc0": 0.06671033122322777, "sim_compute_robot_state-npc1": 0.07242795554074374, "sim_compute_robot_state-npc2": 0.07789301872253418, "sim_compute_robot_state-npc3": 0.07358119704506615}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.20667465365662863, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06209172521318708, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.1529203191095469, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.0970196869908547, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04042711549875688, "sim_compute_performance-ego": 0.06973474852892818, "sim_compute_robot_state-ego": 0.07431342650432976, "sim_compute_robot_state-npc0": 0.06645248860728983, "sim_compute_robot_state-npc1": 0.07028111146420848, "sim_compute_robot_state-npc2": 0.0680039220926713, "sim_compute_robot_state-npc3": 0.07183535731568629}}
set_robot_commands_max	0.11527298114917896
set_robot_commands_mean	0.10290972170198125
set_robot_commands_median	0.10355304479599
set_robot_commands_min	0.083958740234375
sim_compute_performance-ego_max	0.08374167919158935
sim_compute_performance-ego_mean	0.07311210653460011
sim_compute_performance-ego_median	0.07333743572235107
sim_compute_performance-ego_min	0.05926102638244629
sim_compute_robot_state-ego_max	0.09127402305603027
sim_compute_robot_state-ego_mean	0.0801530226328924
sim_compute_robot_state-ego_median	0.07981296645270454
sim_compute_robot_state-ego_min	0.06732625007629395
sim_compute_robot_state-npc0_max	0.07837569713592529
sim_compute_robot_state-npc0_mean	0.07195260468961089
sim_compute_robot_state-npc0_median	0.07347218613875539
sim_compute_robot_state-npc0_min	0.0559237003326416
sim_compute_robot_state-npc1_max	0.07740591526031494
sim_compute_robot_state-npc1_mean	0.07355498796791614
sim_compute_robot_state-npc1_median	0.07355539004007976
sim_compute_robot_state-npc1_min	0.06712601661682129
sim_compute_robot_state-npc2_max	0.07789301872253418
sim_compute_robot_state-npc2_mean	0.07358295964813225
sim_compute_robot_state-npc2_median	0.07508569955825806
sim_compute_robot_state-npc2_min	0.06173588752746582
sim_compute_robot_state-npc3_max	0.07958447305779708
sim_compute_robot_state-npc3_mean	0.07379672554924419
sim_compute_robot_state-npc3_median	0.07358119704506615
sim_compute_robot_state-npc3_min	0.06121693611145019
sim_compute_sim_state_max	0.04946213739889639
sim_compute_sim_state_mean	0.0414926785869161
sim_compute_sim_state_median	0.04107926068482576
sim_compute_sim_state_min	0.036599864959716795
sim_physics_max	0.2214760939280192
sim_physics_mean	0.1999520359275132
sim_physics_median	0.19585800612414325
sim_physics_min	0.17439532798269522
sim_render-ego_max	0.06907067298889161
sim_render-ego_mean	0.06493068095766176
sim_render-ego_median	0.0654862681521645
sim_render-ego_min	0.056376714706420895
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

21203

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 21:00:37+00:00

2019-04-27 22:00:12+00:00

0:59:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-25-98-2348-job21203/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21168

2698

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 20:02:50+00:00

2019-04-27 21:00:16+00:00

0:57:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-25-98-2348-job21168/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21153

2570

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 20:00:24+00:00

2019-04-27 20:02:30+00:00

0:02:06

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21127

2707

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 19:16:26+00:00

2019-04-27 20:00:09+00:00

0:43:43

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2707/step1-simulation-ip-172-31-25-98-2348-job21127/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21122

2637

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 19:05:19+00:00

2019-04-27 19:15:49+00:00

0:10:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.17373961436597607
agent_compute-ego_mean	0.1676207579228773
agent_compute-ego_median	0.16903549432754517
agent_compute-ego_min	0.16259679748016653
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.23349764377255983, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.0691344526749623, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.17373961436597607, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10817825341526466, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.042321051223368586, "sim_compute_performance-ego": 0.07501565957371192, "sim_compute_robot_state-ego": 0.08483236349081691, "sim_compute_robot_state-npc0": 0.07454235644280156, "sim_compute_robot_state-npc1": 0.0726327956477298, "sim_compute_robot_state-npc2": 0.07304842864410786, "sim_compute_robot_state-npc3": 0.07321839392939701}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2318558692932129, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06512857334954399, "in-drivable-lane": 0, "agent_compute-ego": 0.16903549432754517, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10029585872377668, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04258504935673305, "sim_compute_performance-ego": 0.07499877044132777, "sim_compute_robot_state-ego": 0.08161573750632149, "sim_compute_robot_state-npc0": 0.07351313318525042, "sim_compute_robot_state-npc1": 0.06947747298649379, "sim_compute_robot_state-npc2": 0.0751143183026995, "sim_compute_robot_state-npc3": 0.072722213608878}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.2152732830603146, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0655757478139933, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16259679748016653, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10011636400685726, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03909517723379783, "sim_compute_performance-ego": 0.07200886207876854, "sim_compute_robot_state-ego": 0.07675678753158421, "sim_compute_robot_state-npc0": 0.071940928986929, "sim_compute_robot_state-npc1": 0.07207729746994462, "sim_compute_robot_state-npc2": 0.07076729154123844, "sim_compute_robot_state-npc3": 0.07342593646743922}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2294940153757731, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06499011317888896, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16266524295012155, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10229156414667766, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03885282576084137, "sim_compute_performance-ego": 0.07122698922952016, "sim_compute_robot_state-ego": 0.07712352275848389, "sim_compute_robot_state-npc0": 0.07561396559079488, "sim_compute_robot_state-npc1": 0.07284268736839294, "sim_compute_robot_state-npc2": 0.07286480069160461, "sim_compute_robot_state-npc3": 0.0701397309700648}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2383478255498977, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06853328432355608, "in-drivable-lane": 0, "agent_compute-ego": 0.17006664049057735, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.1075156983875093, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03841448965526763, "sim_compute_performance-ego": 0.0758180164155506, "sim_compute_robot_state-ego": 0.08599036080496651, "sim_compute_robot_state-npc0": 0.0715221677507673, "sim_compute_robot_state-npc1": 0.07534325690496535, "sim_compute_robot_state-npc2": 0.0756080150604248, "sim_compute_robot_state-npc3": 0.07624875931512742}}
set_robot_commands_max	0.10817825341526466
set_robot_commands_mean	0.1036795477360171
set_robot_commands_median	0.10229156414667766
set_robot_commands_min	0.10011636400685726
sim_compute_performance-ego_max	0.0758180164155506
sim_compute_performance-ego_mean	0.07381365954777579
sim_compute_performance-ego_median	0.07499877044132777
sim_compute_performance-ego_min	0.07122698922952016
sim_compute_robot_state-ego_max	0.08599036080496651
sim_compute_robot_state-ego_mean	0.08126375441843461
sim_compute_robot_state-ego_median	0.08161573750632149
sim_compute_robot_state-ego_min	0.07675678753158421
sim_compute_robot_state-npc0_max	0.07561396559079488
sim_compute_robot_state-npc0_mean	0.07342651039130862
sim_compute_robot_state-npc0_median	0.07351313318525042
sim_compute_robot_state-npc0_min	0.0715221677507673
sim_compute_robot_state-npc1_max	0.07534325690496535
sim_compute_robot_state-npc1_mean	0.0724747020755053
sim_compute_robot_state-npc1_median	0.0726327956477298
sim_compute_robot_state-npc1_min	0.06947747298649379
sim_compute_robot_state-npc2_max	0.0756080150604248
sim_compute_robot_state-npc2_mean	0.07348057084801504
sim_compute_robot_state-npc2_median	0.07304842864410786
sim_compute_robot_state-npc2_min	0.07076729154123844
sim_compute_robot_state-npc3_max	0.07624875931512742
sim_compute_robot_state-npc3_mean	0.0731510068581813
sim_compute_robot_state-npc3_median	0.07321839392939701
sim_compute_robot_state-npc3_min	0.0701397309700648
sim_compute_sim_state_max	0.04258504935673305
sim_compute_sim_state_mean	0.04025371864600169
sim_compute_sim_state_median	0.03909517723379783
sim_compute_sim_state_min	0.03841448965526763
sim_physics_max	0.2383478255498977
sim_physics_mean	0.2296937274103516
sim_physics_median	0.2318558692932129
sim_physics_min	0.2152732830603146
sim_render-ego_max	0.0691344526749623
sim_render-ego_mean	0.06667243426818893
sim_render-ego_median	0.0655757478139933
sim_render-ego_min	0.06499011317888896
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21080

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 18:00:39+00:00

2019-04-27 19:00:08+00:00

0:59:29

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-25-98-2348-job21080/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21025

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:04:55+00:00

2019-04-27 18:00:11+00:00

0:55:16

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-25-98-2348-job21025/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21019

2779

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:04:04+00:00

2019-04-27 17:04:33+00:00

0:00:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21017

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:03:20+00:00

2019-04-27 17:03:51+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21014

2799

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 17:01:25+00:00

2019-04-27 17:03:12+00:00

0:01:47

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21007

2787

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:00:22+00:00

2019-04-27 17:01:09+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21001

2796

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 16:59:35+00:00

2019-04-27 17:00:13+00:00

0:00:38

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2796/step1-simulation-ip-172-31-25-98-2348-job21001/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20996

2809

Andrea Censi 🇨🇭

challenge-aido_LF-template-random - random_agent

step1-simulation

success

2019-04-27 16:51:04+00:00

2019-04-27 16:58:51+00:00

0:07:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.155117842886183
agent_compute-ego_mean	0.1439539343438982
agent_compute-ego_median	0.1406640849615398
agent_compute-ego_min	0.13329837799072267
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1631830400890774, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.060414265703271935, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.155117842886183, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09854174543310094, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03724632439789949, "sim_compute_performance-ego": 0.06879098768587466, "sim_compute_robot_state-ego": 0.07205330000983344, "sim_compute_robot_state-npc0": 0.06629116005367702, "sim_compute_robot_state-npc1": 0.06493884987301296, "sim_compute_robot_state-npc2": 0.06362778610653347, "sim_compute_robot_state-npc3": 0.06575246651967366}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.13959095001220703, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05122995376586914, "in-drivable-lane": 0, "agent_compute-ego": 0.13329837799072267, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08604788780212402, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03330634117126465, "sim_compute_performance-ego": 0.05641779899597168, "sim_compute_robot_state-ego": 0.060583915710449215, "sim_compute_robot_state-npc0": 0.062130670547485355, "sim_compute_robot_state-npc1": 0.06240178108215332, "sim_compute_robot_state-npc2": 0.06453588485717773, "sim_compute_robot_state-npc3": 0.06199209213256836}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.15039650076314023, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.053534077970605144, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1406640849615398, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08381908818295128, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.032013576281698125, "sim_compute_performance-ego": 0.05790686921069497, "sim_compute_robot_state-ego": 0.06130008321059378, "sim_compute_robot_state-npc0": 0.059601316326542905, "sim_compute_robot_state-npc1": 0.05828022015722174, "sim_compute_robot_state-npc2": 0.05958062724063271, "sim_compute_robot_state-npc3": 0.05847033701444927}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1885827734500547, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06085536449770384, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15339831762675998, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09584611578832698, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03753394416615933, "sim_compute_performance-ego": 0.06801192368133159, "sim_compute_robot_state-ego": 0.07547338099419316, "sim_compute_robot_state-npc0": 0.06965623324430442, "sim_compute_robot_state-npc1": 0.06782508500014679, "sim_compute_robot_state-npc2": 0.06788182258605957, "sim_compute_robot_state-npc3": 0.06632376320754425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.15328437089920044, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.059044829436710904, "in-drivable-lane": 0, "agent_compute-ego": 0.13729104825428554, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0931348545210702, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0377745372908456, "sim_compute_performance-ego": 0.06748500892094203, "sim_compute_robot_state-ego": 0.06951848949704852, "sim_compute_robot_state-npc0": 0.06944116524287633, "sim_compute_robot_state-npc1": 0.06767213344573975, "sim_compute_robot_state-npc2": 0.08281128747122628, "sim_compute_robot_state-npc3": 0.06414153746196202}}
set_robot_commands_max	0.09854174543310094
set_robot_commands_mean	0.0914779383455147
set_robot_commands_median	0.0931348545210702
set_robot_commands_min	0.08381908818295128
sim_compute_performance-ego_max	0.06879098768587466
sim_compute_performance-ego_mean	0.06372251769896298
sim_compute_performance-ego_median	0.06748500892094203
sim_compute_performance-ego_min	0.05641779899597168
sim_compute_robot_state-ego_max	0.07547338099419316
sim_compute_robot_state-ego_mean	0.06778583388442362
sim_compute_robot_state-ego_median	0.06951848949704852
sim_compute_robot_state-ego_min	0.060583915710449215
sim_compute_robot_state-npc0_max	0.06965623324430442
sim_compute_robot_state-npc0_mean	0.0654241090829772
sim_compute_robot_state-npc0_median	0.06629116005367702
sim_compute_robot_state-npc0_min	0.059601316326542905
sim_compute_robot_state-npc1_max	0.06782508500014679
sim_compute_robot_state-npc1_mean	0.0642236139116549
sim_compute_robot_state-npc1_median	0.06493884987301296
sim_compute_robot_state-npc1_min	0.05828022015722174
sim_compute_robot_state-npc2_max	0.08281128747122628
sim_compute_robot_state-npc2_mean	0.06768748165232595
sim_compute_robot_state-npc2_median	0.06453588485717773
sim_compute_robot_state-npc2_min	0.05958062724063271
sim_compute_robot_state-npc3_max	0.06632376320754425
sim_compute_robot_state-npc3_mean	0.06333603926723952
sim_compute_robot_state-npc3_median	0.06414153746196202
sim_compute_robot_state-npc3_min	0.05847033701444927
sim_compute_sim_state_max	0.0377745372908456
sim_compute_sim_state_mean	0.03557494466157344
sim_compute_sim_state_median	0.03724632439789949
sim_compute_sim_state_min	0.032013576281698125
sim_physics_max	0.1885827734500547
sim_physics_mean	0.15900752704273596
sim_physics_median	0.15328437089920044
sim_physics_min	0.13959095001220703
sim_render-ego_max	0.06085536449770384
sim_render-ego_mean	0.057015698274832195
sim_render-ego_median	0.059044829436710904
sim_render-ego_min	0.05122995376586914
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

20954

2860

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 16:00:17+00:00

2019-04-27 16:50:41+00:00

0:50:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.243922955218868
survival_time_median	4.6499999999999915
deviation-center-line_median	0.18552725611414353
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.1082382325772886
agent_compute-ego_mean	0.10229582085998708
agent_compute-ego_median	0.10508679377066124
agent_compute-ego_min	0.09080042914738733
deviation-center-line_max	0.4631022507548988
deviation-center-line_mean	0.22347004383640717
deviation-center-line_min	0.11309604590331793
deviation-heading_max	2.5374600291755636
deviation-heading_mean	1.729786036665199
deviation-heading_median	1.7163005711219772
deviation-heading_min	1.0431621689187949
driven_any_max	1.174577184966339
driven_any_mean	0.449980707351232
driven_any_median	0.34685042807394556
driven_any_min	0.1780768469966603
driven_lanedir_consec_max	1.078907979068851
driven_lanedir_consec_mean	0.3384457526907987
driven_lanedir_consec_min	0.13264304274581074
driven_lanedir_max	1.078907979068851
driven_lanedir_mean	0.3384457526907987
driven_lanedir_median	0.243922955218868
driven_lanedir_min	0.13264304274581074
in-drivable-lane_max	7.300000000000097
in-drivable-lane_mean	0.8033333333333397
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5117857140139904, "sim_physics": 0.19620028954965096, "survival_time": 6.749999999999984, "driven_lanedir": 0.4532292088713587, "sim_render-ego": 0.06770436675460251, "in-drivable-lane": 0, "agent_compute-ego": 0.1082382325772886, "deviation-heading": 2.096366204315778, "set_robot_commands": 0.1048223442501492, "deviation-center-line": 0.3452144831962659, "driven_lanedir_consec": 0.4532292088713587, "sim_compute_sim_state": 0.04174946855615686, "sim_compute_performance-ego": 0.07706416624563711, "sim_compute_robot_state-ego": 0.07985153904667606, "sim_compute_robot_state-npc0": 0.07608783156783493, "sim_compute_robot_state-npc1": 0.07565316094292535, "sim_compute_robot_state-npc2": 0.07370569087840893, "sim_compute_robot_state-npc3": 0.07429329377633553}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3629011950245257, "sim_physics": 0.18522126404280512, "survival_time": 4.849999999999991, "driven_lanedir": 0.243922955218868, "sim_render-ego": 0.05977080040371295, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.09578458795842436, "deviation-heading": 1.7163005711219772, "set_robot_commands": 0.09579172576825644, "deviation-center-line": 0.20139573634182711, "driven_lanedir_consec": 0.243922955218868, "sim_compute_sim_state": 0.037906307535073194, "sim_compute_performance-ego": 0.06896864507616181, "sim_compute_robot_state-ego": 0.07670631359532937, "sim_compute_robot_state-npc0": 0.06706080485865012, "sim_compute_robot_state-npc1": 0.06701686701823756, "sim_compute_robot_state-npc2": 0.06794598422099635, "sim_compute_robot_state-npc3": 0.06716518795367368}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4794376232243158, "sim_physics": 0.19578497182755245, "survival_time": 6.299999999999986, "driven_lanedir": 0.4202275777990336, "sim_render-ego": 0.0669207459404355, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.10576504563528394, "deviation-heading": 1.9055111060096976, "set_robot_commands": 0.11139850389389765, "deviation-center-line": 0.24120356129470663, "driven_lanedir_consec": 0.4202275777990336, "sim_compute_sim_state": 0.04258948659139966, "sim_compute_performance-ego": 0.07501635664985293, "sim_compute_robot_state-ego": 0.08326661586761475, "sim_compute_robot_state-npc0": 0.07388700568486774, "sim_compute_robot_state-npc1": 0.07365577561514718, "sim_compute_robot_state-npc2": 0.076132993849497, "sim_compute_robot_state-npc3": 0.07355205974881611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6361350807299464, "sim_physics": 0.1940592606862386, "survival_time": 8.249999999999982, "driven_lanedir": 0.5334098803308858, "sim_render-ego": 0.06763432820638021, "in-drivable-lane": 0.6500000000000012, "agent_compute-ego": 0.1035950588457512, "deviation-heading": 1.9200354427410955, "set_robot_commands": 0.10406632712393096, "deviation-center-line": 0.18552725611414353, "driven_lanedir_consec": 0.5334098803308858, "sim_compute_sim_state": 0.04154794866388494, "sim_compute_performance-ego": 0.0759073662035393, "sim_compute_robot_state-ego": 0.08622170650597774, "sim_compute_robot_state-npc0": 0.07454438643022017, "sim_compute_robot_state-npc1": 0.0744109601685495, "sim_compute_robot_state-npc2": 0.07444709864529696, "sim_compute_robot_state-npc3": 0.07365749099037865}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1941567123342041, "sim_physics": 0.1837350541895086, "survival_time": 2.7499999999999982, "driven_lanedir": 0.15476384328107884, "sim_render-ego": 0.06666467406532982, "in-drivable-lane": 0, "agent_compute-ego": 0.10673847631974652, "deviation-heading": 1.4548639747779202, "set_robot_commands": 0.10410760966214266, "deviation-center-line": 0.15266249080130037, "driven_lanedir_consec": 0.15476384328107884, "sim_compute_sim_state": 0.04177365736527877, "sim_compute_performance-ego": 0.07696848782626066, "sim_compute_robot_state-ego": 0.08318181037902832, "sim_compute_robot_state-npc0": 0.0744451479478316, "sim_compute_robot_state-npc1": 0.08498875878073953, "sim_compute_robot_state-npc2": 0.07349331162192604, "sim_compute_robot_state-npc3": 0.07447055036371404}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2704877981455599, "sim_physics": 0.16701742442878517, "survival_time": 3.699999999999995, "driven_lanedir": 0.1636410018793648, "sim_render-ego": 0.06703981837710819, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.10508679377066124, "deviation-heading": 1.659277672206381, "set_robot_commands": 0.10285566304181074, "deviation-center-line": 0.13535110695993238, "driven_lanedir_consec": 0.1636410018793648, "sim_compute_sim_state": 0.041050711193600216, "sim_compute_performance-ego": 0.07539015847283441, "sim_compute_robot_state-ego": 0.08028121574504955, "sim_compute_robot_state-npc0": 0.07375789977408745, "sim_compute_robot_state-npc1": 0.07367164379841573, "sim_compute_robot_state-npc2": 0.07399902472624907, "sim_compute_robot_state-npc3": 0.07193501897760339}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.174532714394281, "sim_physics": 0.1868020208676656, "survival_time": 14.950000000000076, "driven_lanedir": 0.542751807612836, "sim_render-ego": 0.0662263290087382, "in-drivable-lane": 7.300000000000097, "agent_compute-ego": 0.10748208045959472, "deviation-heading": 1.85915448865056, "set_robot_commands": 0.1052921199798584, "deviation-center-line": 0.32600702986645513, "driven_lanedir_consec": 0.542751807612836, "sim_compute_sim_state": 0.041416237354278566, "sim_compute_performance-ego": 0.07286426146825155, "sim_compute_robot_state-ego": 0.07984745184580486, "sim_compute_robot_state-npc0": 0.07532971620559692, "sim_compute_robot_state-npc1": 0.07401501099268595, "sim_compute_robot_state-npc2": 0.07336676994959514, "sim_compute_robot_state-npc3": 0.07415836334228515}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.35487899036505044, "sim_physics": 0.19691634931062396, "survival_time": 4.749999999999991, "driven_lanedir": 0.30035204856325937, "sim_render-ego": 0.06549114930002313, "in-drivable-lane": 0, "agent_compute-ego": 0.1079033751236765, "deviation-heading": 1.8466376053411988, "set_robot_commands": 0.10720957203915243, "deviation-center-line": 0.2298950235656793, "driven_lanedir_consec": 0.30035204856325937, "sim_compute_sim_state": 0.041986663717972605, "sim_compute_performance-ego": 0.07346949577331544, "sim_compute_robot_state-ego": 0.0815122780046965, "sim_compute_robot_state-npc0": 0.07502846215900622, "sim_compute_robot_state-npc1": 0.07766330869574296, "sim_compute_robot_state-npc2": 0.0756882391477886, "sim_compute_robot_state-npc3": 0.07645642882899234}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2383461475657996, "sim_physics": 0.1966504003062393, "survival_time": 3.2999999999999963, "driven_lanedir": 0.16034283112484493, "sim_render-ego": 0.06761229760719067, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.10628384532350482, "deviation-heading": 1.5877041005970034, "set_robot_commands": 0.10510720267440334, "deviation-center-line": 0.11309604590331793, "driven_lanedir_consec": 0.16034283112484493, "sim_compute_sim_state": 0.04266816919500178, "sim_compute_performance-ego": 0.07558188293919418, "sim_compute_robot_state-ego": 0.08125415354064017, "sim_compute_robot_state-npc0": 0.07601847793116714, "sim_compute_robot_state-npc1": 0.07532868240818832, "sim_compute_robot_state-npc2": 0.07517102992895877, "sim_compute_robot_state-npc3": 0.0759148308725068}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.33879251030597207, "sim_physics": 0.20756605431273745, "survival_time": 4.549999999999992, "driven_lanedir": 0.2365319070778149, "sim_render-ego": 0.06885158098660983, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.1078640340448736, "deviation-heading": 1.5590440222901596, "set_robot_commands": 0.1081829595041799, "deviation-center-line": 0.118979967600755, "driven_lanedir_consec": 0.2365319070778149, "sim_compute_sim_state": 0.043592754301134046, "sim_compute_performance-ego": 0.07850703040322105, "sim_compute_robot_state-ego": 0.08762198228102464, "sim_compute_robot_state-npc0": 0.0757614492060064, "sim_compute_robot_state-npc1": 0.07564715500716325, "sim_compute_robot_state-npc2": 0.0747767516544887, "sim_compute_robot_state-npc3": 0.07463309005066589}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.22630030599631087, "sim_physics": 0.1743395593431261, "survival_time": 3.149999999999997, "driven_lanedir": 0.17829673272686408, "sim_render-ego": 0.05965698711455814, "in-drivable-lane": 0, "agent_compute-ego": 0.09080042914738733, "deviation-heading": 1.7164703023207906, "set_robot_commands": 0.08762548461792961, "deviation-center-line": 0.15752131783654058, "driven_lanedir_consec": 0.17829673272686408, "sim_compute_sim_state": 0.03589301260690841, "sim_compute_performance-ego": 0.06177567300342378, "sim_compute_robot_state-ego": 0.06750303979903932, "sim_compute_robot_state-npc0": 0.06558208995395237, "sim_compute_robot_state-npc1": 0.06346989056420704, "sim_compute_robot_state-npc2": 0.06604934874035064, "sim_compute_robot_state-npc3": 0.06448707126435779}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.34685042807394556, "sim_physics": 0.16278950629695768, "survival_time": 4.6499999999999915, "driven_lanedir": 0.331579207539054, "sim_render-ego": 0.060971116506925195, "in-drivable-lane": 0, "agent_compute-ego": 0.1019281469365602, "deviation-heading": 1.0431621689187949, "set_robot_commands": 0.10380152733095233, "deviation-center-line": 0.4631022507548988, "driven_lanedir_consec": 0.331579207539054, "sim_compute_sim_state": 0.03888409881181614, "sim_compute_performance-ego": 0.07132627630746492, "sim_compute_robot_state-ego": 0.07714048252310804, "sim_compute_robot_state-npc0": 0.07294201081798922, "sim_compute_robot_state-npc1": 0.07019619275164861, "sim_compute_robot_state-npc2": 0.06653500115999611, "sim_compute_robot_state-npc3": 0.0682794560668289}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.262451358131577, "sim_physics": 0.1790797147485945, "survival_time": 3.599999999999995, "driven_lanedir": 0.14608626652205625, "sim_render-ego": 0.06081834766599867, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0966421729988522, "deviation-heading": 1.6030969515709643, "set_robot_commands": 0.09894024663501316, "deviation-center-line": 0.1413445999479122, "driven_lanedir_consec": 0.14608626652205625, "sim_compute_sim_state": 0.03787480460272895, "sim_compute_performance-ego": 0.06764893730481465, "sim_compute_robot_state-ego": 0.07391679618093702, "sim_compute_robot_state-npc0": 0.06849301523632473, "sim_compute_robot_state-npc1": 0.06660818722512987, "sim_compute_robot_state-npc2": 0.06897096501456366, "sim_compute_robot_state-npc3": 0.0674181514316135}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.174577184966339, "sim_physics": 0.1461282690366109, "survival_time": 14.950000000000076, "driven_lanedir": 1.078907979068851, "sim_render-ego": 0.057025849024454754, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.09232165098190308, "deviation-heading": 2.5374600291755636, "set_robot_commands": 0.08970047950744629, "deviation-center-line": 0.3721162581329744, "driven_lanedir_consec": 1.078907979068851, "sim_compute_sim_state": 0.03574608564376831, "sim_compute_performance-ego": 0.06330566008885702, "sim_compute_robot_state-ego": 0.06787208557128906, "sim_compute_robot_state-npc0": 0.06456080039342245, "sim_compute_robot_state-npc1": 0.06347564776738485, "sim_compute_robot_state-npc2": 0.0635400152206421, "sim_compute_robot_state-npc3": 0.06369273583094279}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1780768469966603, "sim_physics": 0.1704863426732082, "survival_time": 2.549999999999999, "driven_lanedir": 0.13264304274581074, "sim_render-ego": 0.06197441792955585, "in-drivable-lane": 0, "agent_compute-ego": 0.09800338277629778, "deviation-heading": 1.4417059099400995, "set_robot_commands": 0.1000647918850768, "deviation-center-line": 0.16863352922939795, "driven_lanedir_consec": 0.13264304274581074, "sim_compute_sim_state": 0.03983103060254864, "sim_compute_performance-ego": 0.07134448780732996, "sim_compute_robot_state-ego": 0.07715813786375757, "sim_compute_robot_state-npc0": 0.07238471741769828, "sim_compute_robot_state-npc1": 0.07234836092182234, "sim_compute_robot_state-npc2": 0.07177260810253668, "sim_compute_robot_state-npc3": 0.07168251860375498}}
set_robot_commands_max	0.11139850389389765
set_robot_commands_mean	0.10193110386094666
set_robot_commands_median	0.10406632712393096
set_robot_commands_min	0.08762548461792961
sim_compute_performance-ego_max	0.07850703040322105
sim_compute_performance-ego_mean	0.07234259237134391
sim_compute_performance-ego_median	0.07346949577331544
sim_compute_performance-ego_min	0.06177567300342378
sim_compute_robot_state-ego_max	0.08762198228102464
sim_compute_robot_state-ego_mean	0.07888904058333153
sim_compute_robot_state-ego_median	0.07985153904667606
sim_compute_robot_state-ego_min	0.06750303979903932
sim_compute_robot_state-npc0_max	0.07608783156783493
sim_compute_robot_state-npc0_mean	0.07239225437231038
sim_compute_robot_state-npc0_median	0.07388700568486774
sim_compute_robot_state-npc0_min	0.06456080039342245
sim_compute_robot_state-npc1_max	0.08498875878073953
sim_compute_robot_state-npc1_mean	0.07254330684386587
sim_compute_robot_state-npc1_median	0.07367164379841573
sim_compute_robot_state-npc1_min	0.06346989056420704
sim_compute_robot_state-npc2_max	0.076132993849497
sim_compute_robot_state-npc2_mean	0.07170632219075299
sim_compute_robot_state-npc2_median	0.07349331162192604
sim_compute_robot_state-npc2_min	0.0635400152206421
sim_compute_robot_state-npc3_max	0.07645642882899234
sim_compute_robot_state-npc3_mean	0.07145308320683132
sim_compute_robot_state-npc3_median	0.07355205974881611
sim_compute_robot_state-npc3_min	0.06369273583094279
sim_compute_sim_state_max	0.043592754301134046
sim_compute_sim_state_mean	0.040300695782770075
sim_compute_sim_state_median	0.041416237354278566
sim_compute_sim_state_min	0.03574608564376831
sim_physics_max	0.20756605431273745
sim_physics_mean	0.18285176544135365
sim_physics_median	0.18522126404280512
sim_physics_min	0.1461282690366109
sim_render-ego_max	0.06885158098660983
sim_render-ego_mean	0.06429085392610824
sim_render-ego_median	0.0662263290087382
sim_render-ego_min	0.057025849024454754
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.936666666666669
survival_time_min	2.549999999999999

No reset possible

20949

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 15:49:57+00:00

2019-04-27 16:00:09+00:00

0:10:12

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-25-98-2348-job20949/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20929

2960

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 15:07:45+00:00

2019-04-27 15:49:42+00:00

0:41:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2558952639455283
survival_time_median	5.549999999999988
deviation-center-line_median	0.2081549537970791
in-drivable-lane_median	1.949999999999993

other stats

agent_compute-ego_max	0.22308322813658588
agent_compute-ego_mean	0.19965040071625195
agent_compute-ego_median	0.19914917151133216
agent_compute-ego_min	0.18568076599727976
deviation-center-line_max	0.6275557230606436
deviation-center-line_mean	0.2336989383714546
deviation-center-line_min	0.13316001985112372
deviation-heading_max	1.6159724425570672
deviation-heading_mean	1.1844299179341446
deviation-heading_median	1.28590993824577
deviation-heading_min	0.7186998956052326
driven_any_max	1.7424502858222848
driven_any_mean	0.716928080459207
driven_any_median	0.6407839422632843
driven_any_min	0.4118273639618462
driven_lanedir_consec_max	1.7374806557551237
driven_lanedir_consec_mean	0.36204060474838934
driven_lanedir_consec_min	0.10378656547664589
driven_lanedir_max	1.7374806557551237
driven_lanedir_mean	0.3636406663978391
driven_lanedir_median	0.26983060723621666
driven_lanedir_min	0.10394623107188306
in-drivable-lane_max	4.199999999999985
in-drivable-lane_mean	2.0266666666666593
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8204924620975466, "sim_physics": 0.1586868411810823, "survival_time": 6.449999999999985, "driven_lanedir": 0.4936155390856496, "sim_render-ego": 0.05715114386506783, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1972326215847518, "deviation-heading": 1.2911834022946087, "set_robot_commands": 0.09089807022449582, "deviation-center-line": 0.372746005716685, "driven_lanedir_consec": 0.4894726320005738, "sim_compute_sim_state": 0.0356436570485433, "sim_compute_performance-ego": 0.06340133496957231, "sim_compute_robot_state-ego": 0.06918186919633733, "sim_compute_robot_state-npc0": 0.06445243746735328, "sim_compute_robot_state-npc1": 0.06480759798094284, "sim_compute_robot_state-npc2": 0.0655855984650841, "sim_compute_robot_state-npc3": 0.06543672362039256}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7523709885289792, "sim_physics": 0.1805969690665221, "survival_time": 5.849999999999987, "driven_lanedir": 0.2558952639455283, "sim_render-ego": 0.06507481672824958, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.20181569278749645, "deviation-heading": 0.7853241777894644, "set_robot_commands": 0.08790587971353123, "deviation-center-line": 0.26698426358480554, "driven_lanedir_consec": 0.2558952639455283, "sim_compute_sim_state": 0.03614049080090645, "sim_compute_performance-ego": 0.0626006819244124, "sim_compute_robot_state-ego": 0.06689032530173278, "sim_compute_robot_state-npc0": 0.06368726746648805, "sim_compute_robot_state-npc1": 0.06349365120260124, "sim_compute_robot_state-npc2": 0.06592196888393825, "sim_compute_robot_state-npc3": 0.0649353255573501}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6838082373306186, "sim_physics": 0.15875035729901543, "survival_time": 5.799999999999987, "driven_lanedir": 0.3408511655847595, "sim_render-ego": 0.05780267098854328, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.20697127539536048, "deviation-heading": 1.399914581299962, "set_robot_commands": 0.0982791493678915, "deviation-center-line": 0.23221238611626444, "driven_lanedir_consec": 0.3408511655847595, "sim_compute_sim_state": 0.037578648534314384, "sim_compute_performance-ego": 0.06683534383773804, "sim_compute_robot_state-ego": 0.0724851262980494, "sim_compute_robot_state-npc0": 0.06707548273020777, "sim_compute_robot_state-npc1": 0.06475879611640141, "sim_compute_robot_state-npc2": 0.06301184974867723, "sim_compute_robot_state-npc3": 0.06644152567304414}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6741120375903688, "sim_physics": 0.14887906666155215, "survival_time": 5.399999999999989, "driven_lanedir": 0.3342432949653591, "sim_render-ego": 0.05789319232658104, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.19914917151133216, "deviation-heading": 1.3151730620061766, "set_robot_commands": 0.08829514627103452, "deviation-center-line": 0.2081549537970791, "driven_lanedir_consec": 0.3342432949653591, "sim_compute_sim_state": 0.034616823549623844, "sim_compute_performance-ego": 0.06285158130857679, "sim_compute_robot_state-ego": 0.06595863236321343, "sim_compute_robot_state-npc0": 0.06080442225491559, "sim_compute_robot_state-npc1": 0.05981842235282615, "sim_compute_robot_state-npc2": 0.061462609856216995, "sim_compute_robot_state-npc3": 0.06327181613003766}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6376607843163205, "sim_physics": 0.1568895997227849, "survival_time": 5.549999999999988, "driven_lanedir": 0.29045252537813504, "sim_render-ego": 0.058807063747096704, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.2032626448450862, "deviation-heading": 1.28590993824577, "set_robot_commands": 0.08912446047808673, "deviation-center-line": 0.17402225687437048, "driven_lanedir_consec": 0.29045252537813504, "sim_compute_sim_state": 0.03679917309735272, "sim_compute_performance-ego": 0.06296962875503677, "sim_compute_robot_state-ego": 0.07067841452521247, "sim_compute_robot_state-npc0": 0.06354245194443711, "sim_compute_robot_state-npc1": 0.06587318686751632, "sim_compute_robot_state-npc2": 0.062788860217945, "sim_compute_robot_state-npc3": 0.06269743206264737}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4118273639618462, "sim_physics": 0.16549840196967125, "survival_time": 3.1999999999999966, "driven_lanedir": 0.10394623107188306, "sim_render-ego": 0.06007363647222519, "in-drivable-lane": 1.6999999999999962, "agent_compute-ego": 0.19000818580389023, "deviation-heading": 0.9667847622303974, "set_robot_commands": 0.08659061044454575, "deviation-center-line": 0.144365425426475, "driven_lanedir_consec": 0.10378656547664589, "sim_compute_sim_state": 0.035610347986221313, "sim_compute_performance-ego": 0.06413273140788078, "sim_compute_robot_state-ego": 0.06669490784406662, "sim_compute_robot_state-npc0": 0.06259020790457726, "sim_compute_robot_state-npc1": 0.06171517074108124, "sim_compute_robot_state-npc2": 0.06257684156298637, "sim_compute_robot_state-npc3": 0.06113286316394806}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9611791650349628, "sim_physics": 0.14102377891540527, "survival_time": 7.249999999999982, "driven_lanedir": 0.23886567550498297, "sim_render-ego": 0.05571685495047734, "in-drivable-lane": 4.199999999999985, "agent_compute-ego": 0.1904312018690438, "deviation-heading": 1.3336832232014575, "set_robot_commands": 0.08698621782763251, "deviation-center-line": 0.17494426198513532, "driven_lanedir_consec": 0.23886567550498297, "sim_compute_sim_state": 0.03574448947248788, "sim_compute_performance-ego": 0.06078465231533709, "sim_compute_robot_state-ego": 0.0631576472315295, "sim_compute_robot_state-npc0": 0.06065860123469912, "sim_compute_robot_state-npc1": 0.06020721073808341, "sim_compute_robot_state-npc2": 0.06339993148014464, "sim_compute_robot_state-npc3": 0.06292172464831122}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.7424502858222848, "sim_physics": 0.1600380516052246, "survival_time": 14.950000000000076, "driven_lanedir": 1.7374806557551237, "sim_render-ego": 0.05880149443944295, "in-drivable-lane": 0, "agent_compute-ego": 0.20379001379013065, "deviation-heading": 0.8534887930654382, "set_robot_commands": 0.08864100456237793, "deviation-center-line": 0.6275557230606436, "driven_lanedir_consec": 1.7374806557551237, "sim_compute_sim_state": 0.036576050917307534, "sim_compute_performance-ego": 0.06462594827016195, "sim_compute_robot_state-ego": 0.0679671581586202, "sim_compute_robot_state-npc0": 0.06538268327713012, "sim_compute_robot_state-npc1": 0.06361202796300253, "sim_compute_robot_state-npc2": 0.0628348970413208, "sim_compute_robot_state-npc3": 0.06401584227879842}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.5022316286918262, "sim_physics": 0.14578349143266678, "survival_time": 3.1999999999999966, "driven_lanedir": 0.18902469182377504, "sim_render-ego": 0.06344491988420486, "in-drivable-lane": 1.4499999999999962, "agent_compute-ego": 0.19935009256005287, "deviation-heading": 0.8947618762604028, "set_robot_commands": 0.08990238979458809, "deviation-center-line": 0.14154820005401322, "driven_lanedir_consec": 0.1884788795922918, "sim_compute_sim_state": 0.03591398522257805, "sim_compute_performance-ego": 0.06725161522626877, "sim_compute_robot_state-ego": 0.06674616038799286, "sim_compute_robot_state-npc0": 0.06494419649243355, "sim_compute_robot_state-npc1": 0.06234064698219299, "sim_compute_robot_state-npc2": 0.06212701648473739, "sim_compute_robot_state-npc3": 0.06364985182881355}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5483800479738031, "sim_physics": 0.18028221888975665, "survival_time": 4.399999999999992, "driven_lanedir": 0.26983060723621666, "sim_render-ego": 0.05583152445879849, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.18568076599727976, "deviation-heading": 1.6159724425570672, "set_robot_commands": 0.07918407700278542, "deviation-center-line": 0.22223870786126249, "driven_lanedir_consec": 0.25067806740626564, "sim_compute_sim_state": 0.033524843779477204, "sim_compute_performance-ego": 0.06258456002582204, "sim_compute_robot_state-ego": 0.06657707691192627, "sim_compute_robot_state-npc0": 0.06333902207287875, "sim_compute_robot_state-npc1": 0.06300750374794006, "sim_compute_robot_state-npc2": 0.06336410479112105, "sim_compute_robot_state-npc3": 0.061454832553863525}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.6002247076350946, "sim_physics": 0.17108775495172857, "survival_time": 4.549999999999992, "driven_lanedir": 0.248165186762876, "sim_render-ego": 0.06001707485743931, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.21065923931834463, "deviation-heading": 1.1477546076180594, "set_robot_commands": 0.09491665546710674, "deviation-center-line": 0.17524199625741912, "driven_lanedir_consec": 0.248165186762876, "sim_compute_sim_state": 0.039099276720822515, "sim_compute_performance-ego": 0.06581403134943364, "sim_compute_robot_state-ego": 0.06985979551797385, "sim_compute_robot_state-npc0": 0.0674193534222278, "sim_compute_robot_state-npc1": 0.06614026132520738, "sim_compute_robot_state-npc2": 0.07009280120933449, "sim_compute_robot_state-npc3": 0.06905838683411315}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.7544613365582297, "sim_physics": 0.1381794507952704, "survival_time": 6.8999999999999835, "driven_lanedir": 0.33312547170440965, "sim_render-ego": 0.05500273082567298, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.19705731972404147, "deviation-heading": 1.4712501691972988, "set_robot_commands": 0.08297013027080591, "deviation-center-line": 0.24095058220023555, "driven_lanedir_consec": 0.33312547170440965, "sim_compute_sim_state": 0.034766107365704964, "sim_compute_performance-ego": 0.060908785764721855, "sim_compute_robot_state-ego": 0.06412452027417612, "sim_compute_robot_state-npc0": 0.05961633246877919, "sim_compute_robot_state-npc1": 0.06131104973779208, "sim_compute_robot_state-npc2": 0.05936650089595629, "sim_compute_robot_state-npc3": 0.0602521274400794}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.48092919359418257, "sim_physics": 0.1481047482103915, "survival_time": 3.699999999999995, "driven_lanedir": 0.14003204240499822, "sim_render-ego": 0.055398654293369605, "in-drivable-lane": 2.049999999999994, "agent_compute-ego": 0.19280327010799095, "deviation-heading": 0.7186998956052326, "set_robot_commands": 0.08671042403659306, "deviation-center-line": 0.17613568260676982, "driven_lanedir_consec": 0.14003204240499822, "sim_compute_sim_state": 0.03549011655755945, "sim_compute_performance-ego": 0.06281963876775794, "sim_compute_robot_state-ego": 0.06411307889062005, "sim_compute_robot_state-npc0": 0.06272879484537486, "sim_compute_robot_state-npc1": 0.05989547033567686, "sim_compute_robot_state-npc2": 0.061461471222542426, "sim_compute_robot_state-npc3": 0.06190986568863328}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.6407839422632843, "sim_physics": 0.18043245889444268, "survival_time": 5.649999999999988, "driven_lanedir": 0.27701105251901703, "sim_render-ego": 0.05880966228721416, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.22308322813658588, "deviation-heading": 1.4704231379576875, "set_robot_commands": 0.09487996059181417, "deviation-center-line": 0.2152236101795376, "driven_lanedir_consec": 0.27701105251901703, "sim_compute_sim_state": 0.0368793369394488, "sim_compute_performance-ego": 0.06843328264962255, "sim_compute_robot_state-ego": 0.07756082357558529, "sim_compute_robot_state-npc0": 0.06880976035531643, "sim_compute_robot_state-npc1": 0.06708275955335229, "sim_compute_robot_state-npc2": 0.06818468169828432, "sim_compute_robot_state-npc3": 0.0660252571105957}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5430090254887557, "sim_physics": 0.16188069378457418, "survival_time": 4.099999999999993, "driven_lanedir": 0.202070592224874, "sim_render-ego": 0.05767757427401659, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.19346128731239132, "deviation-heading": 1.216124699683142, "set_robot_commands": 0.08804085196518316, "deviation-center-line": 0.13316001985112372, "driven_lanedir_consec": 0.202070592224874, "sim_compute_sim_state": 0.035066784881963964, "sim_compute_performance-ego": 0.06576247040818377, "sim_compute_robot_state-ego": 0.0673168403346364, "sim_compute_robot_state-npc0": 0.06263153145952922, "sim_compute_robot_state-npc1": 0.06397671815825672, "sim_compute_robot_state-npc2": 0.06282337700448386, "sim_compute_robot_state-npc3": 0.06161102725238335}}
set_robot_commands_max	0.0982791493678915
set_robot_commands_mean	0.0888883352012315
set_robot_commands_median	0.08829514627103452
set_robot_commands_min	0.07918407700278542
sim_compute_performance-ego_max	0.06843328264962255
sim_compute_performance-ego_mean	0.06411841913203511
sim_compute_performance-ego_median	0.06340133496957231
sim_compute_performance-ego_min	0.06078465231533709
sim_compute_robot_state-ego_max	0.07756082357558529
sim_compute_robot_state-ego_mean	0.0679541584541115
sim_compute_robot_state-ego_median	0.06689032530173278
sim_compute_robot_state-ego_min	0.0631576472315295
sim_compute_robot_state-npc0_max	0.06880976035531643
sim_compute_robot_state-npc0_mean	0.06384550302642321
sim_compute_robot_state-npc0_median	0.06354245194443711
sim_compute_robot_state-npc0_min	0.05961633246877919
sim_compute_robot_state-npc1_max	0.06708275955335229
sim_compute_robot_state-npc1_mean	0.0632026982535249
sim_compute_robot_state-npc1_median	0.06349365120260124
sim_compute_robot_state-npc1_min	0.05981842235282615
sim_compute_robot_state-npc2_max	0.07009280120933449
sim_compute_robot_state-npc2_mean	0.06366683403751822
sim_compute_robot_state-npc2_median	0.0628348970413208
sim_compute_robot_state-npc2_min	0.05936650089595629
sim_compute_robot_state-npc3_max	0.06905838683411315
sim_compute_robot_state-npc3_mean	0.0636543067895341
sim_compute_robot_state-npc3_median	0.06327181613003766
sim_compute_robot_state-npc3_min	0.0602521274400794
sim_compute_sim_state_max	0.039099276720822515
sim_compute_sim_state_mean	0.035963342191620826
sim_compute_sim_state_median	0.03574448947248788
sim_compute_sim_state_min	0.033524843779477204
sim_physics_max	0.1805969690665221
sim_physics_mean	0.1597409255586726
sim_physics_median	0.15875035729901543
sim_physics_min	0.1381794507952704
sim_render-ego_max	0.06507481672824958
sim_render-ego_mean	0.05850020095989333
sim_render-ego_median	0.05789319232658104
sim_render-ego_min	0.05500273082567298
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.796666666666662
survival_time_min	3.1999999999999966

No reset possible

20914

2949

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 15:00:32+00:00

2019-04-27 15:06:58+00:00

0:06:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08787355924771556
survival_time_median	1.1500000000000004
deviation-center-line_median	0.0706492421606213
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17587655561941642
agent_compute-ego_mean	0.16063998253200723
agent_compute-ego_median	0.15812664446623428
agent_compute-ego_min	0.14779947115027386
deviation-center-line_max	0.10171781518954984
deviation-center-line_mean	0.07623603354701503
deviation-center-line_min	0.05708627502380784
deviation-heading_max	0.9475359374906298
deviation-heading_mean	0.6464852760742658
deviation-heading_median	0.6409906001439911
deviation-heading_min	0.4135209014434082
driven_any_max	0.21630717907741365
driven_any_mean	0.17722001420632277
driven_any_median	0.1756049152750405
driven_any_min	0.14428727825550086
driven_lanedir_consec_max	0.14705645111163168
driven_lanedir_consec_mean	0.10523450286150536
driven_lanedir_consec_min	0.08117394862572525
driven_lanedir_max	0.14705645111163168
driven_lanedir_mean	0.10523450286150536
driven_lanedir_median	0.08787355924771556
driven_lanedir_min	0.08117394862572525
in-drivable-lane_max	0.6000000000000005
in-drivable-lane_mean	0.15000000000000013
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21630717907741365, "sim_physics": 0.16896374786601348, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08117394862572525, "sim_render-ego": 0.06590637739966898, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16693395025589886, "deviation-heading": 0.6409906001439911, "set_robot_commands": 0.0852658187641817, "deviation-center-line": 0.05708627502380784, "driven_lanedir_consec": 0.08117394862572525, "sim_compute_sim_state": 0.03278261773726519, "sim_compute_performance-ego": 0.0607985678841086, "sim_compute_robot_state-ego": 0.06937965926002054, "sim_compute_robot_state-npc0": 0.06465852961820714, "sim_compute_robot_state-npc1": 0.06328207605025347, "sim_compute_robot_state-npc2": 0.05892567073597627, "sim_compute_robot_state-npc3": 0.056671885883106905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19220286501562997, "sim_physics": 0.17935237178096064, "survival_time": 1.3500000000000003, "driven_lanedir": 0.08529229336311461, "sim_render-ego": 0.06052427821689182, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17587655561941642, "deviation-heading": 0.9475359374906298, "set_robot_commands": 0.09901199517426668, "deviation-center-line": 0.0706492421606213, "driven_lanedir_consec": 0.08529229336311461, "sim_compute_sim_state": 0.03777431558679651, "sim_compute_performance-ego": 0.07384913055985062, "sim_compute_robot_state-ego": 0.07866281050222891, "sim_compute_robot_state-npc0": 0.06766176223754883, "sim_compute_robot_state-npc1": 0.06870175290990758, "sim_compute_robot_state-npc2": 0.06955170631408691, "sim_compute_robot_state-npc3": 0.06939743183277271}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1756049152750405, "sim_physics": 0.15627867242564325, "survival_time": 1.1500000000000004, "driven_lanedir": 0.14705645111163168, "sim_render-ego": 0.05443478667217752, "in-drivable-lane": 0, "agent_compute-ego": 0.15812664446623428, "deviation-heading": 0.4135209014434082, "set_robot_commands": 0.08985314161881157, "deviation-center-line": 0.10171781518954984, "driven_lanedir_consec": 0.14705645111163168, "sim_compute_sim_state": 0.03987070788507876, "sim_compute_performance-ego": 0.06183548595594323, "sim_compute_robot_state-ego": 0.06121663425279701, "sim_compute_robot_state-npc0": 0.06455718952676524, "sim_compute_robot_state-npc1": 0.06236346908237623, "sim_compute_robot_state-npc2": 0.05748810975447945, "sim_compute_robot_state-npc3": 0.06058886776799741}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1576978334080289, "sim_physics": 0.1729426072991413, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12477626195933976, "sim_render-ego": 0.05547342093094536, "in-drivable-lane": 0, "agent_compute-ego": 0.14779947115027386, "deviation-heading": 0.4669986229428005, "set_robot_commands": 0.09605220089788022, "deviation-center-line": 0.09462762749518686, "driven_lanedir_consec": 0.12477626195933976, "sim_compute_sim_state": 0.03501943919969642, "sim_compute_performance-ego": 0.0606255116670028, "sim_compute_robot_state-ego": 0.0687801630600639, "sim_compute_robot_state-npc0": 0.06739072177721106, "sim_compute_robot_state-npc1": 0.06475462084231169, "sim_compute_robot_state-npc2": 0.06477197356846022, "sim_compute_robot_state-npc3": 0.0605882976366126}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14428727825550086, "sim_physics": 0.16223973577672784, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08787355924771556, "sim_render-ego": 0.057486469095403496, "in-drivable-lane": 0, "agent_compute-ego": 0.1544632911682129, "deviation-heading": 0.7633803183504989, "set_robot_commands": 0.08762841874902899, "deviation-center-line": 0.05709920786590927, "driven_lanedir_consec": 0.08787355924771556, "sim_compute_sim_state": 0.03436862338672985, "sim_compute_performance-ego": 0.06562122431668369, "sim_compute_robot_state-ego": 0.06445519490675493, "sim_compute_robot_state-npc0": 0.06311678886413574, "sim_compute_robot_state-npc1": 0.06367256424643776, "sim_compute_robot_state-npc2": 0.058295488357543945, "sim_compute_robot_state-npc3": 0.05994400111111728}}
set_robot_commands_max	0.09901199517426668
set_robot_commands_mean	0.09156231504083384
set_robot_commands_median	0.08985314161881157
set_robot_commands_min	0.0852658187641817
sim_compute_performance-ego_max	0.07384913055985062
sim_compute_performance-ego_mean	0.06454598407671779
sim_compute_performance-ego_median	0.06183548595594323
sim_compute_performance-ego_min	0.0606255116670028
sim_compute_robot_state-ego_max	0.07866281050222891
sim_compute_robot_state-ego_mean	0.06849889239637305
sim_compute_robot_state-ego_median	0.0687801630600639
sim_compute_robot_state-ego_min	0.06121663425279701
sim_compute_robot_state-npc0_max	0.06766176223754883
sim_compute_robot_state-npc0_mean	0.0654769984047736
sim_compute_robot_state-npc0_median	0.06465852961820714
sim_compute_robot_state-npc0_min	0.06311678886413574
sim_compute_robot_state-npc1_max	0.06870175290990758
sim_compute_robot_state-npc1_mean	0.06455489662625734
sim_compute_robot_state-npc1_median	0.06367256424643776
sim_compute_robot_state-npc1_min	0.06236346908237623
sim_compute_robot_state-npc2_max	0.06955170631408691
sim_compute_robot_state-npc2_mean	0.06180658974610935
sim_compute_robot_state-npc2_median	0.05892567073597627
sim_compute_robot_state-npc2_min	0.05748810975447945
sim_compute_robot_state-npc3_max	0.06939743183277271
sim_compute_robot_state-npc3_mean	0.06143809684632138
sim_compute_robot_state-npc3_median	0.0605882976366126
sim_compute_robot_state-npc3_min	0.056671885883106905
sim_compute_sim_state_max	0.03987070788507876
sim_compute_sim_state_mean	0.035963140759113346
sim_compute_sim_state_median	0.03501943919969642
sim_compute_sim_state_min	0.03278261773726519
sim_physics_max	0.17935237178096064
sim_physics_mean	0.1679554270296973
sim_physics_median	0.16896374786601348
sim_physics_min	0.15627867242564325
sim_render-ego_max	0.06590637739966898
sim_render-ego_mean	0.058765066463017435
sim_render-ego_median	0.057486469095403496
sim_render-ego_min	0.05443478667217752
simulation-passed	1
survival_time_max	1.7000000000000008
survival_time_mean	1.2900000000000005
survival_time_min	1.1000000000000003

No reset possible

20903

2965

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 14:48:40+00:00

2019-04-27 15:00:03+00:00

0:11:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2965/step1-simulation-ip-172-31-25-98-2348-job20903/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20890

2990

Maxim Scherbakov

challenge-aido_LF-template-tensorflow

step1-simulation

success

2019-04-27 14:25:33+00:00

2019-04-27 14:48:22+00:00

0:22:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5527638854387128
survival_time_median	3.149999999999997
deviation-center-line_median	0.16763493238779217
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.16184042930603026
agent_compute-ego_mean	0.14245184328944513
agent_compute-ego_median	0.14003795882066092
agent_compute-ego_min	0.11412333039676442
deviation-center-line_max	0.329654756518298
deviation-center-line_mean	0.1837270206658312
deviation-center-line_min	0.08995827918647338
deviation-heading_max	2.072612345495946
deviation-heading_mean	1.0911822739912538
deviation-heading_median	1.0359074858860318
deviation-heading_min	0.2522538114530115
driven_any_max	1.4539784691217368
driven_any_mean	0.9353503175758208
driven_any_median	1.0020276529696566
driven_any_min	0.32530276379788803
driven_lanedir_consec_max	1.375507620095423
driven_lanedir_consec_mean	0.6527862286780975
driven_lanedir_consec_min	0.29355990415171007
driven_lanedir_max	1.375507620095423
driven_lanedir_mean	0.6565108833691862
driven_lanedir_median	0.5527638854387128
driven_lanedir_min	0.29355990415171007
in-drivable-lane_max	1.6999999999999973
in-drivable-lane_mean	0.5999999999999981
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4506596934071787, "sim_physics": 0.11207287788391113, "survival_time": 4.99999999999999, "driven_lanedir": 1.375507620095423, "sim_render-ego": 0.06397238731384278, "in-drivable-lane": 0, "agent_compute-ego": 0.16082417488098144, "deviation-heading": 1.4080725027651215, "set_robot_commands": 0.098790602684021, "deviation-center-line": 0.329654756518298, "driven_lanedir_consec": 1.375507620095423, "sim_compute_sim_state": 0.04001071214675903, "sim_compute_performance-ego": 0.07242606163024902, "sim_compute_robot_state-ego": 0.07483211755752564}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.208830181029407, "sim_physics": 0.10913627603080836, "survival_time": 4.449999999999992, "driven_lanedir": 0.5527638854387128, "sim_render-ego": 0.06389035535662362, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.1524551370170679, "deviation-heading": 1.7612854522487575, "set_robot_commands": 0.0950135247091229, "deviation-center-line": 0.16763493238779217, "driven_lanedir_consec": 0.5527638854387128, "sim_compute_sim_state": 0.040014853638209655, "sim_compute_performance-ego": 0.06874280029468322, "sim_compute_robot_state-ego": 0.0805225908086541}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.286380880649831, "sim_physics": 0.11805581485523896, "survival_time": 4.249999999999993, "driven_lanedir": 0.5088622967037075, "sim_render-ego": 0.06486554426305434, "in-drivable-lane": 1.6999999999999973, "agent_compute-ego": 0.15818651143242332, "deviation-heading": 1.4157072771081538, "set_robot_commands": 0.0973423537086038, "deviation-center-line": 0.18490833496789943, "driven_lanedir_consec": 0.5088622967037075, "sim_compute_sim_state": 0.03791712873122272, "sim_compute_performance-ego": 0.07048458211562213, "sim_compute_robot_state-ego": 0.07882278386284323}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9038432098565586, "sim_physics": 0.1086072013491676, "survival_time": 3.149999999999997, "driven_lanedir": 0.5087029539923704, "sim_render-ego": 0.061097304026285805, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.1499475638071696, "deviation-heading": 2.072612345495946, "set_robot_commands": 0.0973141836741614, "deviation-center-line": 0.17946624491951477, "driven_lanedir_consec": 0.484354328771186, "sim_compute_sim_state": 0.03906854750618102, "sim_compute_performance-ego": 0.06697365972730848, "sim_compute_robot_state-ego": 0.0749851559835767}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0886751146389029, "sim_physics": 0.11427694886595338, "survival_time": 4.549999999999992, "driven_lanedir": 0.7686858353047623, "sim_render-ego": 0.06329487444280268, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1557330744607108, "deviation-heading": 1.8069365186159845, "set_robot_commands": 0.09798832778092267, "deviation-center-line": 0.28704507236232113, "driven_lanedir_consec": 0.7371646401596164, "sim_compute_sim_state": 0.0398406248826247, "sim_compute_performance-ego": 0.06960681768564078, "sim_compute_robot_state-ego": 0.07895695246182956}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0020276529696566, "sim_physics": 0.08670920436665164, "survival_time": 2.9499999999999975, "driven_lanedir": 0.7394287954651659, "sim_render-ego": 0.05473991167747368, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13456170437699658, "deviation-heading": 0.8661955587034789, "set_robot_commands": 0.08521552409155894, "deviation-center-line": 0.11324672431995844, "driven_lanedir_consec": 0.7394287954651659, "sim_compute_sim_state": 0.03513972233917754, "sim_compute_performance-ego": 0.06314375036853855, "sim_compute_robot_state-ego": 0.0654327303676282}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.3491638891724095, "sim_physics": 0.12706269667698786, "survival_time": 1.3000000000000005, "driven_lanedir": 0.3211637879420084, "sim_render-ego": 0.05856676285083477, "in-drivable-lane": 0, "agent_compute-ego": 0.14961463671464187, "deviation-heading": 0.43819473027518513, "set_robot_commands": 0.0873801983319796, "deviation-center-line": 0.08995827918647338, "driven_lanedir_consec": 0.3211637879420084, "sim_compute_sim_state": 0.03396134193126972, "sim_compute_performance-ego": 0.0650637883406419, "sim_compute_robot_state-ego": 0.06755389617039607}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.5361573483235569, "sim_physics": 0.08027014311622171, "survival_time": 1.7000000000000008, "driven_lanedir": 0.5170856829714657, "sim_render-ego": 0.04807436466217041, "in-drivable-lane": 0, "agent_compute-ego": 0.11412333039676442, "deviation-heading": 0.36238168282416966, "set_robot_commands": 0.07331310300266042, "deviation-center-line": 0.1067280333908134, "driven_lanedir_consec": 0.5170856829714657, "sim_compute_sim_state": 0.029263671706704533, "sim_compute_performance-ego": 0.04864797872655532, "sim_compute_robot_state-ego": 0.05232883902157054}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.1638823616546332, "sim_physics": 0.10218205799659091, "survival_time": 4.799999999999991, "driven_lanedir": 0.7995499599834117, "sim_render-ego": 0.05890685568253199, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.14003795882066092, "deviation-heading": 1.213736100511029, "set_robot_commands": 0.08786383767922719, "deviation-center-line": 0.31437297062773484, "driven_lanedir_consec": 0.7995499599834117, "sim_compute_sim_state": 0.036123951276143394, "sim_compute_performance-ego": 0.06486927966276805, "sim_compute_robot_state-ego": 0.06710640837748845}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6500785460953573, "sim_physics": 0.09551044579209952, "survival_time": 2.8999999999999977, "driven_lanedir": 0.29355990415171007, "sim_render-ego": 0.057530974519663845, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.13383698874506458, "deviation-heading": 0.9862933185537882, "set_robot_commands": 0.08086373477146544, "deviation-center-line": 0.13754778784840638, "driven_lanedir_consec": 0.29355990415171007, "sim_compute_sim_state": 0.035081296131528654, "sim_compute_performance-ego": 0.06298491461523648, "sim_compute_robot_state-ego": 0.0641353911366956}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.42629004576685897, "sim_physics": 0.12333633422851564, "survival_time": 1.2500000000000004, "driven_lanedir": 0.4084901828015895, "sim_render-ego": 0.06525984764099121, "in-drivable-lane": 0, "agent_compute-ego": 0.16184042930603026, "deviation-heading": 0.2522538114530115, "set_robot_commands": 0.09939363479614258, "deviation-center-line": 0.09802504260501918, "driven_lanedir_consec": 0.4084901828015895, "sim_compute_sim_state": 0.03997013092041016, "sim_compute_performance-ego": 0.07054417610168456, "sim_compute_robot_state-ego": 0.07462465286254882}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.32530276379788803, "sim_physics": 0.1176888209122878, "survival_time": 1.3000000000000005, "driven_lanedir": 0.30658244116076905, "sim_render-ego": 0.05556778724376972, "in-drivable-lane": 0, "agent_compute-ego": 0.13841560253730187, "deviation-heading": 0.3788664566868691, "set_robot_commands": 0.09626089609586276, "deviation-center-line": 0.10777332860558024, "driven_lanedir_consec": 0.30658244116076905, "sim_compute_sim_state": 0.05214374798994798, "sim_compute_performance-ego": 0.05936594192798321, "sim_compute_robot_state-ego": 0.06390345096588135}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.3537859617049284, "sim_physics": 0.09220454744670702, "survival_time": 4.599999999999992, "driven_lanedir": 0.9147967249617056, "sim_render-ego": 0.0577282542767732, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.13706981358320816, "deviation-heading": 1.0359074858860318, "set_robot_commands": 0.08981583170268846, "deviation-center-line": 0.1253952842158299, "driven_lanedir_consec": 0.9147967249617056, "sim_compute_sim_state": 0.036412179470062256, "sim_compute_performance-ego": 0.06338169522907423, "sim_compute_robot_state-ego": 0.06761769885602205}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.4539784691217368, "sim_physics": 0.08801637268066406, "survival_time": 6.249999999999986, "driven_lanedir": 1.0375012202984228, "sim_render-ego": 0.051508007049560545, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.11605238914489746, "deviation-heading": 1.727844816698034, "set_robot_commands": 0.07252096939086915, "deviation-center-line": 0.2806419592092974, "driven_lanedir_consec": 1.0375012202984228, "sim_compute_sim_state": 0.031819616317749023, "sim_compute_performance-ego": 0.055285915374755856, "sim_compute_robot_state-ego": 0.057506000518798825}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.8311986454484066, "sim_physics": 0.0988522850233933, "survival_time": 2.8999999999999977, "driven_lanedir": 0.7949819592665679, "sim_render-ego": 0.05819150908239957, "in-drivable-lane": 0, "agent_compute-ego": 0.13407833411775785, "deviation-heading": 0.6414460520432468, "set_robot_commands": 0.08830587206215694, "deviation-center-line": 0.23350655882252916, "driven_lanedir_consec": 0.7949819592665679, "sim_compute_sim_state": 0.03670608175211939, "sim_compute_performance-ego": 0.06365713990967849, "sim_compute_robot_state-ego": 0.06536074342398808}}
set_robot_commands_max	0.09939363479614258
set_robot_commands_mean	0.0898255062987629
set_robot_commands_median	0.08981583170268846
set_robot_commands_min	0.07252096939086915
sim_compute_performance-ego_max	0.07242606163024902
sim_compute_performance-ego_mean	0.06434523344736134
sim_compute_performance-ego_median	0.06486927966276805
sim_compute_performance-ego_min	0.04864797872655532
sim_compute_robot_state-ego_max	0.0805225908086541
sim_compute_robot_state-ego_mean	0.06891262749169648
sim_compute_robot_state-ego_median	0.06755389617039607
sim_compute_robot_state-ego_min	0.05232883902157054
sim_compute_sim_state_max	0.05214374798994798
sim_compute_sim_state_mean	0.03756490711600732
sim_compute_sim_state_median	0.03670608175211939
sim_compute_sim_state_min	0.029263671706704533
sim_physics_max	0.12706269667698786
sim_physics_mean	0.10493213514834658
sim_physics_median	0.1086072013491676
sim_physics_min	0.08027014311622171
sim_render-ego_max	0.06525984764099121
sim_render-ego_mean	0.05887964933925187
sim_render-ego_median	0.05856676285083477
sim_render-ego_min	0.04807436466217041
simulation-passed	1
survival_time_max	6.249999999999986
survival_time_mean	3.423333333333329
survival_time_min	1.2500000000000004

No reset possible

20887

2994

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-27 14:24:37+00:00

2019-04-27 14:25:12+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20885

2998

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-27 14:23:41+00:00

2019-04-27 14:24:19+00:00

0:00:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20883

3003

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-27 14:20:27+00:00

2019-04-27 14:23:13+00:00

0:02:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20882

3006

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:19:27+00:00

2019-04-27 14:20:00+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20881

3007

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:18:36+00:00

2019-04-27 14:19:09+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20880

3010

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:17:37+00:00

2019-04-27 14:18:10+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20879

3011

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:16:32+00:00

2019-04-27 14:17:05+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20878

3014

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:15:00+00:00

2019-04-27 14:15:33+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20877

3015

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:14:07+00:00

2019-04-27 14:14:39+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20876

3018

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:13:08+00:00

2019-04-27 14:13:40+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20875

3019

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:12:07+00:00

2019-04-27 14:12:41+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20874

3022

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:11:11+00:00

2019-04-27 14:11:45+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20873

3023

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:10:13+00:00

2019-04-27 14:10:44+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20872

3026

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:09:16+00:00

2019-04-27 14:09:48+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20871

3027

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:08:13+00:00

2019-04-27 14:08:47+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20870

3030

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:07:18+00:00

2019-04-27 14:07:50+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20869

3031

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:06:25+00:00

2019-04-27 14:06:58+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20868

3034

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:05:32+00:00

2019-04-27 14:06:05+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20867

3035

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:03:50+00:00

2019-04-27 14:04:55+00:00

0:01:05

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20859

3038

challenge-aido_LF-template-pytorch

step1-simulation

error

2019-04-27 14:00:31+00:00

2019-04-27 14:03:17+00:00

0:02:46

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20840

3055

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 13:46:02+00:00

2019-04-27 14:00:12+00:00

0:14:10

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3055/step1-simulation-ip-172-31-25-98-2348-job20840/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20826

3096

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 13:23:15+00:00

2019-04-27 13:45:20+00:00

0:22:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5817924136828502
survival_time_median	14.950000000000076
deviation-center-line_median	1.1802345238870453
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1306238571802775
agent_compute-ego_mean	0.12137511479093847
agent_compute-ego_median	0.1200253184636434
agent_compute-ego_min	0.1111272069124075
deviation-center-line_max	1.5064904443176683
deviation-center-line_mean	1.1027991229075722
deviation-center-line_min	0.4465533666217405
deviation-heading_max	3.302572615429076
deviation-heading_mean	2.0344406878641292
deviation-heading_median	2.008185305538093
deviation-heading_min	1.1354961619137771
driven_any_max	0.7830631958600012
driven_any_mean	0.6652219268524439
driven_any_median	0.7805094846014029
driven_any_min	0.39999562853214216
driven_lanedir_consec_max	0.7773624434023549
driven_lanedir_consec_mean	0.6112560962043172
driven_lanedir_consec_min	0.3724891516780122
driven_lanedir_max	0.7773624434023549
driven_lanedir_mean	0.6112560962043172
driven_lanedir_median	0.5817924136828502
driven_lanedir_min	0.3724891516780122
in-drivable-lane_max	3.5500000000000504
in-drivable-lane_mean	0.7100000000000101
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7805094846014029, "sim_physics": 0.10127102613449096, "survival_time": 14.950000000000076, "driven_lanedir": 0.7482753191811706, "sim_render-ego": 0.05678958177566528, "in-drivable-lane": 0, "agent_compute-ego": 0.1200253184636434, "deviation-heading": 3.302572615429076, "set_robot_commands": 0.09170375188191732, "deviation-center-line": 1.1249984518057103, "driven_lanedir_consec": 0.7482753191811706, "sim_compute_sim_state": 0.03640087286631266, "sim_compute_performance-ego": 0.06461449225743611, "sim_compute_robot_state-ego": 0.06841645161310832}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7830630052773291, "sim_physics": 0.11090267658233642, "survival_time": 14.950000000000076, "driven_lanedir": 0.5817924136828502, "sim_render-ego": 0.0630760916074117, "in-drivable-lane": 3.5500000000000504, "agent_compute-ego": 0.1272544312477112, "deviation-heading": 2.008185305538093, "set_robot_commands": 0.09857720136642456, "deviation-center-line": 1.1802345238870453, "driven_lanedir_consec": 0.5817924136828502, "sim_compute_sim_state": 0.03939095020294189, "sim_compute_performance-ego": 0.07090825080871582, "sim_compute_robot_state-ego": 0.07689704259236653}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5794783199913445, "sim_physics": 0.1039984055164149, "survival_time": 11.150000000000023, "driven_lanedir": 0.5763611530771979, "sim_render-ego": 0.06212512687717318, "in-drivable-lane": 0, "agent_compute-ego": 0.11784476015065284, "deviation-heading": 1.1354961619137771, "set_robot_commands": 0.09924307425460473, "deviation-center-line": 1.2557188279056966, "driven_lanedir_consec": 0.5763611530771979, "sim_compute_sim_state": 0.03936884221474686, "sim_compute_performance-ego": 0.06946849929912208, "sim_compute_robot_state-ego": 0.07596044262428454}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.39999562853214216, "sim_physics": 0.10562482858315492, "survival_time": 7.79999999999998, "driven_lanedir": 0.3724891516780122, "sim_render-ego": 0.05712736111420851, "in-drivable-lane": 0, "agent_compute-ego": 0.1111272069124075, "deviation-heading": 2.5625789856143397, "set_robot_commands": 0.09276554523370203, "deviation-center-line": 0.4465533666217405, "driven_lanedir_consec": 0.3724891516780122, "sim_compute_sim_state": 0.03880934684704512, "sim_compute_performance-ego": 0.063388847387754, "sim_compute_robot_state-ego": 0.06805970729925694}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7830631958600012, "sim_physics": 0.10987584193547568, "survival_time": 14.950000000000076, "driven_lanedir": 0.7773624434023549, "sim_render-ego": 0.06243482748667399, "in-drivable-lane": 0, "agent_compute-ego": 0.1306238571802775, "deviation-heading": 1.163370370825359, "set_robot_commands": 0.09964242617289223, "deviation-center-line": 1.5064904443176683, "driven_lanedir_consec": 0.7773624434023549, "sim_compute_sim_state": 0.038938140869140624, "sim_compute_performance-ego": 0.0698365561167399, "sim_compute_robot_state-ego": 0.07703331152598063}}
set_robot_commands_max	0.09964242617289223
set_robot_commands_mean	0.0963863997819082
set_robot_commands_median	0.09857720136642456
set_robot_commands_min	0.09170375188191732
sim_compute_performance-ego_max	0.07090825080871582
sim_compute_performance-ego_mean	0.06764332917395358
sim_compute_performance-ego_median	0.06946849929912208
sim_compute_performance-ego_min	0.063388847387754
sim_compute_robot_state-ego_max	0.07703331152598063
sim_compute_robot_state-ego_mean	0.07327339113099939
sim_compute_robot_state-ego_median	0.07596044262428454
sim_compute_robot_state-ego_min	0.06805970729925694
sim_compute_sim_state_max	0.03939095020294189
sim_compute_sim_state_mean	0.03858163060003743
sim_compute_sim_state_median	0.038938140869140624
sim_compute_sim_state_min	0.03640087286631266
sim_physics_max	0.11090267658233642
sim_physics_mean	0.10633455575037458
sim_physics_median	0.10562482858315492
sim_physics_min	0.10127102613449096
sim_render-ego_max	0.0630760916074117
sim_render-ego_mean	0.06031059777222654
sim_render-ego_median	0.06212512687717318
sim_render-ego_min	0.05678958177566528
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.760000000000048
survival_time_min	7.79999999999998

No reset possible

20805

3104

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-27 13:00:22+00:00

2019-04-27 13:22:43+00:00

0:22:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4216945916313639
survival_time_median	14.950000000000076
deviation-center-line_median	0.6322739629890628
in-drivable-lane_median	5.500000000000033

other stats

agent_compute-ego_max	0.21240916412867855
agent_compute-ego_mean	0.2035117877504637
agent_compute-ego_median	0.20707167943318688
agent_compute-ego_min	0.19181801875432333
deviation-center-line_max	0.9592454849336416
deviation-center-line_mean	0.6665577655822414
deviation-center-line_min	0.4881519496433221
deviation-heading_max	3.231129368503044
deviation-heading_mean	2.06846506058257
deviation-heading_median	1.724478745061807
deviation-heading_min	1.1719700654952054
driven_any_max	0.9427768826356054
driven_any_mean	0.8668447192756454
driven_any_median	0.9264855999057502
driven_any_min	0.6735681179795491
driven_lanedir_consec_max	0.8038027177520073
driven_lanedir_consec_mean	0.5177972401200811
driven_lanedir_consec_min	0.31083226381609386
driven_lanedir_max	0.8038027177520073
driven_lanedir_mean	0.5177972401200811
driven_lanedir_median	0.4216945916313639
driven_lanedir_min	0.31083226381609386
in-drivable-lane_max	9.250000000000089
in-drivable-lane_mean	5.06000000000005
in-drivable-lane_min	1.7000000000000242
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8487867304626403, "sim_physics": 0.10085138131616714, "survival_time": 13.350000000000056, "driven_lanedir": 0.4216945916313639, "sim_render-ego": 0.06155498197462675, "in-drivable-lane": 6.350000000000072, "agent_compute-ego": 0.21240916412867855, "deviation-heading": 1.1719700654952054, "set_robot_commands": 0.0989560205838207, "deviation-center-line": 0.7484054369494832, "driven_lanedir_consec": 0.4216945916313639, "sim_compute_sim_state": 0.03933469275856733, "sim_compute_performance-ego": 0.06915944435176778, "sim_compute_robot_state-ego": 0.07356261939145206}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9264855999057502, "sim_physics": 0.1089173420270284, "survival_time": 14.950000000000076, "driven_lanedir": 0.311491395367374, "sim_render-ego": 0.060025769074757894, "in-drivable-lane": 9.250000000000089, "agent_compute-ego": 0.20707167943318688, "deviation-heading": 1.724478745061807, "set_robot_commands": 0.0947151025136312, "deviation-center-line": 0.4881519496433221, "driven_lanedir_consec": 0.311491395367374, "sim_compute_sim_state": 0.038360341389973955, "sim_compute_performance-ego": 0.0667057736714681, "sim_compute_robot_state-ego": 0.07215351978937785}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9427768826356054, "sim_physics": 0.09631345351537068, "survival_time": 14.950000000000076, "driven_lanedir": 0.7411652320335662, "sim_render-ego": 0.05533682902654012, "in-drivable-lane": 2.5000000000000355, "agent_compute-ego": 0.19181801875432333, "deviation-heading": 3.231129368503044, "set_robot_commands": 0.08722084760665894, "deviation-center-line": 0.9592454849336416, "driven_lanedir_consec": 0.7411652320335662, "sim_compute_sim_state": 0.03599820057551066, "sim_compute_performance-ego": 0.06081885655721029, "sim_compute_robot_state-ego": 0.06472955862681071}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.942606265394682, "sim_physics": 0.10178436676661172, "survival_time": 14.950000000000076, "driven_lanedir": 0.8038027177520073, "sim_render-ego": 0.05894888401031494, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.21002142429351808, "deviation-heading": 2.7332477753783713, "set_robot_commands": 0.0929852827390035, "deviation-center-line": 0.6322739629890628, "driven_lanedir_consec": 0.8038027177520073, "sim_compute_sim_state": 0.037113043467203774, "sim_compute_performance-ego": 0.06599226633707682, "sim_compute_robot_state-ego": 0.07254507621129354}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6735681179795491, "sim_physics": 0.0997873761437156, "survival_time": 11.00000000000002, "driven_lanedir": 0.31083226381609386, "sim_render-ego": 0.05768495256250555, "in-drivable-lane": 5.500000000000033, "agent_compute-ego": 0.1962386521426114, "deviation-heading": 1.4814993484744203, "set_robot_commands": 0.0891984842040322, "deviation-center-line": 0.504711993395697, "driven_lanedir_consec": 0.31083226381609386, "sim_compute_sim_state": 0.03528711579062722, "sim_compute_performance-ego": 0.06383831284262917, "sim_compute_robot_state-ego": 0.06847353848544034}}
set_robot_commands_max	0.0989560205838207
set_robot_commands_mean	0.0926151475294293
set_robot_commands_median	0.0929852827390035
set_robot_commands_min	0.08722084760665894
sim_compute_performance-ego_max	0.06915944435176778
sim_compute_performance-ego_mean	0.06530293075203042
sim_compute_performance-ego_median	0.06599226633707682
sim_compute_performance-ego_min	0.06081885655721029
sim_compute_robot_state-ego_max	0.07356261939145206
sim_compute_robot_state-ego_mean	0.07029286250087491
sim_compute_robot_state-ego_median	0.07215351978937785
sim_compute_robot_state-ego_min	0.06472955862681071
sim_compute_sim_state_max	0.03933469275856733
sim_compute_sim_state_mean	0.03721867879637659
sim_compute_sim_state_median	0.037113043467203774
sim_compute_sim_state_min	0.03528711579062722
sim_physics_max	0.1089173420270284
sim_physics_mean	0.10153078395377872
sim_physics_median	0.10085138131616714
sim_physics_min	0.09631345351537068
sim_render-ego_max	0.06155498197462675
sim_render-ego_mean	0.058710283329749056
sim_render-ego_median	0.05894888401031494
sim_render-ego_min	0.05533682902654012
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.84000000000006
survival_time_min	11.00000000000002

No reset possible

20801

2991

Artem Ioselevskii

challenge-aido_LF-template-tensorflow

step1-simulation

host-error

2019-04-27 12:45:10+00:00

2019-04-27 13:00:08+00:00

0:14:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2991/step1-simulation-ip-172-31-25-98-2348-job20801/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20789

2912

Thies Lennart Alff 🇩🇪

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 12:05:19+00:00

2019-04-27 12:44:44+00:00

0:39:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7463164654374173
survival_time_median	5.649999999999988
deviation-center-line_median	0.4108826929008622
in-drivable-lane_median	1.149999999999998

other stats

agent_compute-ego_max	0.10117974051509997
agent_compute-ego_mean	0.09305715658766342
agent_compute-ego_median	0.09269714891240838
agent_compute-ego_min	0.08894949489169651
deviation-center-line_max	1.0424751837838946
deviation-center-line_mean	0.48783083339248245
deviation-center-line_min	0.2808648634491642
deviation-heading_max	6.360569138432639
deviation-heading_mean	2.595299341772301
deviation-heading_median	1.8493140529404597
deviation-heading_min	0.6597013621224311
driven_any_max	2.348618638041652
driven_any_mean	1.2077942538535775
driven_any_median	0.8543082194551828
driven_any_min	0.6130639841398904
driven_lanedir_consec_max	1.0664775619530085
driven_lanedir_consec_mean	0.6941225793614069
driven_lanedir_consec_min	0.15117209564661516
driven_lanedir_max	1.3154714118327897
driven_lanedir_mean	0.780522850714488
driven_lanedir_median	0.7463164654374173
driven_lanedir_min	0.29155250013108996
in-drivable-lane_max	4.850000000000048
in-drivable-lane_mean	1.746666666666676
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7593411301766588, "sim_physics": 0.10662001721999224, "survival_time": 5.09999999999999, "driven_lanedir": 0.6210529213726836, "sim_render-ego": 0.061107390067156625, "in-drivable-lane": 0, "agent_compute-ego": 0.09016754580479042, "deviation-heading": 2.3425026543718186, "set_robot_commands": 0.098159719915951, "deviation-center-line": 0.3553498257343046, "driven_lanedir_consec": 0.6210529213726836, "sim_compute_sim_state": 0.039270569296444166, "sim_compute_performance-ego": 0.06788033130122166, "sim_compute_robot_state-ego": 0.0741814421672447}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6130639841398904, "sim_physics": 0.10720113386590796, "survival_time": 4.149999999999993, "driven_lanedir": 0.29155250013108996, "sim_render-ego": 0.06768224038273456, "in-drivable-lane": 1.149999999999998, "agent_compute-ego": 0.10117974051509997, "deviation-heading": 1.8493140529404597, "set_robot_commands": 0.1073690581034465, "deviation-center-line": 0.2891855730903157, "driven_lanedir_consec": 0.15117209564661516, "sim_compute_sim_state": 0.04111370121140078, "sim_compute_performance-ego": 0.0759685585297734, "sim_compute_robot_state-ego": 0.0856525208576616}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.741816760534188, "sim_physics": 0.09812571785666724, "survival_time": 4.94999999999999, "driven_lanedir": 0.7260649088848683, "sim_render-ego": 0.060463052807432235, "in-drivable-lane": 0, "agent_compute-ego": 0.08894949489169651, "deviation-heading": 0.903143609283572, "set_robot_commands": 0.0936986171838009, "deviation-center-line": 0.5271636472991755, "driven_lanedir_consec": 0.7260649088848683, "sim_compute_sim_state": 0.03809024830057164, "sim_compute_performance-ego": 0.06688881883717547, "sim_compute_robot_state-ego": 0.06843279828928937}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7659268997986907, "sim_physics": 0.09638603528340656, "survival_time": 5.09999999999999, "driven_lanedir": 0.7463164654374173, "sim_render-ego": 0.06010188074672923, "in-drivable-lane": 0, "agent_compute-ego": 0.09014572115505444, "deviation-heading": 1.0027669465766864, "set_robot_commands": 0.09347582097147024, "deviation-center-line": 0.42584917406584955, "driven_lanedir_consec": 0.7463164654374173, "sim_compute_sim_state": 0.038493927787331975, "sim_compute_performance-ego": 0.0685565378151688, "sim_compute_robot_state-ego": 0.0711278237548529}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348242627855297, "sim_physics": 0.12146964232126872, "survival_time": 14.950000000000076, "driven_lanedir": 1.3154714118327897, "sim_render-ego": 0.06347097714742024, "in-drivable-lane": 3.800000000000028, "agent_compute-ego": 0.09366963704427084, "deviation-heading": 6.360569138432639, "set_robot_commands": 0.09706654946009316, "deviation-center-line": 1.0424751837838946, "driven_lanedir_consec": 0.8045047419061597, "sim_compute_sim_state": 0.03869886000951131, "sim_compute_performance-ego": 0.06980665047963461, "sim_compute_robot_state-ego": 0.07494404157002767}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348618638041652, "sim_physics": 0.1270678981145223, "survival_time": 14.950000000000076, "driven_lanedir": 1.2017216367802137, "sim_render-ego": 0.061822633743286136, "in-drivable-lane": 4.850000000000048, "agent_compute-ego": 0.09523031155268352, "deviation-heading": 5.679820654791261, "set_robot_commands": 0.09717243989308676, "deviation-center-line": 0.8122312649136145, "driven_lanedir_consec": 0.8010183303715233, "sim_compute_sim_state": 0.03872557878494263, "sim_compute_performance-ego": 0.07164699633916219, "sim_compute_robot_state-ego": 0.07535353819529216}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.3681916812312276, "sim_physics": 0.12517564714291676, "survival_time": 8.84999999999999, "driven_lanedir": 0.8887733743385611, "sim_render-ego": 0.06441703219871736, "in-drivable-lane": 1.6500000000000066, "agent_compute-ego": 0.09680793379659706, "deviation-heading": 3.721604630957109, "set_robot_commands": 0.10159222150253036, "deviation-center-line": 0.40510127029939474, "driven_lanedir_consec": 0.8887733743385611, "sim_compute_sim_state": 0.03912892718773104, "sim_compute_performance-ego": 0.07116578527763065, "sim_compute_robot_state-ego": 0.080849888634547}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.6417172882688789, "sim_physics": 0.11365977734751044, "survival_time": 10.550000000000017, "driven_lanedir": 0.9618932952607164, "sim_render-ego": 0.060502495245910934, "in-drivable-lane": 3.350000000000028, "agent_compute-ego": 0.08989084727391247, "deviation-heading": 2.418910731226201, "set_robot_commands": 0.09440922285143231, "deviation-center-line": 0.8339667345208774, "driven_lanedir_consec": 0.8054596262000102, "sim_compute_sim_state": 0.03894610653556354, "sim_compute_performance-ego": 0.06676563041470063, "sim_compute_robot_state-ego": 0.06845820232590227}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4487601511795425, "sim_physics": 0.11224342284993054, "survival_time": 9.349999999999998, "driven_lanedir": 0.7496540368895186, "sim_render-ego": 0.061674373035124914, "in-drivable-lane": 3.5000000000000027, "agent_compute-ego": 0.08919683624716367, "deviation-heading": 2.698866839422958, "set_robot_commands": 0.09407876264602742, "deviation-center-line": 0.3209138898564394, "driven_lanedir_consec": 0.7496540368895186, "sim_compute_sim_state": 0.03816789866768741, "sim_compute_performance-ego": 0.07090300289704837, "sim_compute_robot_state-ego": 0.07368767962736242}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7015574514547436, "sim_physics": 0.1126985397744686, "survival_time": 4.699999999999991, "driven_lanedir": 0.5617249080481304, "sim_render-ego": 0.06325201278037214, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.09707754469932392, "deviation-heading": 1.5545045707526248, "set_robot_commands": 0.10087170753073184, "deviation-center-line": 0.2836026499354905, "driven_lanedir_consec": 0.5617249080481304, "sim_compute_sim_state": 0.039016995024173814, "sim_compute_performance-ego": 0.07144370484859386, "sim_compute_robot_state-ego": 0.07884643686578628}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9908332866515548, "sim_physics": 0.10950427055358888, "survival_time": 6.499999999999985, "driven_lanedir": 0.4041999584133412, "sim_render-ego": 0.06230905789595384, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.0952411596591656, "deviation-heading": 1.325073093085218, "set_robot_commands": 0.10155904293060304, "deviation-center-line": 0.2808648634491642, "driven_lanedir_consec": 0.4041999584133412, "sim_compute_sim_state": 0.03926175190852239, "sim_compute_performance-ego": 0.0691122843669011, "sim_compute_robot_state-ego": 0.07824665583097018}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.6613762245035795, "sim_physics": 0.09034170461504648, "survival_time": 4.449999999999992, "driven_lanedir": 0.589529042221375, "sim_render-ego": 0.060463760676008935, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.09269714891240838, "deviation-heading": 1.475584346008303, "set_robot_commands": 0.0929412975739897, "deviation-center-line": 0.3040873962779198, "driven_lanedir_consec": 0.589529042221375, "sim_compute_sim_state": 0.038887816868471294, "sim_compute_performance-ego": 0.06628745325495687, "sim_compute_robot_state-ego": 0.07074549760711327}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.1554407545551224, "sim_physics": 0.11947375817732378, "survival_time": 13.75000000000006, "driven_lanedir": 1.1539975823687247, "sim_render-ego": 0.06417704408819025, "in-drivable-lane": 4.250000000000035, "agent_compute-ego": 0.09463972091674804, "deviation-heading": 5.118588883094848, "set_robot_commands": 0.10068507714705034, "deviation-center-line": 0.5675354818385648, "driven_lanedir_consec": 1.0664775619530085, "sim_compute_sim_state": 0.03952970678156072, "sim_compute_performance-ego": 0.07060446305708452, "sim_compute_robot_state-ego": 0.07654200207103383}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7177187099574556, "sim_physics": 0.0942411944270134, "survival_time": 4.799999999999991, "driven_lanedir": 0.7085705270833902, "sim_render-ego": 0.0594123030702273, "in-drivable-lane": 0, "agent_compute-ego": 0.09004706641038258, "deviation-heading": 0.6597013621224311, "set_robot_commands": 0.0937082568804423, "deviation-center-line": 0.4582528529213693, "driven_lanedir_consec": 0.7085705270833902, "sim_compute_sim_state": 0.038492679595947266, "sim_compute_performance-ego": 0.06944806625445683, "sim_compute_robot_state-ego": 0.07122914244731267}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.8543082194551828, "sim_physics": 0.1000370916012114, "survival_time": 5.649999999999988, "driven_lanedir": 0.7873201916545005, "sim_render-ego": 0.06266362899172623, "in-drivable-lane": 0, "agent_compute-ego": 0.09091663993565384, "deviation-heading": 1.8185386135183776, "set_robot_commands": 0.09682793321862684, "deviation-center-line": 0.4108826929008622, "driven_lanedir_consec": 0.7873201916545005, "sim_compute_sim_state": 0.03835095346501443, "sim_compute_performance-ego": 0.07036009720996418, "sim_compute_robot_state-ego": 0.07596115728395175}}
set_robot_commands_max	0.1073690581034465
set_robot_commands_mean	0.0975743818539522
set_robot_commands_median	0.09706654946009316
set_robot_commands_min	0.0929412975739897
sim_compute_performance-ego_max	0.0759685585297734
sim_compute_performance-ego_mean	0.06978922539223156
sim_compute_performance-ego_median	0.06980665047963461
sim_compute_performance-ego_min	0.06628745325495687
sim_compute_robot_state-ego_max	0.0856525208576616
sim_compute_robot_state-ego_mean	0.07495058850188988
sim_compute_robot_state-ego_median	0.07494404157002767
sim_compute_robot_state-ego_min	0.06843279828928937
sim_compute_sim_state_max	0.04111370121140078
sim_compute_sim_state_mean	0.03894504809499162
sim_compute_sim_state_median	0.038887816868471294
sim_compute_sim_state_min	0.03809024830057164
sim_physics_max	0.1270678981145223
sim_physics_mean	0.10894972341005169
sim_physics_median	0.10950427055358888
sim_physics_min	0.09034170461504648
sim_render-ego_max	0.06768224038273456
sim_render-ego_mean	0.06223465885846605
sim_render-ego_median	0.061822633743286136
sim_render-ego_min	0.0594123030702273
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.853333333333341
survival_time_min	4.149999999999993

No reset possible

20786

2940

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 12:02:46+00:00

2019-04-27 12:05:11+00:00

0:02:25

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20769

2970

Andrea Censi 🇨🇭

minimal_agent (Python 3)

step1-simulation

host-error