Evaluator 843

2019-05-07 18:02:44+00:00

2019-05-07 18:03:16+00:00

0:00:32

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 24, in check_compatible_protocol
    raise IncompatibleProtocol(msg)
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type <class 'aido_schemas.schemas.Duckiebot1Observations'> as <class 'float'>: Type <class 'aido_schemas.schemas.Duckiebot1Observations'>
 is not a subclass of <class 'float'>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 75, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 84, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/project/src/zuper-nodes/src/zuper_nodes/compatibility.py", line 42, in check_compatible_protocol
    raise IncompatibleProtocol(msg) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
p1: |InteractionProtocol(description='Particularization for Duckiebot1 observations and commands.', inputs={'observations': <class 'aido_schemas.schemas.Duckiebot1Observations'>, 'seed': <class 'int'>, 'get_commands': <class 'NoneType'>, 'episode_start': <class 'aido_schemas.protocol_agent.EpisodeStart'>}, outputs={'commands': <class 'aido_schemas.schemas.Duckiebot1Commands'>}, language='(in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)')
p2: |InteractionProtocol(description='An estimator receives a stream of values and must predict the next value.', inputs={'observations': <class 'float'>, 'seed': <class 'int'>, 'get_prediction': <class 'NoneType'>}, outputs={'prediction': <class 'float'>}, language='(in:seed)? ; ((in:observations | (in:get_prediction ; out:prediction))*)')

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21636

3256

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

step1-simulation

success

2019-05-07 16:34:51+00:00

2019-05-07 16:52:04+00:00

0:17:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.418615133874259
survival_time_median	14.950000000000076
deviation-center-line_median	1.010751808879406
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.31021003405253095
agent_compute-ego_mean	0.27751582076355275
agent_compute-ego_median	0.27844630027639455
agent_compute-ego_min	0.2468224774419734
deviation-center-line_max	1.277314585012814
deviation-center-line_mean	0.8610551665204931
deviation-center-line_min	0.4136192046414609
deviation-heading_max	2.5895447308829618
deviation-heading_mean	1.7295417809760374
deviation-heading_median	2.0932075450998053
deviation-heading_min	0.43381447902135634
driven_any_max	2.757711634098175
driven_any_mean	2.0596706088029135
driven_any_median	2.748647715332554
driven_any_min	1.003030631690442
driven_lanedir_consec_max	2.698926831809056
driven_lanedir_consec_mean	1.9153656247087008
driven_lanedir_consec_min	0.9915976238592568
driven_lanedir_max	2.698926831809056
driven_lanedir_mean	1.9153656247087008
driven_lanedir_median	2.418615133874259
driven_lanedir_min	0.9915976238592568
in-drivable-lane_max	1.3500000000000192
in-drivable-lane_mean	0.5200000000000029
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.748647715332554, "sim_physics": 0.07574662526448568, "survival_time": 14.950000000000076, "driven_lanedir": 2.418615133874259, "sim_render-ego": 0.0422228725751241, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.2678349717458089, "deviation-heading": 2.5895447308829618, "set_robot_commands": 0.06533260663350424, "deviation-center-line": 1.010751808879406, "driven_lanedir_consec": 2.418615133874259, "sim_compute_sim_state": 0.028264850775400797, "sim_compute_performance-ego": 0.04566823959350586, "sim_compute_robot_state-ego": 0.050427107016245525}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.757711634098175, "sim_physics": 0.07268771092096965, "survival_time": 14.950000000000076, "driven_lanedir": 2.470310146953941, "sim_render-ego": 0.04211418310801189, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.2842653203010559, "deviation-heading": 2.0932075450998053, "set_robot_commands": 0.06528991222381592, "deviation-center-line": 1.277314585012814, "driven_lanedir_consec": 2.470310146953941, "sim_compute_sim_state": 0.02903992255528768, "sim_compute_performance-ego": 0.04745387633641561, "sim_compute_robot_state-ego": 0.05186001539230347}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.003030631690442, "sim_physics": 0.07592900453415592, "survival_time": 5.649999999999988, "driven_lanedir": 0.9973783870469904, "sim_render-ego": 0.04234101287031595, "in-drivable-lane": 0, "agent_compute-ego": 0.2468224774419734, "deviation-heading": 0.43381447902135634, "set_robot_commands": 0.06690074490234915, "deviation-center-line": 0.5758360507703525, "driven_lanedir_consec": 0.9973783870469904, "sim_compute_sim_state": 0.029858648249533323, "sim_compute_performance-ego": 0.046881260070125615, "sim_compute_robot_state-ego": 0.05141049359752014}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.031318568797858, "sim_physics": 0.07792328760541718, "survival_time": 5.799999999999987, "driven_lanedir": 0.9915976238592568, "sim_render-ego": 0.04240617258795377, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.27844630027639455, "deviation-heading": 1.197864443088784, "set_robot_commands": 0.06533941729315396, "deviation-center-line": 0.4136192046414609, "driven_lanedir_consec": 0.9915976238592568, "sim_compute_sim_state": 0.02904541328035552, "sim_compute_performance-ego": 0.045652757430898736, "sim_compute_robot_state-ego": 0.05015324518598359}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.757644494095537, "sim_physics": 0.0725438412030538, "survival_time": 14.950000000000076, "driven_lanedir": 2.698926831809056, "sim_render-ego": 0.04269337256749471, "in-drivable-lane": 0, "agent_compute-ego": 0.31021003405253095, "deviation-heading": 2.333277706787278, "set_robot_commands": 0.0663847533861796, "deviation-center-line": 1.0277541832984325, "driven_lanedir_consec": 2.698926831809056, "sim_compute_sim_state": 0.028943123817443846, "sim_compute_performance-ego": 0.04610728661219279, "sim_compute_robot_state-ego": 0.05004729509353638}}
set_robot_commands_max	0.06690074490234915
set_robot_commands_mean	0.06584948688780058
set_robot_commands_median	0.06533941729315396
set_robot_commands_min	0.06528991222381592
sim_compute_performance-ego_max	0.04745387633641561
sim_compute_performance-ego_mean	0.04635268400862773
sim_compute_performance-ego_median	0.04610728661219279
sim_compute_performance-ego_min	0.045652757430898736
sim_compute_robot_state-ego_max	0.05186001539230347
sim_compute_robot_state-ego_mean	0.05077963125711782
sim_compute_robot_state-ego_median	0.050427107016245525
sim_compute_robot_state-ego_min	0.05004729509353638
sim_compute_sim_state_max	0.029858648249533323
sim_compute_sim_state_mean	0.029030391735604233
sim_compute_sim_state_median	0.02903992255528768
sim_compute_sim_state_min	0.028264850775400797
sim_physics_max	0.07792328760541718
sim_physics_mean	0.07496609390561644
sim_physics_median	0.07574662526448568
sim_physics_min	0.0725438412030538
sim_render-ego_max	0.04269337256749471
sim_render-ego_mean	0.04235552274178008
sim_render-ego_median	0.04234101287031595
sim_render-ego_min	0.04211418310801189
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.260000000000042
survival_time_min	5.649999999999988

No reset possible

21626

3250

Kuan-Lin Chen 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-07 15:21:09+00:00

2019-05-07 15:21:38+00:00

0:00:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10261901947133031
error_L2	0.016692050490706937

No reset possible

21620

3244

Second test - TH-jp

step1-simulation

success

2019-05-07 14:38:38+00:00

2019-05-07 14:50:05+00:00

0:11:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1017791781516908
survival_time_median	14.950000000000076
deviation-center-line_median	0.5600329151300182
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09648509740829468
agent_compute-ego_mean	0.09557381320174088
agent_compute-ego_median	0.09598321481184524
agent_compute-ego_min	0.09401215630016108
deviation-center-line_max	1.0058316156344536
deviation-center-line_mean	0.585960599552088
deviation-center-line_min	0.32037356963980534
deviation-heading_max	2.538127033152034
deviation-heading_mean	2.1197651033781035
deviation-heading_median	2.0998979100231123
deviation-heading_min	1.7090764965907583
driven_any_max	2.9970783255399027
driven_any_mean	1.495753592459728
driven_any_median	1.2525846138634489
driven_any_min	0.589387252561687
driven_lanedir_consec_max	2.8150798375931956
driven_lanedir_consec_mean	1.17957651634551
driven_lanedir_consec_min	0.274996421594105
driven_lanedir_max	2.8150798375931956
driven_lanedir_mean	1.17957651634551
driven_lanedir_median	1.1017791781516908
driven_lanedir_min	0.274996421594105
in-drivable-lane_max	9.150000000000093
in-drivable-lane_mean	1.860000000000018
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.589387252561687, "sim_physics": 0.05836537751284512, "survival_time": 5.4999999999999885, "driven_lanedir": 0.4718733328879434, "sim_render-ego": 0.03608284863558683, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09598321481184524, "deviation-heading": 1.8475966887163395, "set_robot_commands": 0.05574651414697821, "deviation-center-line": 0.32037356963980534, "driven_lanedir_consec": 0.4718733328879434, "sim_compute_sim_state": 0.023204562880776144, "sim_compute_performance-ego": 0.039072478901256216, "sim_compute_robot_state-ego": 0.04080962051044811}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9357556450107442, "sim_physics": 0.05743742068608602, "survival_time": 14.950000000000076, "driven_lanedir": 0.274996421594105, "sim_render-ego": 0.03585672537485758, "in-drivable-lane": 0, "agent_compute-ego": 0.0950563144683838, "deviation-heading": 2.0998979100231123, "set_robot_commands": 0.0537367041905721, "deviation-center-line": 0.5600329151300182, "driven_lanedir_consec": 0.274996421594105, "sim_compute_sim_state": 0.022988804976145423, "sim_compute_performance-ego": 0.03838247617085775, "sim_compute_robot_state-ego": 0.04051965872446696}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9970783255399027, "sim_physics": 0.05582435131072998, "survival_time": 14.950000000000076, "driven_lanedir": 2.8150798375931956, "sim_render-ego": 0.036979688008626305, "in-drivable-lane": 0, "agent_compute-ego": 0.09633228302001952, "deviation-heading": 2.404127388408273, "set_robot_commands": 0.054097998142242434, "deviation-center-line": 1.0058316156344536, "driven_lanedir_consec": 2.8150798375931956, "sim_compute_sim_state": 0.023155426184336345, "sim_compute_performance-ego": 0.03881269057591756, "sim_compute_robot_state-ego": 0.041871798833211266}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2525846138634489, "sim_physics": 0.05826730152656292, "survival_time": 8.699999999999989, "driven_lanedir": 1.1017791781516908, "sim_render-ego": 0.03601327298701495, "in-drivable-lane": 0, "agent_compute-ego": 0.09401215630016108, "deviation-heading": 1.7090764965907583, "set_robot_commands": 0.05599636044995538, "deviation-center-line": 0.617296874178294, "driven_lanedir_consec": 1.1017791781516908, "sim_compute_sim_state": 0.022987334207556713, "sim_compute_performance-ego": 0.038401176189554145, "sim_compute_robot_state-ego": 0.04048961332474632}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7039621253228574, "sim_physics": 0.05381633202234904, "survival_time": 14.950000000000076, "driven_lanedir": 1.234153811500614, "sim_render-ego": 0.03530439853668213, "in-drivable-lane": 9.150000000000093, "agent_compute-ego": 0.09648509740829468, "deviation-heading": 2.538127033152034, "set_robot_commands": 0.05348788738250732, "deviation-center-line": 0.4262680231778686, "driven_lanedir_consec": 1.234153811500614, "sim_compute_sim_state": 0.0232104762395223, "sim_compute_performance-ego": 0.03852075576782227, "sim_compute_robot_state-ego": 0.04061421235402425}}
set_robot_commands_max	0.05599636044995538
set_robot_commands_mean	0.054613092862451085
set_robot_commands_median	0.054097998142242434
set_robot_commands_min	0.05348788738250732
sim_compute_performance-ego_max	0.039072478901256216
sim_compute_performance-ego_mean	0.03863791552108159
sim_compute_performance-ego_median	0.03852075576782227
sim_compute_performance-ego_min	0.03838247617085775
sim_compute_robot_state-ego_max	0.041871798833211266
sim_compute_robot_state-ego_mean	0.04086098074937938
sim_compute_robot_state-ego_median	0.04061421235402425
sim_compute_robot_state-ego_min	0.04048961332474632
sim_compute_sim_state_max	0.0232104762395223
sim_compute_sim_state_mean	0.023109320897667384
sim_compute_sim_state_median	0.023155426184336345
sim_compute_sim_state_min	0.022987334207556713
sim_physics_max	0.05836537751284512
sim_physics_mean	0.056742156611714625
sim_physics_median	0.05743742068608602
sim_physics_min	0.05381633202234904
sim_render-ego_max	0.036979688008626305
sim_render-ego_mean	0.03604738670855356
sim_render-ego_median	0.03601327298701495
sim_render-ego_min	0.03530439853668213
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.81000000000004
survival_time_min	5.4999999999999885

No reset possible

21606

3233

First test - TH -hhk

step1-simulation

error

2019-05-07 08:28:34+00:00

2019-05-07 08:30:03+00:00

0:01:29

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21551

3221

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-05-06 12:07:38+00:00

2019-05-06 12:14:10+00:00

0:06:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.1159718944912865
agent_compute-ego_mean	0.1101103996047799
agent_compute-ego_median	0.11183050312573396
agent_compute-ego_min	0.09803155490330288
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.13669356213340275, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.04524037506006941, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11183050312573396, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.06954663312887843, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.02826837044727953, "sim_compute_performance-ego": 0.04776420472543451, "sim_compute_robot_state-ego": 0.048844829390320595, "sim_compute_robot_state-npc0": 0.04904306085803841, "sim_compute_robot_state-npc1": 0.04988354972646206, "sim_compute_robot_state-npc2": 0.050763809228245214, "sim_compute_robot_state-npc3": 0.04965142358707477}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1338417444910322, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.03856054374149868, "in-drivable-lane": 0, "agent_compute-ego": 0.09803155490330288, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.05854271139417376, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.02575107983180455, "sim_compute_performance-ego": 0.03988763264247349, "sim_compute_robot_state-ego": 0.04492450611931937, "sim_compute_robot_state-npc0": 0.04469449179513114, "sim_compute_robot_state-npc1": 0.04494030135018485, "sim_compute_robot_state-npc2": 0.04435397045952933, "sim_compute_robot_state-npc3": 0.044241692338671}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.13111783231346352, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.04352506619055294, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.11519123744038702, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0689417135368273, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.030369483151482145, "sim_compute_performance-ego": 0.046523758508626695, "sim_compute_robot_state-ego": 0.047826586417781494, "sim_compute_robot_state-npc0": 0.051551179978453994, "sim_compute_robot_state-npc1": 0.05316088037583434, "sim_compute_robot_state-npc2": 0.05007771149422358, "sim_compute_robot_state-npc3": 0.05220345617498009}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.13347900410493216, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.042379086216290794, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1095268080631892, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.06652078529198964, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.027715663115183514, "sim_compute_performance-ego": 0.04582904279232025, "sim_compute_robot_state-ego": 0.04705046117305755, "sim_compute_robot_state-npc0": 0.04891756673653921, "sim_compute_robot_state-npc1": 0.048488885164260864, "sim_compute_robot_state-npc2": 0.04783230026563009, "sim_compute_robot_state-npc3": 0.049160162607828774}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.15112883704049246, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04412417184738886, "in-drivable-lane": 0, "agent_compute-ego": 0.1159718944912865, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.06782811028616768, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02815608751206171, "sim_compute_performance-ego": 0.049049388794671925, "sim_compute_robot_state-ego": 0.05270880744570777, "sim_compute_robot_state-npc0": 0.052201123464675175, "sim_compute_robot_state-npc1": 0.050673053378150576, "sim_compute_robot_state-npc2": 0.053354683376493905, "sim_compute_robot_state-npc3": 0.0502746445792062}}
set_robot_commands_max	0.06954663312887843
set_robot_commands_mean	0.06627599072760737
set_robot_commands_median	0.06782811028616768
set_robot_commands_min	0.05854271139417376
sim_compute_performance-ego_max	0.049049388794671925
sim_compute_performance-ego_mean	0.04581080549270537
sim_compute_performance-ego_median	0.046523758508626695
sim_compute_performance-ego_min	0.03988763264247349
sim_compute_robot_state-ego_max	0.05270880744570777
sim_compute_robot_state-ego_mean	0.04827103810923736
sim_compute_robot_state-ego_median	0.047826586417781494
sim_compute_robot_state-ego_min	0.04492450611931937
sim_compute_robot_state-npc0_max	0.052201123464675175
sim_compute_robot_state-npc0_mean	0.049281484566567585
sim_compute_robot_state-npc0_median	0.04904306085803841
sim_compute_robot_state-npc0_min	0.04469449179513114
sim_compute_robot_state-npc1_max	0.05316088037583434
sim_compute_robot_state-npc1_mean	0.049429333998978545
sim_compute_robot_state-npc1_median	0.04988354972646206
sim_compute_robot_state-npc1_min	0.04494030135018485
sim_compute_robot_state-npc2_max	0.053354683376493905
sim_compute_robot_state-npc2_mean	0.049276494964824426
sim_compute_robot_state-npc2_median	0.05007771149422358
sim_compute_robot_state-npc2_min	0.04435397045952933
sim_compute_robot_state-npc3_max	0.05220345617498009
sim_compute_robot_state-npc3_mean	0.04910627585755216
sim_compute_robot_state-npc3_median	0.04965142358707477
sim_compute_robot_state-npc3_min	0.044241692338671
sim_compute_sim_state_max	0.030369483151482145
sim_compute_sim_state_mean	0.028052136811562288
sim_compute_sim_state_median	0.02815608751206171
sim_compute_sim_state_min	0.02575107983180455
sim_physics_max	0.15112883704049246
sim_physics_mean	0.1372521960166646
sim_physics_median	0.1338417444910322
sim_physics_min	0.13111783231346352
sim_render-ego_max	0.04524037506006941
sim_render-ego_mean	0.04276584861116014
sim_render-ego_median	0.04352506619055294
sim_render-ego_min	0.03856054374149868
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21516

3204

Masaya Kambara 🇯🇵

challenge-aido_LF-template-random

step1-simulation

aborted

2019-05-06 04:42:21+00:00

2019-05-06 04:51:37+00:00

0:09:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.09221146583557129
agent_compute-ego_mean	0.08695002049202444
agent_compute-ego_median	0.08666832972381075
agent_compute-ego_min	0.08543548129853748
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0562919643190172, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03576353302708379, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0873586513378002, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05565136891824228, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02324948928974293, "sim_compute_performance-ego": 0.038613712346112286, "sim_compute_robot_state-ego": 0.04044482443067762}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.055216709772745766, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.035276085722680185, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08720516223533481, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.05454588871376187, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.022820528815774357, "sim_compute_performance-ego": 0.03866258789511288, "sim_compute_robot_state-ego": 0.03989192083770154}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.058017702663646024, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03560301836799173, "in-drivable-lane": 0, "agent_compute-ego": 0.0855247132918414, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0541541716631721, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02294363695032456, "sim_compute_performance-ego": 0.03885242518256692, "sim_compute_robot_state-ego": 0.041582191691679114}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06017354011535645, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03607560157775879, "in-drivable-lane": 0, "agent_compute-ego": 0.09221146583557129, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05516352653503418, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.023871803283691408, "sim_compute_performance-ego": 0.03847563743591308, "sim_compute_robot_state-ego": 0.040407142639160155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05762075472481643, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03736827645120742, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08607878564279291, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.055200718626191345, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0231644050984443, "sim_compute_performance-ego": 0.038485877121551125, "sim_compute_robot_state-ego": 0.041173648230637176}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.057562759944370816, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03561235933887715, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08600803783961705, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.05455381529671805, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.022823645144092793, "sim_compute_performance-ego": 0.03837967405513841, "sim_compute_robot_state-ego": 0.04054248576261559}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.06839186378887721, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.035833384309496195, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.08620744092123848, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.05443415471485683, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.02292401875768389, "sim_compute_performance-ego": 0.039478378636496406, "sim_compute_robot_state-ego": 0.04089014870779855}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.06069724900381906, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.03552166620890299, "in-drivable-lane": 0, "agent_compute-ego": 0.08543548129853748, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.05467725935436431, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.02366441772097633, "sim_compute_performance-ego": 0.03834164710271926, "sim_compute_robot_state-ego": 0.04075930232093448}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.06055791499251026, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.036903175257020075, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08666832972381075, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.05723733821157682, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.02307045257697671, "sim_compute_performance-ego": 0.038906590413239045, "sim_compute_robot_state-ego": 0.040553889032137594}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.05550542311234908, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.03656248612837358, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.08761168826710095, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.05529815066944469, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.023029973290183327, "sim_compute_performance-ego": 0.039250850677490234, "sim_compute_robot_state-ego": 0.04100901863791726}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.05743034783895914, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.03658154413297579, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0874393048224511, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.05697109172870586, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.023078587148096658, "sim_compute_performance-ego": 0.038688281913856405, "sim_compute_robot_state-ego": 0.04058802282655394}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.059261611529759, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.03650262526103428, "in-drivable-lane": 0, "agent_compute-ego": 0.08748254605701991, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.054662849221910746, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.022883687700544084, "sim_compute_performance-ego": 0.04004863330296108, "sim_compute_robot_state-ego": 0.04097425937652588}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.05595496121574851, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03541877222996132, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08636931344574574, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.054521429772470514, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.023319146212409523, "sim_compute_performance-ego": 0.03865527639202043, "sim_compute_robot_state-ego": 0.04051814827264524}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.05888566264399776, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0354360474480523, "in-drivable-lane": 0, "agent_compute-ego": 0.08594499693976508, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.0545347531636556, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.023346556557549372, "sim_compute_performance-ego": 0.03822974805478697, "sim_compute_robot_state-ego": 0.04038199671992549}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05812416357152602, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03642749552633248, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08670438972173952, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.05463856108048383, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02318288531957888, "sim_compute_performance-ego": 0.03904271593280867, "sim_compute_robot_state-ego": 0.04076913992563883}}
set_robot_commands_max	0.05723733821157682
set_robot_commands_mean	0.055083005178039275
set_robot_commands_median	0.054662849221910746
set_robot_commands_min	0.0541541716631721
sim_compute_performance-ego_max	0.04004863330296108
sim_compute_performance-ego_mean	0.03880746909751821
sim_compute_performance-ego_median	0.03866258789511288
sim_compute_performance-ego_min	0.03822974805478697
sim_compute_robot_state-ego_max	0.041582191691679114
sim_compute_robot_state-ego_mean	0.04069907596083656
sim_compute_robot_state-ego_median	0.04058802282655394
sim_compute_robot_state-ego_min	0.03989192083770154
sim_compute_sim_state_max	0.023871803283691408
sim_compute_sim_state_mean	0.02315821559107128
sim_compute_sim_state_median	0.023078587148096658
sim_compute_sim_state_min	0.022820528815774357
sim_physics_max	0.06839186378887721
sim_physics_mean	0.058646175282499914
sim_physics_median	0.058017702663646024
sim_physics_min	0.055216709772745766
sim_render-ego_max	0.03736827645120742
sim_render-ego_mean	0.036059071399183205
sim_render-ego_median	0.035833384309496195
sim_render-ego_min	0.035276085722680185
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21497

3189

First test - TH

step1-simulation

success

2019-05-05 13:40:42+00:00

2019-05-05 13:55:25+00:00

0:14:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.014218708590877
survival_time_median	14.950000000000076
deviation-center-line_median	1.214024682700227
in-drivable-lane_median	0.8500000000000121

other stats

agent_compute-ego_max	0.12803800106048585
agent_compute-ego_mean	0.10375435622533162
agent_compute-ego_median	0.09745416720708212
agent_compute-ego_min	0.09693927526474
deviation-center-line_max	1.9756515234335512
deviation-center-line_mean	1.3615817206056693
deviation-center-line_min	1.1177610347290754
deviation-heading_max	12.182267774911509
deviation-heading_mean	6.152146460415496
deviation-heading_median	3.6086193485712177
deviation-heading_min	3.233089649057491
driven_any_max	3.6064495544271553
driven_any_mean	2.7931367776812435
driven_any_median	3.206619244387382
driven_any_min	0.6159262114551919
driven_lanedir_consec_max	3.0597781770717978
driven_lanedir_consec_mean	2.4453627571253405
driven_lanedir_consec_min	0.6089540376857013
driven_lanedir_max	3.0597781770717978
driven_lanedir_mean	2.4453627571253405
driven_lanedir_median	3.014218708590877
driven_lanedir_min	0.6089540376857013
in-drivable-lane_max	1.8000000000000256
in-drivable-lane_mean	0.7100000000000071
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.451037953089127, "sim_physics": 0.07866566419601441, "survival_time": 14.950000000000076, "driven_lanedir": 2.5118982431227024, "sim_render-ego": 0.0471296755472819, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.12803800106048585, "deviation-heading": 3.372200315130104, "set_robot_commands": 0.070015230178833, "deviation-center-line": 1.1536826735788988, "driven_lanedir_consec": 2.5118982431227024, "sim_compute_sim_state": 0.030202271938323973, "sim_compute_performance-ego": 0.050849910577138266, "sim_compute_robot_state-ego": 0.05144738038380941}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6159262114551919, "sim_physics": 0.058075406551361085, "survival_time": 14.950000000000076, "driven_lanedir": 0.6089540376857013, "sim_render-ego": 0.03629557371139527, "in-drivable-lane": 0, "agent_compute-ego": 0.0991200304031372, "deviation-heading": 12.182267774911509, "set_robot_commands": 0.05600629488627116, "deviation-center-line": 1.9756515234335512, "driven_lanedir_consec": 0.6089540376857013, "sim_compute_sim_state": 0.023963724772135417, "sim_compute_performance-ego": 0.03958184083302816, "sim_compute_robot_state-ego": 0.042726693153381345}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.0856509250473607, "sim_physics": 0.05659327189127604, "survival_time": 14.950000000000076, "driven_lanedir": 3.0319646191556227, "sim_render-ego": 0.03599618434906006, "in-drivable-lane": 0, "agent_compute-ego": 0.09693927526474, "deviation-heading": 8.364555214407158, "set_robot_commands": 0.05463001171747844, "deviation-center-line": 1.1177610347290754, "driven_lanedir_consec": 3.0319646191556227, "sim_compute_sim_state": 0.02314199527104696, "sim_compute_performance-ego": 0.03916552941004435, "sim_compute_robot_state-ego": 0.04008853673934937}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.6064495544271553, "sim_physics": 0.056713555653889976, "survival_time": 14.950000000000076, "driven_lanedir": 3.0597781770717978, "sim_render-ego": 0.03603833198547363, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.09722030719121295, "deviation-heading": 3.6086193485712177, "set_robot_commands": 0.054321135679880776, "deviation-center-line": 1.214024682700227, "driven_lanedir_consec": 3.0597781770717978, "sim_compute_sim_state": 0.02305919885635376, "sim_compute_performance-ego": 0.039697093963623045, "sim_compute_robot_state-ego": 0.0397349468866984}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.206619244387382, "sim_physics": 0.05772544463475545, "survival_time": 14.950000000000076, "driven_lanedir": 3.014218708590877, "sim_render-ego": 0.0357776419321696, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.09745416720708212, "deviation-heading": 3.233089649057491, "set_robot_commands": 0.05408940156300863, "deviation-center-line": 1.346788688586594, "driven_lanedir_consec": 3.014218708590877, "sim_compute_sim_state": 0.02323572079340617, "sim_compute_performance-ego": 0.03867722193400065, "sim_compute_robot_state-ego": 0.039987936814626056}}
set_robot_commands_max	0.070015230178833
set_robot_commands_mean	0.0578124148050944
set_robot_commands_median	0.05463001171747844
set_robot_commands_min	0.05408940156300863
sim_compute_performance-ego_max	0.050849910577138266
sim_compute_performance-ego_mean	0.04159431934356689
sim_compute_performance-ego_median	0.03958184083302816
sim_compute_performance-ego_min	0.03867722193400065
sim_compute_robot_state-ego_max	0.05144738038380941
sim_compute_robot_state-ego_mean	0.04279709879557292
sim_compute_robot_state-ego_median	0.04008853673934937
sim_compute_robot_state-ego_min	0.0397349468866984
sim_compute_sim_state_max	0.030202271938323973
sim_compute_sim_state_mean	0.024720582326253255
sim_compute_sim_state_median	0.02323572079340617
sim_compute_sim_state_min	0.02305919885635376
sim_physics_max	0.07866566419601441
sim_physics_mean	0.06155466858545938
sim_physics_median	0.05772544463475545
sim_physics_min	0.05659327189127604
sim_render-ego_max	0.0471296755472819
sim_render-ego_mean	0.03824748150507609
sim_render-ego_median	0.03603833198547363
sim_render-ego_min	0.0357776419321696
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21411

3116

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-29 05:50:51+00:00

2019-04-29 06:00:08+00:00

0:09:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3116/step1-simulation-ip-172-31-42-167-7357-job21411/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21403

2410

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 05:00:28+00:00

2019-04-28 05:58:12+00:00

0:57:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-1.355676207214709
survival_time_median	14.950000000000076
deviation-center-line_median	1.002134440312669
in-drivable-lane_median	4.050000000000024

other stats

agent_compute-ego_max	0.0955276370048523
agent_compute-ego_mean	0.09445809634526572
agent_compute-ego_median	0.09444457213083902
agent_compute-ego_min	0.09346494356791178
deviation-center-line_max	1.5296442653166566
deviation-center-line_mean	0.8536767524476552
deviation-center-line_min	0.2656525762859935
deviation-heading_max	8.682256325592228
deviation-heading_mean	6.927230740477735
deviation-heading_median	7.090641611385013
deviation-heading_min	5.52174661383955
driven_any_max	4.378506444052824
driven_any_mean	4.378506444052809
driven_any_median	4.378506444052808
driven_any_min	4.378506444052796
driven_lanedir_consec_max	-1.2728379671211965
driven_lanedir_consec_mean	-1.352643582087815
driven_lanedir_consec_min	-1.388190292394527
driven_lanedir_max	-1.3477913186786226
driven_lanedir_mean	-2.005867861365606
driven_lanedir_median	-2.260637650975249
driven_lanedir_min	-2.7253255736285684
in-drivable-lane_max	7.60000000000004
in-drivable-lane_mean	4.9200000000000275
in-drivable-lane_min	2.100000000000011
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.09122009913126627, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.03631322940190633, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.0955276370048523, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.05523066600163778, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.022730733553568524, "sim_compute_performance-ego": 0.03872823238372803, "sim_compute_robot_state-ego": 0.04056239366531372, "sim_compute_robot_state-npc0": 0.04059567292531331, "sim_compute_robot_state-npc1": 0.03972894112269083, "sim_compute_robot_state-npc2": 0.03956274429957072, "sim_compute_robot_state-npc3": 0.03956585566202799}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052822, "sim_physics": 0.08879700899124146, "survival_time": 14.950000000000076, "driven_lanedir": -2.686350659544358, "sim_render-ego": 0.03604775746663411, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09471882979075114, "deviation-heading": 8.558153948461722, "set_robot_commands": 0.054464730421702065, "deviation-center-line": 1.5296442653166566, "driven_lanedir_consec": -1.2728379671211965, "sim_compute_sim_state": 0.02269486824671427, "sim_compute_performance-ego": 0.038694469928741454, "sim_compute_robot_state-ego": 0.04068134228388468, "sim_compute_robot_state-npc0": 0.040321497122446696, "sim_compute_robot_state-npc1": 0.04003631750742594, "sim_compute_robot_state-npc2": 0.039473456541697184, "sim_compute_robot_state-npc3": 0.03964911301930745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.378506444052811, "sim_physics": 0.09250166336695352, "survival_time": 14.950000000000076, "driven_lanedir": -1.3662544443440128, "sim_render-ego": 0.036136234601338704, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09472435315450033, "deviation-heading": 5.773684892471282, "set_robot_commands": 0.05455291748046875, "deviation-center-line": 0.2929285686140787, "driven_lanedir_consec": -1.3662544443440128, "sim_compute_sim_state": 0.024064414501190182, "sim_compute_performance-ego": 0.03867609739303589, "sim_compute_robot_state-ego": 0.04064634005228678, "sim_compute_robot_state-npc0": 0.04046774625778198, "sim_compute_robot_state-npc1": 0.03961586316426595, "sim_compute_robot_state-npc2": 0.04046960433324178, "sim_compute_robot_state-npc3": 0.03964637756347656}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052824, "sim_physics": 0.09234817028045654, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670015115194478, "sim_render-ego": 0.036306073665618895, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.09444457213083902, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.054590477148691814, "deviation-center-line": 0.28261955257418875, "driven_lanedir_consec": -1.3670015115194478, "sim_compute_sim_state": 0.0228649894396464, "sim_compute_performance-ego": 0.038926382859547935, "sim_compute_robot_state-ego": 0.04072261571884155, "sim_compute_robot_state-npc0": 0.04191320339838664, "sim_compute_robot_state-npc1": 0.03982582728068034, "sim_compute_robot_state-npc2": 0.03963820139567057, "sim_compute_robot_state-npc3": 0.039785698254903155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.37850644405281, "sim_physics": 0.09334729115168254, "survival_time": 14.950000000000076, "driven_lanedir": -2.260637650975249, "sim_render-ego": 0.03639143228530884, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.09522622664769492, "deviation-heading": 7.090641611385013, "set_robot_commands": 0.05609631697336832, "deviation-center-line": 1.002134440312669, "driven_lanedir_consec": -1.339793520141566, "sim_compute_sim_state": 0.02270004590352376, "sim_compute_performance-ego": 0.038666296005249026, "sim_compute_robot_state-ego": 0.04057096004486084, "sim_compute_robot_state-npc0": 0.040519961516062415, "sim_compute_robot_state-npc1": 0.03981616655985514, "sim_compute_robot_state-npc2": 0.03971685489018758, "sim_compute_robot_state-npc3": 0.039786758422851565}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 4.378506444052811, "sim_physics": 0.09305345217386882, "survival_time": 14.950000000000076, "driven_lanedir": -2.608509993180694, "sim_render-ego": 0.037444795767466225, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.09501384973526, "deviation-heading": 8.07296329712472, "set_robot_commands": 0.05465654293696086, "deviation-center-line": 1.3867682469030311, "driven_lanedir_consec": -1.388190292394527, "sim_compute_sim_state": 0.022877385616302492, "sim_compute_performance-ego": 0.039028578599294025, "sim_compute_robot_state-ego": 0.04074295043945313, "sim_compute_robot_state-npc0": 0.04047558148701986, "sim_compute_robot_state-npc1": 0.040196531613667805, "sim_compute_robot_state-npc2": 0.03963710069656372, "sim_compute_robot_state-npc3": 0.03993384758631388}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 4.378506444052805, "sim_physics": 0.0885393738746643, "survival_time": 14.950000000000076, "driven_lanedir": -1.355676207214709, "sim_render-ego": 0.03579576412836711, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.094808988571167, "deviation-heading": 5.863437531793397, "set_robot_commands": 0.05434913953145345, "deviation-center-line": 0.2923561535172491, "driven_lanedir_consec": -1.355676207214709, "sim_compute_sim_state": 0.02414363225301107, "sim_compute_performance-ego": 0.03850113312403361, "sim_compute_robot_state-ego": 0.04038920323053996, "sim_compute_robot_state-npc0": 0.040241539478302, "sim_compute_robot_state-npc1": 0.039686381816864014, "sim_compute_robot_state-npc2": 0.03954297542572022, "sim_compute_robot_state-npc3": 0.03956587870915731}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 4.378506444052796, "sim_physics": 0.08920387506484985, "survival_time": 14.950000000000076, "driven_lanedir": -1.377653082196022, "sim_render-ego": 0.035627570947011314, "in-drivable-lane": 7.30000000000004, "agent_compute-ego": 0.09380549669265748, "deviation-heading": 5.826000672384985, "set_robot_commands": 0.0552062201499939, "deviation-center-line": 0.28890677730047676, "driven_lanedir_consec": -1.377653082196022, "sim_compute_sim_state": 0.0226928448677063, "sim_compute_performance-ego": 0.03833829323450724, "sim_compute_robot_state-ego": 0.04029395341873169, "sim_compute_robot_state-npc0": 0.04001023292541504, "sim_compute_robot_state-npc1": 0.03974134604136149, "sim_compute_robot_state-npc2": 0.03934278964996338, "sim_compute_robot_state-npc3": 0.03945903380711873}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 4.378506444052807, "sim_physics": 0.08555604060490926, "survival_time": 14.950000000000076, "driven_lanedir": -2.4543552110962836, "sim_render-ego": 0.03568967580795288, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.09368824164072671, "deviation-heading": 7.285030095349859, "set_robot_commands": 0.05529999494552612, "deviation-center-line": 1.16426495230065, "driven_lanedir_consec": -1.3837301815284158, "sim_compute_sim_state": 0.02238229751586914, "sim_compute_performance-ego": 0.03822850624720255, "sim_compute_robot_state-ego": 0.040371359984079994, "sim_compute_robot_state-npc0": 0.03998291810353597, "sim_compute_robot_state-npc1": 0.03932715574900309, "sim_compute_robot_state-npc2": 0.038937740325927735, "sim_compute_robot_state-npc3": 0.03968732515970866}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 4.378506444052819, "sim_physics": 0.09158688386281331, "survival_time": 14.950000000000076, "driven_lanedir": -2.59861542380514, "sim_render-ego": 0.035548725922902424, "in-drivable-lane": 2.250000000000013, "agent_compute-ego": 0.0941602357228597, "deviation-heading": 8.682256325592228, "set_robot_commands": 0.05429823319117228, "deviation-center-line": 1.4641409944409558, "driven_lanedir_consec": -1.339457603752913, "sim_compute_sim_state": 0.02232444763183594, "sim_compute_performance-ego": 0.038147946198781334, "sim_compute_robot_state-ego": 0.041244099934895834, "sim_compute_robot_state-npc0": 0.04013369083404541, "sim_compute_robot_state-npc1": 0.03918069839477539, "sim_compute_robot_state-npc2": 0.03902174393335978, "sim_compute_robot_state-npc3": 0.039298442204793296}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 4.378506444052819, "sim_physics": 0.08755947987238566, "survival_time": 14.950000000000076, "driven_lanedir": -2.487619304575852, "sim_render-ego": 0.035784616470336914, "in-drivable-lane": 3.150000000000018, "agent_compute-ego": 0.0952795656522115, "deviation-heading": 7.680289782334559, "set_robot_commands": 0.05559024890263875, "deviation-center-line": 1.2605671921446628, "driven_lanedir_consec": -1.333456085292506, "sim_compute_sim_state": 0.02234350840250651, "sim_compute_performance-ego": 0.03815324306488037, "sim_compute_robot_state-ego": 0.04015722433725993, "sim_compute_robot_state-npc0": 0.03995945612589518, "sim_compute_robot_state-npc1": 0.03920641819636027, "sim_compute_robot_state-npc2": 0.039130895137786864, "sim_compute_robot_state-npc3": 0.03912423928578695}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 4.378506444052808, "sim_physics": 0.0850731102625529, "survival_time": 14.950000000000076, "driven_lanedir": -1.3477913186786226, "sim_render-ego": 0.03593200922012329, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.09410636266072592, "deviation-heading": 5.52174661383955, "set_robot_commands": 0.05374397198359172, "deviation-center-line": 0.26627156834437943, "driven_lanedir_consec": -1.3477913186786226, "sim_compute_sim_state": 0.022444318930308023, "sim_compute_performance-ego": 0.038118921120961505, "sim_compute_robot_state-ego": 0.03983924547831218, "sim_compute_robot_state-npc0": 0.03983984470367432, "sim_compute_robot_state-npc1": 0.039255345662434896, "sim_compute_robot_state-npc2": 0.03893729368845622, "sim_compute_robot_state-npc3": 0.039294924736022946}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 4.378506444052802, "sim_physics": 0.08833346128463745, "survival_time": 14.950000000000076, "driven_lanedir": -2.7253255736285684, "sim_render-ego": 0.03590248823165894, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.09399883429209392, "deviation-heading": 8.383960965716458, "set_robot_commands": 0.05501988093058268, "deviation-center-line": 1.5198553376845148, "driven_lanedir_consec": -1.3654612749893655, "sim_compute_sim_state": 0.022477326393127443, "sim_compute_performance-ego": 0.03824900468190511, "sim_compute_robot_state-ego": 0.03995508829752604, "sim_compute_robot_state-npc0": 0.04003920555114746, "sim_compute_robot_state-npc1": 0.039584095478057864, "sim_compute_robot_state-npc2": 0.039158971309661866, "sim_compute_robot_state-npc3": 0.039367383321126305}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 4.378506444052804, "sim_physics": 0.09070298671722413, "survival_time": 14.950000000000076, "driven_lanedir": -1.3543489995592757, "sim_render-ego": 0.035790783564249674, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.09346494356791178, "deviation-heading": 5.531556420749436, "set_robot_commands": 0.053761499722798665, "deviation-center-line": 0.2656525762859935, "driven_lanedir_consec": -1.3543489995592757, "sim_compute_sim_state": 0.02229602336883545, "sim_compute_performance-ego": 0.03827395995457967, "sim_compute_robot_state-ego": 0.04010551373163859, "sim_compute_robot_state-npc0": 0.04020915985107422, "sim_compute_robot_state-npc1": 0.03933428525924683, "sim_compute_robot_state-npc2": 0.03902140855789184, "sim_compute_robot_state-npc3": 0.0393457571665446}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 4.378506444052808, "sim_physics": 0.0893623121579488, "survival_time": 14.950000000000076, "driven_lanedir": -1.3871236758121115, "sim_render-ego": 0.03568454424540202, "in-drivable-lane": 7.450000000000041, "agent_compute-ego": 0.09390330791473388, "deviation-heading": 5.569918191698341, "set_robot_commands": 0.055079286893208824, "deviation-center-line": 0.26950853351829485, "driven_lanedir_consec": -1.3871236758121115, "sim_compute_sim_state": 0.022280762195587157, "sim_compute_performance-ego": 0.03823049386342366, "sim_compute_robot_state-ego": 0.040054221153259274, "sim_compute_robot_state-npc0": 0.039991549650828045, "sim_compute_robot_state-npc1": 0.03904835462570191, "sim_compute_robot_state-npc2": 0.0388656489054362, "sim_compute_robot_state-npc3": 0.039098472595214845}}
set_robot_commands_max	0.05609631697336832
set_robot_commands_mean	0.05479600848091973
set_robot_commands_median	0.05465654293696086
set_robot_commands_min	0.05374397198359172
sim_compute_performance-ego_max	0.039028578599294025
sim_compute_performance-ego_mean	0.0384641039106581
sim_compute_performance-ego_median	0.03833829323450724
sim_compute_performance-ego_min	0.038118921120961505
sim_compute_robot_state-ego_max	0.041244099934895834
sim_compute_robot_state-ego_mean	0.040422434118058945
sim_compute_robot_state-ego_median	0.04038920323053996
sim_compute_robot_state-ego_min	0.03983924547831218
sim_compute_robot_state-npc0_max	0.04191320339838664
sim_compute_robot_state-npc0_mean	0.040313417328728576
sim_compute_robot_state-npc0_median	0.04020915985107422
sim_compute_robot_state-npc0_min	0.03983984470367432
sim_compute_robot_state-npc1_max	0.040196531613667805
sim_compute_robot_state-npc1_mean	0.03957224856482612
sim_compute_robot_state-npc1_median	0.03961586316426595
sim_compute_robot_state-npc1_min	0.03904835462570191
sim_compute_robot_state-npc2_max	0.04046960433324178
sim_compute_robot_state-npc2_mean	0.0393638286060757
sim_compute_robot_state-npc2_median	0.03934278964996338
sim_compute_robot_state-npc2_min	0.0388656489054362
sim_compute_robot_state-npc3_max	0.03993384758631388
sim_compute_robot_state-npc3_mean	0.03950727383295696
sim_compute_robot_state-npc3_median	0.03956585566202799
sim_compute_robot_state-npc3_min	0.039098472595214845
sim_compute_sim_state_max	0.02414363225301107
sim_compute_sim_state_mean	0.022754506587982178
sim_compute_sim_state_median	0.0226928448677063
sim_compute_sim_state_min	0.022280762195587157
sim_physics_max	0.09334729115168254
sim_physics_mean	0.08981234725316364
sim_physics_median	0.0893623121579488
sim_physics_min	0.0850731102625529
sim_render-ego_max	0.037444795767466225
sim_render-ego_mean	0.03602638011508518
sim_render-ego_median	0.03590248823165894
sim_render-ego_min	0.035548725922902424
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21398

2412

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 04:00:39+00:00

2019-04-28 05:00:09+00:00

0:59:30

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-42-167-7357-job21398/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21392

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 03:00:27+00:00

2019-04-28 04:00:02+00:00

0:59:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-42-167-7357-job21392/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21383

2373

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-28 02:00:20+00:00

2019-04-28 02:43:12+00:00

0:42:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.637258234942822
survival_time_median	7.199999999999982
deviation-center-line_median	0.41059891008830585
in-drivable-lane_median	1.699999999999994

other stats

agent_compute-ego_max	0.15594795530876226
agent_compute-ego_mean	0.11089440535044356
agent_compute-ego_median	0.1091697613398234
agent_compute-ego_min	0.08716986884533519
deviation-center-line_max	0.9349599376168654
deviation-center-line_mean	0.4387555178222911
deviation-center-line_min	0.17941317297639486
deviation-heading_max	4.374417856296392
deviation-heading_mean	1.5940974384060418
deviation-heading_median	1.0234199155419084
deviation-heading_min	0.4336566898932428
driven_any_max	2.1860208965398997
driven_any_mean	1.068337512713888
driven_any_median	1.0253513500538094
driven_any_min	0.3424596765232271
driven_lanedir_consec_max	1.8538963171887557
driven_lanedir_consec_mean	0.6976649549765142
driven_lanedir_consec_min	0.3024072802283877
driven_lanedir_max	1.8539439248016505
driven_lanedir_mean	0.7124823821349586
driven_lanedir_median	0.637258234942822
driven_lanedir_min	0.3024072802283877
in-drivable-lane_max	7.600000000000008
in-drivable-lane_mean	1.933333333333337
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.1940201172786476, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.06278349973459159, "in-drivable-lane": 0, "agent_compute-ego": 0.15594795530876226, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.09852542602910404, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.039646303759211986, "sim_compute_performance-ego": 0.06992927272762872, "sim_compute_robot_state-ego": 0.0772753553052919, "sim_compute_robot_state-npc0": 0.06922071802932604, "sim_compute_robot_state-npc1": 0.07037916964134283, "sim_compute_robot_state-npc2": 0.06744356176494497, "sim_compute_robot_state-npc3": 0.07067899049910824}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.1881727592812644, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.06078869435522291, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14544857376151615, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09348742332723406, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03896930813789368, "sim_compute_performance-ego": 0.06825131674607594, "sim_compute_robot_state-ego": 0.07157871623833974, "sim_compute_robot_state-npc0": 0.07084981600443523, "sim_compute_robot_state-npc1": 0.06599624786112043, "sim_compute_robot_state-npc2": 0.06836369964811537, "sim_compute_robot_state-npc3": 0.06809832817978329}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.18375609253273636, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.061173397986615294, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.1481490057022845, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.09190369140906413, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.039199261391749146, "sim_compute_performance-ego": 0.0667224790229172, "sim_compute_robot_state-ego": 0.0708276951899294, "sim_compute_robot_state-npc0": 0.06890321950443455, "sim_compute_robot_state-npc1": 0.06871661494989864, "sim_compute_robot_state-npc2": 0.06718037656096161, "sim_compute_robot_state-npc3": 0.06814219521694496}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.1829805588722229, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06127752304077149, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1453256392478943, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.08863492409388224, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03821848392486572, "sim_compute_performance-ego": 0.06524295727411906, "sim_compute_robot_state-ego": 0.06874158461888631, "sim_compute_robot_state-npc0": 0.06738770564397176, "sim_compute_robot_state-npc1": 0.06573770999908447, "sim_compute_robot_state-npc2": 0.06607798099517823, "sim_compute_robot_state-npc3": 0.06597061475118002}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.13384295834435356, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.046208721620065195, "in-drivable-lane": 0, "agent_compute-ego": 0.11019685533311632, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.07332876435032597, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.02831758393181695, "sim_compute_performance-ego": 0.05076304629996971, "sim_compute_robot_state-ego": 0.05173458876433196, "sim_compute_robot_state-npc0": 0.04815158579084608, "sim_compute_robot_state-npc1": 0.04697388631326181, "sim_compute_robot_state-npc2": 0.04809123056906241, "sim_compute_robot_state-npc3": 0.04702063843056008}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.12972038718545512, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.04418772648853861, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.1166175702574906, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.07032003068620232, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.029305322914366508, "sim_compute_performance-ego": 0.05015160019989986, "sim_compute_robot_state-ego": 0.04958035687732089, "sim_compute_robot_state-npc0": 0.05132257862455526, "sim_compute_robot_state-npc1": 0.05208272690985613, "sim_compute_robot_state-npc2": 0.050062507580799664, "sim_compute_robot_state-npc3": 0.050133916223125095}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.1505456066131592, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.04774718602498373, "in-drivable-lane": 0, "agent_compute-ego": 0.11660629590352375, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.0709860070546468, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.02923594792683919, "sim_compute_performance-ego": 0.05067595799763997, "sim_compute_robot_state-ego": 0.05261641502380371, "sim_compute_robot_state-npc0": 0.05257994016011556, "sim_compute_robot_state-npc1": 0.05135429064432779, "sim_compute_robot_state-npc2": 0.050542112986246744, "sim_compute_robot_state-npc3": 0.05035897890726725}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.12863466143608093, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.04140668445163303, "in-drivable-lane": 0, "agent_compute-ego": 0.1091697613398234, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.06283885571691725, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.025732038749588865, "sim_compute_performance-ego": 0.046039866076575384, "sim_compute_robot_state-ego": 0.0479585329691569, "sim_compute_robot_state-npc0": 0.04648412267367045, "sim_compute_robot_state-npc1": 0.04559829831123352, "sim_compute_robot_state-npc2": 0.045361404617627464, "sim_compute_robot_state-npc3": 0.04521736833784315}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.10251536098777823, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.03582792079195063, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.08718486711488548, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.0538392591138258, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.022414224367615174, "sim_compute_performance-ego": 0.038087782284892194, "sim_compute_robot_state-ego": 0.04019763960060498, "sim_compute_robot_state-npc0": 0.039734578301720586, "sim_compute_robot_state-npc1": 0.039321606886302325, "sim_compute_robot_state-npc2": 0.039192055979519025, "sim_compute_robot_state-npc3": 0.03905229534663207}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.11321299559586533, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.03602621938798811, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.08923378524246749, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.0538178957425631, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.022506148665101377, "sim_compute_performance-ego": 0.03817606305742597, "sim_compute_robot_state-ego": 0.040258222526603646, "sim_compute_robot_state-npc0": 0.04077633944424716, "sim_compute_robot_state-npc1": 0.03933180795682894, "sim_compute_robot_state-npc2": 0.039308016116802506, "sim_compute_robot_state-npc3": 0.0459914224131124}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.10189148554435144, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.0361445821248568, "in-drivable-lane": 0, "agent_compute-ego": 0.08784984166805561, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.05385391070292546, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.022338252801161543, "sim_compute_performance-ego": 0.03818766428874089, "sim_compute_robot_state-ego": 0.04019938523952778, "sim_compute_robot_state-npc0": 0.0398408999809852, "sim_compute_robot_state-npc1": 0.03930220237145057, "sim_compute_robot_state-npc2": 0.03920111747888418, "sim_compute_robot_state-npc3": 0.03909972080817589}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.09852244249030724, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.03611431904693148, "in-drivable-lane": 0, "agent_compute-ego": 0.0877421009006785, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.05598116632717759, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.022693687410496953, "sim_compute_performance-ego": 0.03802063927721622, "sim_compute_robot_state-ego": 0.04333748746274123, "sim_compute_robot_state-npc0": 0.04167734331159449, "sim_compute_robot_state-npc1": 0.03913569094529792, "sim_compute_robot_state-npc2": 0.03890737490867501, "sim_compute_robot_state-npc3": 0.039778460317583225}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.1046207378159708, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.035877391473570865, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.08739025082754258, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.05522114601894398, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.022538752105105576, "sim_compute_performance-ego": 0.03836723109382895, "sim_compute_robot_state-ego": 0.040179110285061506, "sim_compute_robot_state-npc0": 0.039939906466659625, "sim_compute_robot_state-npc1": 0.03946944730198799, "sim_compute_robot_state-npc2": 0.03902679177659068, "sim_compute_robot_state-npc3": 0.03924466484221653}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.10142744426995937, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.03578547188933467, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.08716986884533519, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.05367824057458152, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.022515065233472367, "sim_compute_performance-ego": 0.0419801910158614, "sim_compute_robot_state-ego": 0.040107700186716, "sim_compute_robot_state-npc0": 0.03984877928881578, "sim_compute_robot_state-npc1": 0.03945079823614846, "sim_compute_robot_state-npc2": 0.03935150361396897, "sim_compute_robot_state-npc3": 0.039445014067099125}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.10901477462367008, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.03605246230175621, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.08938370880327727, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.053840041160583496, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.02283570170402527, "sim_compute_performance-ego": 0.03868487006739566, "sim_compute_robot_state-ego": 0.04049850451318841, "sim_compute_robot_state-npc0": 0.03999933129862735, "sim_compute_robot_state-npc1": 0.0394458017851177, "sim_compute_robot_state-npc2": 0.039258676139931926, "sim_compute_robot_state-npc3": 0.03942956108795969}}
set_robot_commands_max	0.09852542602910404
set_robot_commands_mean	0.06868378548719851
set_robot_commands_median	0.06283885571691725
set_robot_commands_min	0.05367824057458152
sim_compute_performance-ego_max	0.06992927272762872
sim_compute_performance-ego_mean	0.04928539582867914
sim_compute_performance-ego_median	0.046039866076575384
sim_compute_performance-ego_min	0.03802063927721622
sim_compute_robot_state-ego_max	0.0772753553052919
sim_compute_robot_state-ego_mean	0.05167275298676696
sim_compute_robot_state-ego_median	0.0479585329691569
sim_compute_robot_state-ego_min	0.040107700186716
sim_compute_robot_state-npc0_max	0.07084981600443523
sim_compute_robot_state-npc0_mean	0.050447790968267
sim_compute_robot_state-npc0_median	0.04648412267367045
sim_compute_robot_state-npc0_min	0.039734578301720586
sim_compute_robot_state-npc1_max	0.07037916964134283
sim_compute_robot_state-npc1_mean	0.04948642000755064
sim_compute_robot_state-npc1_median	0.04559829831123352
sim_compute_robot_state-npc1_min	0.03913569094529792
sim_compute_robot_state-npc2_max	0.06836369964811537
sim_compute_robot_state-npc2_mean	0.04915789404915392
sim_compute_robot_state-npc2_median	0.045361404617627464
sim_compute_robot_state-npc2_min	0.03890737490867501
sim_compute_robot_state-npc3_max	0.07067899049910824
sim_compute_robot_state-npc3_mean	0.049844144628572735
sim_compute_robot_state-npc3_median	0.0459914224131124
sim_compute_robot_state-npc3_min	0.03905229534663207
sim_compute_sim_state_max	0.039646303759211986
sim_compute_sim_state_mean	0.028431072201554015
sim_compute_sim_state_median	0.025732038749588865
sim_compute_sim_state_min	0.022338252801161543
sim_physics_max	0.1940201172786476
sim_physics_mean	0.1348585588581215
sim_physics_median	0.12863466143608093
sim_physics_min	0.09852244249030724
sim_render-ego_max	0.06278349973459159
sim_render-ego_mean	0.04516012004792071
sim_render-ego_median	0.04140668445163303
sim_render-ego_min	0.03578547188933467
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.47
survival_time_min	2.5999999999999988

No reset possible

21367

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-28 01:11:22+00:00

2019-04-28 02:00:04+00:00

0:48:42

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-42-167-7357-job21367/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21358

2378

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-28 01:00:37+00:00

2019-04-28 01:10:44+00:00

0:10:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6707441932890994
survival_time_median	3.649999999999995
deviation-center-line_median	0.14435558631904788
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.06219185675893511
agent_compute-ego_mean	0.06027219575453128
agent_compute-ego_median	0.06056504590170724
agent_compute-ego_min	0.0581577984062401
deviation-center-line_max	0.2085822874042474
deviation-center-line_mean	0.1589542518908908
deviation-center-line_min	0.10686452122645386
deviation-heading_max	0.6191860504142408
deviation-heading_mean	0.523857550127959
deviation-heading_median	0.5156622477370731
deviation-heading_min	0.42218734391092383
driven_any_max	1.5798273185720382
driven_any_mean	0.9978358087547315
driven_any_median	0.9948273195001778
driven_any_min	0.3798605253583843
driven_lanedir_consec_max	1.2017887891468408
driven_lanedir_consec_mean	0.7740609626522831
driven_lanedir_consec_min	0.366714522485295
driven_lanedir_max	1.2017887891468408
driven_lanedir_mean	0.7740609626522831
driven_lanedir_median	0.6707441932890994
driven_lanedir_min	0.366714522485295
in-drivable-lane_max	1.1999999999999955
in-drivable-lane_mean	0.6699999999999976
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.16351580946412805, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.056325089441586845, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06080242052470168, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.10302230429975952, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03503649528712442, "sim_compute_performance-ego": 0.06603397735177655, "sim_compute_robot_state-ego": 0.06674265534910437, "sim_compute_robot_state-npc0": 0.06714316590191567, "sim_compute_robot_state-npc1": 0.06755017907652136, "sim_compute_robot_state-npc2": 0.06554886739547938, "sim_compute_robot_state-npc3": 0.06530614421792226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.1706056917035902, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.05764518557368098, "in-drivable-lane": 0, "agent_compute-ego": 0.0581577984062401, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.08054590225219727, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03740371884526433, "sim_compute_performance-ego": 0.06979886261192528, "sim_compute_robot_state-ego": 0.06976554200455949, "sim_compute_robot_state-npc0": 0.06520130183245684, "sim_compute_robot_state-npc1": 0.06766480368536872, "sim_compute_robot_state-npc2": 0.06745257248749605, "sim_compute_robot_state-npc3": 0.06660893801096324}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.17776921391487122, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.062358355947903225, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06219185675893511, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.0911480699266706, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.03706677258014679, "sim_compute_performance-ego": 0.07163466087409429, "sim_compute_robot_state-ego": 0.07087372243404388, "sim_compute_robot_state-npc0": 0.06558238608496529, "sim_compute_robot_state-npc1": 0.0672340669802257, "sim_compute_robot_state-npc2": 0.06721393551145281, "sim_compute_robot_state-npc3": 0.06713634303637914}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.173510519521577, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.05915150684969766, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06056504590170724, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.08763863146305084, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03733578750065395, "sim_compute_performance-ego": 0.06456264427730016, "sim_compute_robot_state-ego": 0.06862541394574302, "sim_compute_robot_state-npc0": 0.06622199501310076, "sim_compute_robot_state-npc1": 0.06480543528284345, "sim_compute_robot_state-npc2": 0.06663393335683006, "sim_compute_robot_state-npc3": 0.06777969215597425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.16297951340675354, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.05634930729866028, "in-drivable-lane": 0, "agent_compute-ego": 0.059643857181072235, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.08597685396671295, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.03752867132425308, "sim_compute_performance-ego": 0.06201153248548508, "sim_compute_robot_state-ego": 0.06985007226467133, "sim_compute_robot_state-npc0": 0.05983927845954895, "sim_compute_robot_state-npc1": 0.06270433962345123, "sim_compute_robot_state-npc2": 0.06699344515800476, "sim_compute_robot_state-npc3": 0.0644388198852539}}
set_robot_commands_max	0.10302230429975952
set_robot_commands_mean	0.08966635238167824
set_robot_commands_median	0.08763863146305084
set_robot_commands_min	0.08054590225219727
sim_compute_performance-ego_max	0.07163466087409429
sim_compute_performance-ego_mean	0.06680833552011627
sim_compute_performance-ego_median	0.06603397735177655
sim_compute_performance-ego_min	0.06201153248548508
sim_compute_robot_state-ego_max	0.07087372243404388
sim_compute_robot_state-ego_mean	0.06917148119962442
sim_compute_robot_state-ego_median	0.06976554200455949
sim_compute_robot_state-ego_min	0.06674265534910437
sim_compute_robot_state-npc0_max	0.06714316590191567
sim_compute_robot_state-npc0_mean	0.06479762545839751
sim_compute_robot_state-npc0_median	0.06558238608496529
sim_compute_robot_state-npc0_min	0.05983927845954895
sim_compute_robot_state-npc1_max	0.06766480368536872
sim_compute_robot_state-npc1_mean	0.06599176492968209
sim_compute_robot_state-npc1_median	0.0672340669802257
sim_compute_robot_state-npc1_min	0.06270433962345123
sim_compute_robot_state-npc2_max	0.06745257248749605
sim_compute_robot_state-npc2_mean	0.0667685507818526
sim_compute_robot_state-npc2_median	0.06699344515800476
sim_compute_robot_state-npc2_min	0.06554886739547938
sim_compute_robot_state-npc3_max	0.06777969215597425
sim_compute_robot_state-npc3_mean	0.06625398746129856
sim_compute_robot_state-npc3_median	0.06660893801096324
sim_compute_robot_state-npc3_min	0.0644388198852539
sim_compute_sim_state_max	0.03752867132425308
sim_compute_sim_state_mean	0.03687428910748851
sim_compute_sim_state_median	0.03733578750065395
sim_compute_sim_state_min	0.03503649528712442
sim_physics_max	0.17776921391487122
sim_physics_mean	0.169676149602184
sim_physics_median	0.1706056917035902
sim_physics_min	0.16297951340675354
sim_render-ego_max	0.062358355947903225
sim_render-ego_mean	0.05836588902230579
sim_render-ego_median	0.05764518557368098
sim_render-ego_min	0.056325089441586845
simulation-passed	1
survival_time_max	5.599999999999988
survival_time_mean	3.6599999999999944
survival_time_min	1.6000000000000008

No reset possible

21352

2377

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

2019-04-28 00:55:58+00:00

2019-04-28 01:00:09+00:00

0:04:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2377/step1-simulation-ip-172-31-42-167-7357-job21352/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21341

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-28 00:00:33+00:00

2019-04-28 00:55:46+00:00

0:55:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.637258234942822
survival_time_median	7.199999999999982
deviation-center-line_median	0.41059891008830585
in-drivable-lane_median	1.699999999999994

other stats

agent_compute-ego_max	0.1516653103614921
agent_compute-ego_mean	0.14370199066870615
agent_compute-ego_median	0.14686969032994024
agent_compute-ego_min	0.10960798663692876
deviation-center-line_max	0.9349599376168654
deviation-center-line_mean	0.4387555178222911
deviation-center-line_min	0.17941317297639486
deviation-heading_max	4.374417856296392
deviation-heading_mean	1.5940974384060418
deviation-heading_median	1.0234199155419084
deviation-heading_min	0.4336566898932428
driven_any_max	2.1860208965398997
driven_any_mean	1.068337512713888
driven_any_median	1.0253513500538094
driven_any_min	0.3424596765232271
driven_lanedir_consec_max	1.8538963171887557
driven_lanedir_consec_mean	0.6976649549765142
driven_lanedir_consec_min	0.3024072802283877
driven_lanedir_max	1.8539439248016505
driven_lanedir_mean	0.7124823821349586
driven_lanedir_median	0.637258234942822
driven_lanedir_min	0.3024072802283877
in-drivable-lane_max	7.600000000000008
in-drivable-lane_mean	1.933333333333337
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.17796313973654687, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.058869485306528815, "in-drivable-lane": 0, "agent_compute-ego": 0.1448918886944256, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.0885524760305354, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.0372228664634502, "sim_compute_performance-ego": 0.06567928010383539, "sim_compute_robot_state-ego": 0.06925658420123885, "sim_compute_robot_state-npc0": 0.06676784975338826, "sim_compute_robot_state-npc1": 0.06500833751881017, "sim_compute_robot_state-npc2": 0.06554978611194982, "sim_compute_robot_state-npc3": 0.06588010766864878}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.19867607288890415, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.06330155332883199, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14764545857906342, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09440684484110938, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03881170517868466, "sim_compute_performance-ego": 0.06841495136419933, "sim_compute_robot_state-ego": 0.07423700392246246, "sim_compute_robot_state-npc0": 0.06986112892627716, "sim_compute_robot_state-npc1": 0.06890180210272472, "sim_compute_robot_state-npc2": 0.06900571452246772, "sim_compute_robot_state-npc3": 0.06852361891004774}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.1931453923710057, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.06192477707002984, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.14816732875636365, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.09301933792770886, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.03913404316198631, "sim_compute_performance-ego": 0.06783002908112573, "sim_compute_robot_state-ego": 0.07289731404820426, "sim_compute_robot_state-npc0": 0.0690416654602426, "sim_compute_robot_state-npc1": 0.06977116573052328, "sim_compute_robot_state-npc2": 0.0697627311847249, "sim_compute_robot_state-npc3": 0.06902957744285708}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.19069501241048176, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06171159505844116, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.1470088283220927, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.09147494157155354, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.03832197268803914, "sim_compute_performance-ego": 0.06633276859919231, "sim_compute_robot_state-ego": 0.07012192169825236, "sim_compute_robot_state-npc0": 0.06825666268666586, "sim_compute_robot_state-npc1": 0.06626783847808838, "sim_compute_robot_state-npc2": 0.06478115876515707, "sim_compute_robot_state-npc3": 0.06519928216934204}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.1972368469944707, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.06571556903697827, "in-drivable-lane": 0, "agent_compute-ego": 0.14686969032994024, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.09257254777131256, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.040650517852218064, "sim_compute_performance-ego": 0.0666630886219166, "sim_compute_robot_state-ego": 0.07200865833847611, "sim_compute_robot_state-npc0": 0.06952027921323423, "sim_compute_robot_state-npc1": 0.07041616793032046, "sim_compute_robot_state-npc2": 0.06954191349170825, "sim_compute_robot_state-npc3": 0.06846422177773935}, "udem1-5-0": {"driven_any": 1.1302403061470987, "sim_physics": 0.17993524575689038, "survival_time": 7.84999999999998, "driven_lanedir": 0.39314661474467094, "sim_render-ego": 0.06546495826381027, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.14942900845958929, "deviation-heading": 2.4308255969868253, "set_robot_commands": 0.0893893378555395, "deviation-center-line": 0.38861383599610416, "driven_lanedir_consec": 0.39314661474467094, "sim_compute_sim_state": 0.0391095945030261, "sim_compute_performance-ego": 0.06727069958000426, "sim_compute_robot_state-ego": 0.07104134711490315, "sim_compute_robot_state-npc0": 0.06531319800455859, "sim_compute_robot_state-npc1": 0.06839748704509371, "sim_compute_robot_state-npc2": 0.06646541121659005, "sim_compute_robot_state-npc3": 0.06679220564046483}, "udem1-6-0": {"driven_any": 0.5061578530870738, "sim_physics": 0.21831342379252117, "survival_time": 3.7499999999999942, "driven_lanedir": 0.500515270834164, "sim_render-ego": 0.06228947003682454, "in-drivable-lane": 0, "agent_compute-ego": 0.14836861610412597, "deviation-heading": 0.5159300208401423, "set_robot_commands": 0.0904753875732422, "deviation-center-line": 0.32277039791323286, "driven_lanedir_consec": 0.500515270834164, "sim_compute_sim_state": 0.03762097358703613, "sim_compute_performance-ego": 0.06881686210632325, "sim_compute_robot_state-ego": 0.07210201899210612, "sim_compute_robot_state-npc0": 0.06569125811258952, "sim_compute_robot_state-npc1": 0.0658716869354248, "sim_compute_robot_state-npc2": 0.06386165301005045, "sim_compute_robot_state-npc3": 0.06603817939758301}, "udem1-7-0": {"driven_any": 1.0295382151776031, "sim_physics": 0.2055157605144713, "survival_time": 7.199999999999982, "driven_lanedir": 0.9359161916925074, "sim_render-ego": 0.06252410345607334, "in-drivable-lane": 0, "agent_compute-ego": 0.15040967696242863, "deviation-heading": 2.4651914972100637, "set_robot_commands": 0.08993937902980381, "deviation-center-line": 0.5408967871824802, "driven_lanedir_consec": 0.9268938600486144, "sim_compute_sim_state": 0.03966323203510709, "sim_compute_performance-ego": 0.06912701328595479, "sim_compute_robot_state-ego": 0.07130391730202569, "sim_compute_robot_state-npc0": 0.06708970334794787, "sim_compute_robot_state-npc1": 0.06846603751182556, "sim_compute_robot_state-npc2": 0.06836433543099298, "sim_compute_robot_state-npc3": 0.06694941222667694}, "udem1-8-0": {"driven_any": 1.0117814342566946, "sim_physics": 0.1753844995025202, "survival_time": 7.049999999999983, "driven_lanedir": 0.6909705366951359, "sim_render-ego": 0.06139033736912071, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.14241777075097917, "deviation-heading": 2.329921518550053, "set_robot_commands": 0.08520481096091845, "deviation-center-line": 0.5441337791691367, "driven_lanedir_consec": 0.6909705366951359, "sim_compute_sim_state": 0.03570111254428295, "sim_compute_performance-ego": 0.06500705590484836, "sim_compute_robot_state-ego": 0.06946099227201855, "sim_compute_robot_state-npc0": 0.06547885245465218, "sim_compute_robot_state-npc1": 0.06460009399035298, "sim_compute_robot_state-npc2": 0.06315670791247212, "sim_compute_robot_state-npc3": 0.06333562837424853}, "udem1-9-0": {"driven_any": 1.0121721984179504, "sim_physics": 0.144118875890345, "survival_time": 7.149999999999983, "driven_lanedir": 0.6896653033503108, "sim_render-ego": 0.04377523168817267, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10960798663692876, "deviation-heading": 1.7559109248467348, "set_robot_commands": 0.06678609247807857, "deviation-center-line": 0.4657042775355992, "driven_lanedir_consec": 0.6525088666893104, "sim_compute_sim_state": 0.02678497187741153, "sim_compute_performance-ego": 0.04940281381140222, "sim_compute_robot_state-ego": 0.04864892259344354, "sim_compute_robot_state-npc0": 0.04758452868961788, "sim_compute_robot_state-npc1": 0.05981266581928813, "sim_compute_robot_state-npc2": 0.0480343928703895, "sim_compute_robot_state-npc3": 0.047360425228839154}, "udem1-10-0": {"driven_any": 0.3424596765232271, "sim_physics": 0.18849242192048293, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3212520101257572, "sim_render-ego": 0.05526778789666983, "in-drivable-lane": 0, "agent_compute-ego": 0.14025551080703735, "deviation-heading": 0.9083914070419382, "set_robot_commands": 0.08775294285554153, "deviation-center-line": 0.17941317297639486, "driven_lanedir_consec": 0.3212520101257572, "sim_compute_sim_state": 0.035833702637599066, "sim_compute_performance-ego": 0.06342747578254113, "sim_compute_robot_state-ego": 0.06817815853999211, "sim_compute_robot_state-npc0": 0.06317633390426636, "sim_compute_robot_state-npc1": 0.06567739523374118, "sim_compute_robot_state-npc2": 0.06776350736618042, "sim_compute_robot_state-npc3": 0.06011425531827486}, "udem1-11-0": {"driven_any": 0.45910689128684445, "sim_physics": 0.1941764959648474, "survival_time": 3.349999999999996, "driven_lanedir": 0.4553365542784813, "sim_render-ego": 0.06548834914591775, "in-drivable-lane": 0, "agent_compute-ego": 0.1516653103614921, "deviation-heading": 0.4336566898932428, "set_robot_commands": 0.08717106705281272, "deviation-center-line": 0.3396621974449056, "driven_lanedir_consec": 0.4553365542784813, "sim_compute_sim_state": 0.03820260603036454, "sim_compute_performance-ego": 0.06793191183858843, "sim_compute_robot_state-ego": 0.07351326942443848, "sim_compute_robot_state-npc0": 0.06511671507536475, "sim_compute_robot_state-npc1": 0.06670154742340544, "sim_compute_robot_state-npc2": 0.06737004820980243, "sim_compute_robot_state-npc3": 0.06846901552001042}, "udem1-12-0": {"driven_any": 1.447644041392146, "sim_physics": 0.19401329785437132, "survival_time": 10.050000000000008, "driven_lanedir": 0.3024072802283877, "sim_render-ego": 0.05914111398345795, "in-drivable-lane": 7.600000000000008, "agent_compute-ego": 0.14567030128554917, "deviation-heading": 0.5639614932962997, "set_robot_commands": 0.08989717118182586, "deviation-center-line": 0.287042893102722, "driven_lanedir_consec": 0.3024072802283877, "sim_compute_sim_state": 0.03820064411827581, "sim_compute_performance-ego": 0.0659624166156522, "sim_compute_robot_state-ego": 0.07095689204201769, "sim_compute_robot_state-npc0": 0.06624372325726409, "sim_compute_robot_state-npc1": 0.06479158804784367, "sim_compute_robot_state-npc2": 0.06614741875757625, "sim_compute_robot_state-npc3": 0.0673801483799569}, "udem1-13-0": {"driven_any": 1.0071223990792053, "sim_physics": 0.1853433041505411, "survival_time": 7.099999999999983, "driven_lanedir": 0.6504510750495411, "sim_render-ego": 0.058185511911419074, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14209243277428854, "deviation-heading": 1.767427394796984, "set_robot_commands": 0.08579204955571135, "deviation-center-line": 0.44358814435396954, "driven_lanedir_consec": 0.6504510750495411, "sim_compute_sim_state": 0.03710939682705302, "sim_compute_performance-ego": 0.06606654382087815, "sim_compute_robot_state-ego": 0.06859374550026907, "sim_compute_robot_state-npc0": 0.062437180062414895, "sim_compute_robot_state-npc1": 0.06057772837894063, "sim_compute_robot_state-npc2": 0.06474356080444765, "sim_compute_robot_state-npc3": 0.06472457630533568}, "udem1-14-0": {"driven_any": 1.0832727219252307, "sim_physics": 0.19419152171988235, "survival_time": 7.599999999999981, "driven_lanedir": 0.5461047072099379, "sim_render-ego": 0.06026168873435572, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1410300512062876, "deviation-heading": 4.374417856296392, "set_robot_commands": 0.08555082427827936, "deviation-center-line": 0.4695309103813122, "driven_lanedir_consec": 0.3703185844575955, "sim_compute_sim_state": 0.03605116825354727, "sim_compute_performance-ego": 0.06736264730754651, "sim_compute_robot_state-ego": 0.06597029535393965, "sim_compute_robot_state-npc0": 0.06362545333410564, "sim_compute_robot_state-npc1": 0.06308718417820178, "sim_compute_robot_state-npc2": 0.06325208670214603, "sim_compute_robot_state-npc3": 0.06512032684526946}}
set_robot_commands_max	0.09440684484110938
set_robot_commands_mean	0.08786568073093155
set_robot_commands_median	0.0893893378555395
set_robot_commands_min	0.06678609247807857
sim_compute_performance-ego_max	0.06912701328595479
sim_compute_performance-ego_mean	0.06568637052160058
sim_compute_performance-ego_median	0.0666630886219166
sim_compute_performance-ego_min	0.04940281381140222
sim_compute_robot_state-ego_max	0.07423700392246246
sim_compute_robot_state-ego_mean	0.06921940275625255
sim_compute_robot_state-ego_median	0.07095689204201769
sim_compute_robot_state-ego_min	0.04864892259344354
sim_compute_robot_state-npc0_max	0.06986112892627716
sim_compute_robot_state-npc0_mean	0.065013635485506
sim_compute_robot_state-npc0_median	0.06569125811258952
sim_compute_robot_state-npc0_min	0.04758452868961788
sim_compute_robot_state-npc1_max	0.07041616793032046
sim_compute_robot_state-npc1_mean	0.06588991508830565
sim_compute_robot_state-npc1_median	0.0658716869354248
sim_compute_robot_state-npc1_min	0.05981266581928813
sim_compute_robot_state-npc2_max	0.0697627311847249
sim_compute_robot_state-npc2_mean	0.0651866950904437
sim_compute_robot_state-npc2_median	0.06614741875757625
sim_compute_robot_state-npc2_min	0.0480343928703895
sim_compute_robot_state-npc3_max	0.06902957744285708
sim_compute_robot_state-npc3_mean	0.06489206541368632
sim_compute_robot_state-npc3_median	0.06603817939758301
sim_compute_robot_state-npc3_min	0.047360425228839154
sim_compute_sim_state_max	0.040650517852218064
sim_compute_sim_state_mean	0.03722790051720546
sim_compute_sim_state_median	0.03820064411827581
sim_compute_sim_state_min	0.02678497187741153
sim_physics_max	0.21831342379252117
sim_physics_mean	0.18914675409788553
sim_physics_median	0.1931453923710057
sim_physics_min	0.144118875890345
sim_render-ego_max	0.06571556903697827
sim_render-ego_mean	0.06035410215244214
sim_render-ego_median	0.06171159505844116
sim_render-ego_min	0.04377523168817267
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.47
survival_time_min	2.5999999999999988

No reset possible

21319

2448

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 23:08:11+00:00

2019-04-28 00:00:10+00:00

0:51:59

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2448/step1-simulation-ip-172-31-42-167-7357-job21319/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21311

2407

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 23:00:18+00:00

2019-04-27 23:07:37+00:00

0:07:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.09301692002978525
survival_time_median	1.2000000000000004
deviation-center-line_median	0.06665476741524345
in-drivable-lane_median	0.10000000000000007

other stats

agent_compute-ego_max	0.19109646479288736
agent_compute-ego_mean	0.16378644760597813
agent_compute-ego_median	0.1669771671295166
agent_compute-ego_min	0.13353707109178817
deviation-center-line_max	0.10247730427355416
deviation-center-line_mean	0.07338038908256612
deviation-center-line_min	0.043315997986445594
deviation-heading_max	0.8357936862643188
deviation-heading_mean	0.647852917191409
deviation-heading_median	0.7457569337136808
deviation-heading_min	0.4379212412504937
driven_any_max	0.22367625624483492
driven_any_mean	0.17098730079397845
driven_any_median	0.16566387358860254
driven_any_min	0.1327196189481467
driven_lanedir_consec_max	0.13668239838882237
driven_lanedir_consec_mean	0.09423658100292688
driven_lanedir_consec_min	0.05562396297427341
driven_lanedir_max	0.13668239838882237
driven_lanedir_mean	0.09423658100292688
driven_lanedir_median	0.09301692002978525
driven_lanedir_min	0.05562396297427341
in-drivable-lane_max	0.5000000000000004
in-drivable-lane_mean	0.19000000000000017
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.22367625624483492, "sim_physics": 0.187582642691476, "survival_time": 1.7500000000000009, "driven_lanedir": 0.09301692002978525, "sim_render-ego": 0.06706611088344029, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1682372978755406, "deviation-heading": 0.7663430481698092, "set_robot_commands": 0.10754933357238768, "deviation-center-line": 0.06665476741524345, "driven_lanedir_consec": 0.09301692002978525, "sim_compute_sim_state": 0.0378009523664202, "sim_compute_performance-ego": 0.06563538823808943, "sim_compute_robot_state-ego": 0.08030001095363072, "sim_compute_robot_state-npc0": 0.072765166418893, "sim_compute_robot_state-npc1": 0.07235716411045619, "sim_compute_robot_state-npc2": 0.0732344150543213, "sim_compute_robot_state-npc3": 0.07039382117135184}, "udem1-1-0": {"driven_any": 0.1855732408450208, "sim_physics": 0.1708657911845616, "survival_time": 1.4000000000000006, "driven_lanedir": 0.05562396297427341, "sim_render-ego": 0.044564706938607354, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.13353707109178817, "deviation-heading": 0.8357936862643188, "set_robot_commands": 0.07458181892122541, "deviation-center-line": 0.05701050665186216, "driven_lanedir_consec": 0.05562396297427341, "sim_compute_sim_state": 0.030642552035195485, "sim_compute_performance-ego": 0.0471501350402832, "sim_compute_robot_state-ego": 0.05023139715194702, "sim_compute_robot_state-npc0": 0.05538904666900635, "sim_compute_robot_state-npc1": 0.05338685853140695, "sim_compute_robot_state-npc2": 0.05220045362200056, "sim_compute_robot_state-npc3": 0.052193054131099155}, "udem1-2-0": {"driven_any": 0.14730351434328717, "sim_physics": 0.26260152070418646, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11810273916088576, "sim_render-ego": 0.06077635806539784, "in-drivable-lane": 0, "agent_compute-ego": 0.1669771671295166, "deviation-heading": 0.4534496765587428, "set_robot_commands": 0.09613321138464886, "deviation-center-line": 0.10247730427355416, "driven_lanedir_consec": 0.11810273916088576, "sim_compute_sim_state": 0.038836645043414574, "sim_compute_performance-ego": 0.06958570687667183, "sim_compute_robot_state-ego": 0.08677732426187267, "sim_compute_robot_state-npc0": 0.07077133137246837, "sim_compute_robot_state-npc1": 0.06400370597839355, "sim_compute_robot_state-npc2": 0.07015256259752356, "sim_compute_robot_state-npc3": 0.07335431679435399}, "udem1-3-0": {"driven_any": 0.16566387358860254, "sim_physics": 0.24147409200668335, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13668239838882237, "sim_render-ego": 0.07182679573694865, "in-drivable-lane": 0, "agent_compute-ego": 0.19109646479288736, "deviation-heading": 0.4379212412504937, "set_robot_commands": 0.096454918384552, "deviation-center-line": 0.09744336908572523, "driven_lanedir_consec": 0.13668239838882237, "sim_compute_sim_state": 0.04360806941986084, "sim_compute_performance-ego": 0.0761226216952006, "sim_compute_robot_state-ego": 0.07844630877176921, "sim_compute_robot_state-npc0": 0.06873987118403117, "sim_compute_robot_state-npc1": 0.06779366731643677, "sim_compute_robot_state-npc2": 0.06980561216672261, "sim_compute_robot_state-npc3": 0.07111987471580505}, "udem1-4-0": {"driven_any": 0.1327196189481467, "sim_physics": 0.19176571265510892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06775688446086758, "sim_render-ego": 0.05767907267031462, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15908423714015796, "deviation-heading": 0.7457569337136808, "set_robot_commands": 0.09143326593481976, "deviation-center-line": 0.043315997986445594, "driven_lanedir_consec": 0.06775688446086758, "sim_compute_sim_state": 0.04075166453485903, "sim_compute_performance-ego": 0.06538261537966521, "sim_compute_robot_state-ego": 0.06709971635237984, "sim_compute_robot_state-npc0": 0.06467170300691025, "sim_compute_robot_state-npc1": 0.06286892683609673, "sim_compute_robot_state-npc2": 0.06376147270202637, "sim_compute_robot_state-npc3": 0.0617770008418871}}
set_robot_commands_max	0.10754933357238768
set_robot_commands_mean	0.09323050963952675
set_robot_commands_median	0.09613321138464886
set_robot_commands_min	0.07458181892122541
sim_compute_performance-ego_max	0.0761226216952006
sim_compute_performance-ego_mean	0.06477529344598207
sim_compute_performance-ego_median	0.06563538823808943
sim_compute_performance-ego_min	0.0471501350402832
sim_compute_robot_state-ego_max	0.08677732426187267
sim_compute_robot_state-ego_mean	0.0725709514983199
sim_compute_robot_state-ego_median	0.07844630877176921
sim_compute_robot_state-ego_min	0.05023139715194702
sim_compute_robot_state-npc0_max	0.072765166418893
sim_compute_robot_state-npc0_mean	0.06646742373026182
sim_compute_robot_state-npc0_median	0.06873987118403117
sim_compute_robot_state-npc0_min	0.05538904666900635
sim_compute_robot_state-npc1_max	0.07235716411045619
sim_compute_robot_state-npc1_mean	0.06408206455455803
sim_compute_robot_state-npc1_median	0.06400370597839355
sim_compute_robot_state-npc1_min	0.05338685853140695
sim_compute_robot_state-npc2_max	0.0732344150543213
sim_compute_robot_state-npc2_mean	0.06583090322851888
sim_compute_robot_state-npc2_median	0.06980561216672261
sim_compute_robot_state-npc2_min	0.05220045362200056
sim_compute_robot_state-npc3_max	0.07335431679435399
sim_compute_robot_state-npc3_mean	0.06576761353089942
sim_compute_robot_state-npc3_median	0.07039382117135184
sim_compute_robot_state-npc3_min	0.052193054131099155
sim_compute_sim_state_max	0.04360806941986084
sim_compute_sim_state_mean	0.03832797667995003
sim_compute_sim_state_median	0.038836645043414574
sim_compute_sim_state_min	0.030642552035195485
sim_physics_max	0.26260152070418646
sim_physics_mean	0.21085795184840328
sim_physics_median	0.19176571265510892
sim_physics_min	0.1708657911845616
sim_render-ego_max	0.07182679573694865
sim_render-ego_mean	0.060382608858941755
sim_render-ego_median	0.06077635806539784
sim_render-ego_min	0.044564706938607354
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.3300000000000003
survival_time_min	1.1500000000000004

No reset possible

21300

2413

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 22:51:32+00:00

2019-04-27 23:00:04+00:00

0:08:32

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2413/step1-simulation-ip-172-31-42-167-7357-job21300/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21298

2417

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-27 22:45:38+00:00

2019-04-27 22:51:12+00:00

0:05:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15129692414227655
agent_compute-ego_mean	0.13762950319276115
agent_compute-ego_median	0.13777441616299785
agent_compute-ego_min	0.12134728166792128
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10943208358905931, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05776831397303829, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12134728166792128, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08673487327716968, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03694977583708586, "sim_compute_performance-ego": 0.06684895798012062, "sim_compute_robot_state-ego": 0.06854165924919976}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11614818666495529, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06494429999706793, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.13223634981641583, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09147471072627048, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.038889810150744865, "sim_compute_performance-ego": 0.0716566712248559, "sim_compute_robot_state-ego": 0.08130515322965734}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13008256519542022, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0644687624538646, "in-drivable-lane": 0, "agent_compute-ego": 0.15129692414227655, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10925964748158176, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04303497426650103, "sim_compute_performance-ego": 0.07051835340612075, "sim_compute_robot_state-ego": 0.0789803476894603}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13222929000854491, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0636430835723877, "in-drivable-lane": 0, "agent_compute-ego": 0.14549254417419433, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09886322975158691, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04118350982666016, "sim_compute_performance-ego": 0.0716567325592041, "sim_compute_robot_state-ego": 0.07477333068847657}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1063744237151327, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05899055094658574, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13777441616299785, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08850713017620618, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.038373400893392445, "sim_compute_performance-ego": 0.06293983700909192, "sim_compute_robot_state-ego": 0.07122542888303346}}
set_robot_commands_max	0.10925964748158176
set_robot_commands_mean	0.094967918282563
set_robot_commands_median	0.09147471072627048
set_robot_commands_min	0.08673487327716968
sim_compute_performance-ego_max	0.0716567325592041
sim_compute_performance-ego_mean	0.06872411043587864
sim_compute_performance-ego_median	0.07051835340612075
sim_compute_performance-ego_min	0.06293983700909192
sim_compute_robot_state-ego_max	0.08130515322965734
sim_compute_robot_state-ego_mean	0.07496518394796549
sim_compute_robot_state-ego_median	0.07477333068847657
sim_compute_robot_state-ego_min	0.06854165924919976
sim_compute_sim_state_max	0.04303497426650103
sim_compute_sim_state_mean	0.03968629419487687
sim_compute_sim_state_median	0.038889810150744865
sim_compute_sim_state_min	0.03694977583708586
sim_physics_max	0.13222929000854491
sim_physics_mean	0.1188533098346225
sim_physics_median	0.11614818666495529
sim_physics_min	0.1063744237151327
sim_render-ego_max	0.06494429999706793
sim_render-ego_mean	0.06196300218858884
sim_render-ego_median	0.0636430835723877
sim_render-ego_min	0.05776831397303829
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21296

2421

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-27 22:37:02+00:00

2019-04-27 22:45:24+00:00

0:08:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.13900075147026464
agent_compute-ego_mean	0.13295298986230647
agent_compute-ego_median	0.136737225930902
agent_compute-ego_min	0.11883082389831542
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.12651756552531995
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599273
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811214
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589035
driven_any_mean	1.0272530755098266
driven_any_median	1.0243289631429708
driven_any_min	0.4119037580118998
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16139564249250624, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06344397862752278, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13187741350244592, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09352116231565122, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03642476929558648, "sim_compute_performance-ego": 0.06921726685983164, "sim_compute_robot_state-ego": 0.0739013221528795, "sim_compute_robot_state-npc0": 0.06623973669829192, "sim_compute_robot_state-npc1": 0.06718281463340477, "sim_compute_robot_state-npc2": 0.06741242938571507, "sim_compute_robot_state-npc3": 0.06527856102696171}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17648414611816407, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05861088752746582, "in-drivable-lane": 0, "agent_compute-ego": 0.11883082389831542, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08408056259155273, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.037457876205444336, "sim_compute_performance-ego": 0.06649993896484375, "sim_compute_robot_state-ego": 0.06251300811767578, "sim_compute_robot_state-npc0": 0.06491518974304199, "sim_compute_robot_state-npc1": 0.07033397674560547, "sim_compute_robot_state-npc2": 0.06718070983886719, "sim_compute_robot_state-npc3": 0.06725492477416992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17686760425567627, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06011889169090673, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13900075147026464, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09613059696398284, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03902201903493781, "sim_compute_performance-ego": 0.06972013962896247, "sim_compute_robot_state-ego": 0.07301963003058183, "sim_compute_robot_state-npc0": 0.06743674215517546, "sim_compute_robot_state-npc1": 0.06526379522524382, "sim_compute_robot_state-npc2": 0.06502205447146767, "sim_compute_robot_state-npc3": 0.06533173510902807}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2041508215892164, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06397633311114734, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.136737225930902, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09436224985726271, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03874717181241965, "sim_compute_performance-ego": 0.06849603109721895, "sim_compute_robot_state-ego": 0.0765609228158299, "sim_compute_robot_state-npc0": 0.07046494001074682, "sim_compute_robot_state-npc1": 0.06759144082854066, "sim_compute_robot_state-npc2": 0.0670870135102091, "sim_compute_robot_state-npc3": 0.06914107407195659}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18171061788286483, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05914433513368879, "in-drivable-lane": 0, "agent_compute-ego": 0.13831873450960433, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0903215834072658, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04162380525044033, "sim_compute_performance-ego": 0.06262746027537755, "sim_compute_robot_state-ego": 0.07299956253596715, "sim_compute_robot_state-npc0": 0.06600402082715716, "sim_compute_robot_state-npc1": 0.06421453612191337, "sim_compute_robot_state-npc2": 0.0673840982573373, "sim_compute_robot_state-npc3": 0.06807705334254674}}
set_robot_commands_max	0.09613059696398284
set_robot_commands_mean	0.09168323102714308
set_robot_commands_median	0.09352116231565122
set_robot_commands_min	0.08408056259155273
sim_compute_performance-ego_max	0.06972013962896247
sim_compute_performance-ego_mean	0.06731216736524688
sim_compute_performance-ego_median	0.06849603109721895
sim_compute_performance-ego_min	0.06262746027537755
sim_compute_robot_state-ego_max	0.0765609228158299
sim_compute_robot_state-ego_mean	0.07179888913058682
sim_compute_robot_state-ego_median	0.07301963003058183
sim_compute_robot_state-ego_min	0.06251300811767578
sim_compute_robot_state-npc0_max	0.07046494001074682
sim_compute_robot_state-npc0_mean	0.06701212588688268
sim_compute_robot_state-npc0_median	0.06623973669829192
sim_compute_robot_state-npc0_min	0.06491518974304199
sim_compute_robot_state-npc1_max	0.07033397674560547
sim_compute_robot_state-npc1_mean	0.06691731271094162
sim_compute_robot_state-npc1_median	0.06718281463340477
sim_compute_robot_state-npc1_min	0.06421453612191337
sim_compute_robot_state-npc2_max	0.06741242938571507
sim_compute_robot_state-npc2_mean	0.06681726109271927
sim_compute_robot_state-npc2_median	0.06718070983886719
sim_compute_robot_state-npc2_min	0.06502205447146767
sim_compute_robot_state-npc3_max	0.06914107407195659
sim_compute_robot_state-npc3_mean	0.06701666966493261
sim_compute_robot_state-npc3_median	0.06725492477416992
sim_compute_robot_state-npc3_min	0.06527856102696171
sim_compute_sim_state_max	0.04162380525044033
sim_compute_sim_state_mean	0.03865512831976572
sim_compute_sim_state_median	0.03874717181241965
sim_compute_sim_state_min	0.03642476929558648
sim_physics_max	0.2041508215892164
sim_physics_mean	0.18012176646768557
sim_physics_median	0.17686760425567627
sim_physics_min	0.16139564249250624
sim_render-ego_max	0.06397633311114734
sim_render-ego_mean	0.0610588852181463
sim_render-ego_median	0.06011889169090673
sim_render-ego_min	0.05861088752746582
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

21294

2425

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-27 22:27:12+00:00

2019-04-27 22:36:14+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.13616217918766357
agent_compute-ego_mean	0.1297929602868869
agent_compute-ego_median	0.12910951541948923
agent_compute-ego_min	0.12387034722736905
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1935129195828981, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06227180625818952, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12910951541948923, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0899544094182268, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03687180748468713, "sim_compute_performance-ego": 0.06760724284980871, "sim_compute_robot_state-ego": 0.07166773759866063, "sim_compute_robot_state-npc0": 0.06439787828469579, "sim_compute_robot_state-npc1": 0.06420716454711141, "sim_compute_robot_state-npc2": 0.06690638880186443, "sim_compute_robot_state-npc3": 0.06595734403103212}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19821022238050187, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05648885454450335, "in-drivable-lane": 0, "agent_compute-ego": 0.12387034722736905, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0875729066984994, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0363891465323312, "sim_compute_performance-ego": 0.06477670158658709, "sim_compute_robot_state-ego": 0.07077563660485404, "sim_compute_robot_state-npc0": 0.06529634339468819, "sim_compute_robot_state-npc1": 0.06458933012826103, "sim_compute_robot_state-npc2": 0.06228772231510707, "sim_compute_robot_state-npc3": 0.06148659331457955}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20014904309244988, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06297825378121681, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13616217918766357, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09056707493309836, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03720861268274992, "sim_compute_performance-ego": 0.06995449945764634, "sim_compute_robot_state-ego": 0.07518389387038148, "sim_compute_robot_state-npc0": 0.06821316885716706, "sim_compute_robot_state-npc1": 0.06563235255121028, "sim_compute_robot_state-npc2": 0.06440583710531586, "sim_compute_robot_state-npc3": 0.06416711066533061}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2006469219923019, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05983698864777883, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12474338710308076, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08769627908865611, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.034866938988367714, "sim_compute_performance-ego": 0.06640402475992839, "sim_compute_robot_state-ego": 0.06541385253270467, "sim_compute_robot_state-npc0": 0.06294114391009013, "sim_compute_robot_state-npc1": 0.06483520567417145, "sim_compute_robot_state-npc2": 0.06788853804270427, "sim_compute_robot_state-npc3": 0.06664328277111053}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1822422004881359, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06292293185279482, "in-drivable-lane": 0, "agent_compute-ego": 0.135079372496832, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09712851615179152, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.035721994581676665, "sim_compute_performance-ego": 0.06559493428184873, "sim_compute_robot_state-ego": 0.06749341601417178, "sim_compute_robot_state-npc0": 0.06634565762111119, "sim_compute_robot_state-npc1": 0.06395184426080613, "sim_compute_robot_state-npc2": 0.06678432510012672, "sim_compute_robot_state-npc3": 0.067354645047869}}
set_robot_commands_max	0.09712851615179152
set_robot_commands_mean	0.09058383725805444
set_robot_commands_median	0.0899544094182268
set_robot_commands_min	0.0875729066984994
sim_compute_performance-ego_max	0.06995449945764634
sim_compute_performance-ego_mean	0.06686748058716385
sim_compute_performance-ego_median	0.06640402475992839
sim_compute_performance-ego_min	0.06477670158658709
sim_compute_robot_state-ego_max	0.07518389387038148
sim_compute_robot_state-ego_mean	0.07010690732415452
sim_compute_robot_state-ego_median	0.07077563660485404
sim_compute_robot_state-ego_min	0.06541385253270467
sim_compute_robot_state-npc0_max	0.06821316885716706
sim_compute_robot_state-npc0_mean	0.06543883841355047
sim_compute_robot_state-npc0_median	0.06529634339468819
sim_compute_robot_state-npc0_min	0.06294114391009013
sim_compute_robot_state-npc1_max	0.06563235255121028
sim_compute_robot_state-npc1_mean	0.06464317943231206
sim_compute_robot_state-npc1_median	0.06458933012826103
sim_compute_robot_state-npc1_min	0.06395184426080613
sim_compute_robot_state-npc2_max	0.06788853804270427
sim_compute_robot_state-npc2_mean	0.06565456227302367
sim_compute_robot_state-npc2_median	0.06678432510012672
sim_compute_robot_state-npc2_min	0.06228772231510707
sim_compute_robot_state-npc3_max	0.067354645047869
sim_compute_robot_state-npc3_mean	0.06512179516598438
sim_compute_robot_state-npc3_median	0.06595734403103212
sim_compute_robot_state-npc3_min	0.06148659331457955
sim_compute_sim_state_max	0.03720861268274992
sim_compute_sim_state_mean	0.03621170005396252
sim_compute_sim_state_median	0.0363891465323312
sim_compute_sim_state_min	0.034866938988367714
sim_physics_max	0.2006469219923019
sim_physics_mean	0.19495226150725756
sim_physics_median	0.19821022238050187
sim_physics_min	0.1822422004881359
sim_render-ego_max	0.06297825378121681
sim_render-ego_mean	0.060899767016896665
sim_render-ego_median	0.06227180625818952
sim_render-ego_min	0.05648885454450335
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21292

2444

Jacopo Tani

random_agent

step1-simulation

success

2019-04-27 22:17:24+00:00

2019-04-27 22:26:42+00:00

0:09:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.15260306426456996
agent_compute-ego_mean	0.144946022419625
agent_compute-ego_median	0.1445319773275641
agent_compute-ego_min	0.13864552627489404
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19031669821920277, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05799838561045973, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1445319773275641, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.08669218232360067, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.034742904614798634, "sim_compute_performance-ego": 0.06478452984290788, "sim_compute_robot_state-ego": 0.06663775444030762, "sim_compute_robot_state-npc0": 0.06390963325017615, "sim_compute_robot_state-npc1": 0.06555891338782975, "sim_compute_robot_state-npc2": 0.06126156034348886, "sim_compute_robot_state-npc3": 0.062448229970811286}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.18485125473567415, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.058072566986083984, "in-drivable-lane": 0, "agent_compute-ego": 0.15260306426456996, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0872237937791007, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03806166989462716, "sim_compute_performance-ego": 0.06466484069824219, "sim_compute_robot_state-ego": 0.06997741971697126, "sim_compute_robot_state-npc0": 0.060983087335314067, "sim_compute_robot_state-npc1": 0.06341677904129028, "sim_compute_robot_state-npc2": 0.061906635761260986, "sim_compute_robot_state-npc3": 0.06413017851965767}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18037520797507275, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06117229322785313, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13864552627489404, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08930068108641985, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.0379324468594153, "sim_compute_performance-ego": 0.06758189432829328, "sim_compute_robot_state-ego": 0.06903930080747142, "sim_compute_robot_state-npc0": 0.06712323485068905, "sim_compute_robot_state-npc1": 0.06579579890353009, "sim_compute_robot_state-npc2": 0.065303610366525, "sim_compute_robot_state-npc3": 0.06982454744357507}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.20597457885742188, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05934753020604452, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14512647688388824, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08965061604976654, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03936577339967092, "sim_compute_performance-ego": 0.07125039398670197, "sim_compute_robot_state-ego": 0.07230402032534282, "sim_compute_robot_state-npc0": 0.06531766057014465, "sim_compute_robot_state-npc1": 0.06924015283584595, "sim_compute_robot_state-npc2": 0.06937479476133983, "sim_compute_robot_state-npc3": 0.06370679040749867}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.188895168758574, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0577481814793178, "in-drivable-lane": 0, "agent_compute-ego": 0.14382306734720865, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09289967446100145, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03799748420715332, "sim_compute_performance-ego": 0.06419899350120908, "sim_compute_robot_state-ego": 0.06577360062372117, "sim_compute_robot_state-npc0": 0.06971758887881324, "sim_compute_robot_state-npc1": 0.066230989637829, "sim_compute_robot_state-npc2": 0.0688791275024414, "sim_compute_robot_state-npc3": 0.06627154350280762}}
set_robot_commands_max	0.09289967446100145
set_robot_commands_mean	0.08915338953997784
set_robot_commands_median	0.08930068108641985
set_robot_commands_min	0.08669218232360067
sim_compute_performance-ego_max	0.07125039398670197
sim_compute_performance-ego_mean	0.06649613047147088
sim_compute_performance-ego_median	0.06478452984290788
sim_compute_performance-ego_min	0.06419899350120908
sim_compute_robot_state-ego_max	0.07230402032534282
sim_compute_robot_state-ego_mean	0.06874641918276285
sim_compute_robot_state-ego_median	0.06903930080747142
sim_compute_robot_state-ego_min	0.06577360062372117
sim_compute_robot_state-npc0_max	0.06971758887881324
sim_compute_robot_state-npc0_mean	0.06541024097702744
sim_compute_robot_state-npc0_median	0.06531766057014465
sim_compute_robot_state-npc0_min	0.060983087335314067
sim_compute_robot_state-npc1_max	0.06924015283584595
sim_compute_robot_state-npc1_mean	0.06604852676126502
sim_compute_robot_state-npc1_median	0.06579579890353009
sim_compute_robot_state-npc1_min	0.06341677904129028
sim_compute_robot_state-npc2_max	0.06937479476133983
sim_compute_robot_state-npc2_mean	0.06534514574701122
sim_compute_robot_state-npc2_median	0.065303610366525
sim_compute_robot_state-npc2_min	0.06126156034348886
sim_compute_robot_state-npc3_max	0.06982454744357507
sim_compute_robot_state-npc3_mean	0.06527625796887007
sim_compute_robot_state-npc3_median	0.06413017851965767
sim_compute_robot_state-npc3_min	0.062448229970811286
sim_compute_sim_state_max	0.03936577339967092
sim_compute_sim_state_mean	0.03762005579513307
sim_compute_sim_state_median	0.03799748420715332
sim_compute_sim_state_min	0.034742904614798634
sim_physics_max	0.20597457885742188
sim_physics_mean	0.19008258170918912
sim_physics_median	0.188895168758574
sim_physics_min	0.18037520797507275
sim_render-ego_max	0.06117229322785313
sim_render-ego_mean	0.05886779150195183
sim_render-ego_median	0.058072566986083984
sim_render-ego_min	0.0577481814793178
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21276

2439

Jacopo Tani

random_agent

step1-simulation

success

2019-04-27 22:00:28+00:00

2019-04-27 22:17:03+00:00

0:16:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.18839548615848317
agent_compute-ego_mean	0.14818823475741988
agent_compute-ego_median	0.14130424985698625
agent_compute-ego_min	0.12211100578308104
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13821983337402344, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.07074145917539243, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17540508287924308, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1109763118955824, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04459614665419967, "sim_compute_performance-ego": 0.07875475177058468, "sim_compute_robot_state-ego": 0.08436755780820493}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13793298777411966, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.07240140204336129, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.18839548615848317, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.11929893493652344, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04534232382680856, "sim_compute_performance-ego": 0.08113959256340475, "sim_compute_robot_state-ego": 0.08655806616240856}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1434623634113985, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07371772036832921, "in-drivable-lane": 0, "agent_compute-ego": 0.18051569602068732, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.121689333635218, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04565624629749971, "sim_compute_performance-ego": 0.07872359892901253, "sim_compute_robot_state-ego": 0.08364444620469037}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.09363405227661133, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0465594482421875, "in-drivable-lane": 0, "agent_compute-ego": 0.12211100578308104, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07046550750732422, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.032758054733276365, "sim_compute_performance-ego": 0.050793304443359374, "sim_compute_robot_state-ego": 0.05499303817749023}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.08981039554257936, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05477074429958682, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1339273633836191, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08363035962551454, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03565757485884655, "sim_compute_performance-ego": 0.05860485004473336, "sim_compute_robot_state-ego": 0.06184602387343781}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.11945749302299656, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.0626278848064189, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.14968388421194895, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08943114475328096, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03793659015577667, "sim_compute_performance-ego": 0.0696492000501983, "sim_compute_robot_state-ego": 0.0695816351442921}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10359858189310346, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.05711136545453753, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15166164296013968, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08910208089011055, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.038481776203428, "sim_compute_performance-ego": 0.0645621759550912, "sim_compute_robot_state-ego": 0.07156723737716675}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.11884127344403948, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.061372075762067525, "in-drivable-lane": 0, "agent_compute-ego": 0.14022610301063174, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.07981994038536436, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03911005882989792, "sim_compute_performance-ego": 0.06393458729698545, "sim_compute_robot_state-ego": 0.06844325292678106}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.10326078786688336, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.058711912672398454, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1392129235348459, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.0903078499486891, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.036664514218346544, "sim_compute_performance-ego": 0.06319721674515029, "sim_compute_robot_state-ego": 0.06858880236997443}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.08210620880126954, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.04568971720608798, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.12270610115744852, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.06980525797063654, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.02988827878778631, "sim_compute_performance-ego": 0.04945028044960715, "sim_compute_robot_state-ego": 0.051570289785211734}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.12271464025819456, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06271619610972219, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14896915485332538, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.09804501471581398, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03968281250495415, "sim_compute_performance-ego": 0.07014252922751686, "sim_compute_robot_state-ego": 0.08038894851486404}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.10682567528315952, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.0552982006754194, "in-drivable-lane": 0, "agent_compute-ego": 0.14095960344587052, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08205887249537877, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03576014723096575, "sim_compute_performance-ego": 0.06569917712892805, "sim_compute_robot_state-ego": 0.06636097601481847}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10412022646735695, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05621024674060298, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.14130424985698625, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.08386080405291389, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03773352679084329, "sim_compute_performance-ego": 0.059113324857225605, "sim_compute_robot_state-ego": 0.07346551091063257}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.11442622432002315, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05261479483710395, "in-drivable-lane": 0, "agent_compute-ego": 0.13676574495103624, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.08360143061037417, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.032682436483877676, "sim_compute_performance-ego": 0.06721261695579246, "sim_compute_robot_state-ego": 0.06648619969685872}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.11704026951509364, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06197423560946595, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15097947915395102, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09536134962942086, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.040969441918765795, "sim_compute_performance-ego": 0.0685878501218908, "sim_compute_robot_state-ego": 0.0765683417226754}}
set_robot_commands_max	0.121689333635218
set_robot_commands_mean	0.09116361287014305
set_robot_commands_median	0.08910208089011055
set_robot_commands_min	0.06980525797063654
sim_compute_performance-ego_max	0.08113959256340475
sim_compute_performance-ego_mean	0.06597100376929874
sim_compute_performance-ego_median	0.06569917712892805
sim_compute_performance-ego_min	0.04945028044960715
sim_compute_robot_state-ego_max	0.08655806616240856
sim_compute_robot_state-ego_mean	0.07096202177930049
sim_compute_robot_state-ego_median	0.0695816351442921
sim_compute_robot_state-ego_min	0.051570289785211734
sim_compute_sim_state_max	0.04565624629749971
sim_compute_sim_state_mean	0.03819466196635154
sim_compute_sim_state_median	0.03793659015577667
sim_compute_sim_state_min	0.02988827878778631
sim_physics_max	0.1434623634113985
sim_physics_mean	0.11303006755005686
sim_physics_median	0.11442622432002315
sim_physics_min	0.08210620880126954
sim_render-ego_max	0.07371772036832921
sim_render-ego_mean	0.05950116026684547
sim_render-ego_median	0.058711912672398454
sim_render-ego_min	0.04568971720608798
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21267

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 21:40:22+00:00

2019-04-27 22:00:11+00:00

0:19:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-42-167-7357-job21267/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21253

2467

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 21:25:33+00:00

2019-04-27 21:40:08+00:00

0:14:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17604724566141763
agent_compute-ego_mean	0.14103665622679765
agent_compute-ego_median	0.1444349799837385
agent_compute-ego_min	0.09189841326545269
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08636335090354637, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05029099075882523, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11650794523733632, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.06900646068431714, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.031948729797645854, "sim_compute_performance-ego": 0.054771379188255025, "sim_compute_robot_state-ego": 0.05745542932439734}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11873413067238003, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060907658408669865, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15385857282900342, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09236850458032944, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0391090897952809, "sim_compute_performance-ego": 0.06920137124903061, "sim_compute_robot_state-ego": 0.07628666653352625}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.07560641625348259, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0428317154155058, "in-drivable-lane": 0, "agent_compute-ego": 0.09189841326545269, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0555116569294649, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02603307892294491, "sim_compute_performance-ego": 0.04430550687453326, "sim_compute_robot_state-ego": 0.047182588016285616}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12359095573425292, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.060592327117919925, "in-drivable-lane": 0, "agent_compute-ego": 0.1549161911010742, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08703546524047852, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03752797126770019, "sim_compute_performance-ego": 0.06507064819335938, "sim_compute_robot_state-ego": 0.06791294097900391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09870794453198396, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05242327798770953, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13090053992935374, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.07828823524185374, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03517501867270168, "sim_compute_performance-ego": 0.05770087242126465, "sim_compute_robot_state-ego": 0.06343518329572075}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.08993087496076312, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.052456695206311285, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.13062647897370008, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08783296176365443, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03415954356290856, "sim_compute_performance-ego": 0.05897953558941277, "sim_compute_robot_state-ego": 0.05961125237601144}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.11070423892566136, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06302550009318761, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1444349799837385, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.09677886962890624, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03752193706376212, "sim_compute_performance-ego": 0.06911830391202654, "sim_compute_robot_state-ego": 0.07597804921013969}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.1270173958369664, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.059208892640613374, "in-drivable-lane": 0, "agent_compute-ego": 0.1586033162616548, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10112858953930084, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.0391330151330857, "sim_compute_performance-ego": 0.07456551279340472, "sim_compute_robot_state-ego": 0.0714834871746245}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.10832750595222083, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05745978678687144, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14621018959304033, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.08737583079580534, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.0372802160554013, "sim_compute_performance-ego": 0.06420618396694378, "sim_compute_robot_state-ego": 0.06722534713098559}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.10647028576244008, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.058718937093561345, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.14746064272793857, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.08690648078918457, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03648154518821023, "sim_compute_performance-ego": 0.06789287653836337, "sim_compute_robot_state-ego": 0.06954125924543901}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.10937462534223284, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05424920924298175, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1428874127276532, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.08664470833617371, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03767554790942699, "sim_compute_performance-ego": 0.06205802768855899, "sim_compute_robot_state-ego": 0.06869715839237361}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.11800294263022286, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06201225519180298, "in-drivable-lane": 0, "agent_compute-ego": 0.13374797786985124, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.0803459712437221, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.033059511865888326, "sim_compute_performance-ego": 0.06865862437656947, "sim_compute_robot_state-ego": 0.06927425520760673}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10621346679388308, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.060375882130043176, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.13413283404181986, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.08679512435314703, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.037339551776063205, "sim_compute_performance-ego": 0.0646532376607259, "sim_compute_robot_state-ego": 0.06377037366231282}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.14846244564762823, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06724611035099735, "in-drivable-lane": 0, "agent_compute-ego": 0.17604724566141763, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10776984250103984, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04369323341934769, "sim_compute_performance-ego": 0.07598464577286332, "sim_compute_robot_state-ego": 0.0943950988628246}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.1055076239155788, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06263116294262457, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15331710319893033, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.0957775536705466, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03924457232157389, "sim_compute_performance-ego": 0.06974422931671143, "sim_compute_robot_state-ego": 0.0740193058462704}}
set_robot_commands_max	0.10776984250103984
set_robot_commands_mean	0.08663775035319496
set_robot_commands_median	0.08703546524047852
set_robot_commands_min	0.0555116569294649
sim_compute_performance-ego_max	0.07598464577286332
sim_compute_performance-ego_mean	0.06446073036946821
sim_compute_performance-ego_median	0.06507064819335938
sim_compute_performance-ego_min	0.04430550687453326
sim_compute_robot_state-ego_max	0.0943950988628246
sim_compute_robot_state-ego_mean	0.06841789301716815
sim_compute_robot_state-ego_median	0.06869715839237361
sim_compute_robot_state-ego_min	0.047182588016285616
sim_compute_sim_state_max	0.04369323341934769
sim_compute_sim_state_mean	0.036358837516796104
sim_compute_sim_state_median	0.037339551776063205
sim_compute_sim_state_min	0.02603307892294491
sim_physics_max	0.14846244564762823
sim_physics_mean	0.10886761359088289
sim_physics_median	0.10832750595222083
sim_physics_min	0.07560641625348259
sim_render-ego_max	0.06724611035099735
sim_render-ego_mean	0.057628693424508354
sim_render-ego_median	0.059208892640613374
sim_render-ego_min	0.0428317154155058
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21240

2495

Liam Paull 🇨🇦

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 21:10:37+00:00

2019-04-27 21:24:54+00:00

0:14:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07968660528663696
survival_time_median	1.2000000000000004
deviation-center-line_median	0.07611691581775067
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.17677677196005118
agent_compute-ego_mean	0.1519670114959635
agent_compute-ego_median	0.15347912094809793
agent_compute-ego_min	0.1193694273630778
deviation-center-line_max	0.09627104004132828
deviation-center-line_mean	0.07427483215300637
deviation-center-line_min	0.0459248836603353
deviation-heading_max	0.9346314192447778
deviation-heading_mean	0.7277730499929109
deviation-heading_median	0.7594427517427644
deviation-heading_min	0.5227507875290646
driven_any_max	0.24239365835143872
driven_any_mean	0.16042804536475108
driven_any_median	0.1370056416082507
driven_any_min	0.10521756458412442
driven_lanedir_consec_max	0.15457497851859925
driven_lanedir_consec_mean	0.08786745137497634
driven_lanedir_consec_min	0.048383450412528894
driven_lanedir_max	0.15457497851859925
driven_lanedir_mean	0.08786745137497634
driven_lanedir_median	0.07968660528663696
driven_lanedir_min	0.048383450412528894
in-drivable-lane_max	0.6500000000000006
in-drivable-lane_mean	0.13333333333333344
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2221876422486047, "sim_physics": 0.17875210898263114, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07578637203144467, "sim_render-ego": 0.06027131080627442, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16297286578587122, "deviation-heading": 0.7676548075802966, "set_robot_commands": 0.09119725908551896, "deviation-center-line": 0.06345830379339204, "driven_lanedir_consec": 0.07578637203144467, "sim_compute_sim_state": 0.03772357531956264, "sim_compute_performance-ego": 0.06719870567321777, "sim_compute_robot_state-ego": 0.06951024191720145, "sim_compute_robot_state-npc0": 0.06665641239711216, "sim_compute_robot_state-npc1": 0.06578297615051269, "sim_compute_robot_state-npc2": 0.06655471665518624, "sim_compute_robot_state-npc3": 0.07032465253557478}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19915254875033747, "sim_physics": 0.15623399705597849, "survival_time": 1.6500000000000008, "driven_lanedir": 0.048383450412528894, "sim_render-ego": 0.05699193116390344, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.14506973642291446, "deviation-heading": 0.7594427517427644, "set_robot_commands": 0.08361090313304555, "deviation-center-line": 0.05279899839029909, "driven_lanedir_consec": 0.048383450412528894, "sim_compute_sim_state": 0.03633515762560295, "sim_compute_performance-ego": 0.06298221241344105, "sim_compute_robot_state-ego": 0.07093801642909195, "sim_compute_robot_state-npc0": 0.06218975963014545, "sim_compute_robot_state-npc1": 0.06522349877790971, "sim_compute_robot_state-npc2": 0.06766947832974521, "sim_compute_robot_state-npc3": 0.06658463044600053}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1129155018825549, "sim_physics": 0.19765512509779495, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07935837137228008, "sim_render-ego": 0.06303747133775191, "in-drivable-lane": 0, "agent_compute-ego": 0.16468007998033005, "deviation-heading": 0.5227507875290646, "set_robot_commands": 0.09025528214194556, "deviation-center-line": 0.09627104004132828, "driven_lanedir_consec": 0.07935837137228008, "sim_compute_sim_state": 0.03770444609902122, "sim_compute_performance-ego": 0.06549950079484419, "sim_compute_robot_state-ego": 0.08226022937081078, "sim_compute_robot_state-npc0": 0.0683451999317516, "sim_compute_robot_state-npc1": 0.06440181081945245, "sim_compute_robot_state-npc2": 0.06437353654341264, "sim_compute_robot_state-npc3": 0.06484370881860907}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10521756458412442, "sim_physics": 0.1929247812791304, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06818727414579051, "sim_render-ego": 0.05926255746321245, "in-drivable-lane": 0, "agent_compute-ego": 0.15347912094809793, "deviation-heading": 0.5563157019235696, "set_robot_commands": 0.08738555691458962, "deviation-center-line": 0.09069576420228502, "driven_lanedir_consec": 0.06818727414579051, "sim_compute_sim_state": 0.03972762281244451, "sim_compute_performance-ego": 0.06250630725513805, "sim_compute_robot_state-ego": 0.0629228570244529, "sim_compute_robot_state-npc0": 0.06019509922374378, "sim_compute_robot_state-npc1": 0.06242104010148482, "sim_compute_robot_state-npc2": 0.06297945976257324, "sim_compute_robot_state-npc3": 0.06346303766424005}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1208897065678006, "sim_physics": 0.1214630292809528, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05347974691090085, "sim_render-ego": 0.045535129049549934, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1256290518719217, "deviation-heading": 0.8384887994574305, "set_robot_commands": 0.07407934769340184, "deviation-center-line": 0.0459248836603353, "driven_lanedir_consec": 0.05347974691090085, "sim_compute_sim_state": 0.028913829637610394, "sim_compute_performance-ego": 0.054017823675404426, "sim_compute_robot_state-ego": 0.05761110264322032, "sim_compute_robot_state-npc0": 0.05362517937369968, "sim_compute_robot_state-npc1": 0.051763814428578254, "sim_compute_robot_state-npc2": 0.049227756002674934, "sim_compute_robot_state-npc3": 0.05226062691730002}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.23907435600747637, "sim_physics": 0.1373373167855399, "survival_time": 1.7500000000000009, "driven_lanedir": 0.1349516251697307, "sim_render-ego": 0.056629269463675365, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.146992894581386, "deviation-heading": 0.8904263547957212, "set_robot_commands": 0.0786275931767055, "deviation-center-line": 0.07169328232555265, "driven_lanedir_consec": 0.1349516251697307, "sim_compute_sim_state": 0.033433049065726146, "sim_compute_performance-ego": 0.06347669873918806, "sim_compute_robot_state-ego": 0.06636513301304409, "sim_compute_robot_state-npc0": 0.06076982361929757, "sim_compute_robot_state-npc1": 0.05914199692862374, "sim_compute_robot_state-npc2": 0.062132317679268974, "sim_compute_robot_state-npc3": 0.05991567202976772}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12071273636535047, "sim_physics": 0.13477583365006882, "survival_time": 1.1000000000000003, "driven_lanedir": 0.0818806250250339, "sim_render-ego": 0.045809940858320755, "in-drivable-lane": 0, "agent_compute-ego": 0.1459317315708507, "deviation-heading": 0.5764143216303912, "set_robot_commands": 0.07593917846679688, "deviation-center-line": 0.07846041171762767, "driven_lanedir_consec": 0.0818806250250339, "sim_compute_sim_state": 0.026900876652110703, "sim_compute_performance-ego": 0.0498809272592718, "sim_compute_robot_state-ego": 0.05300203236666592, "sim_compute_robot_state-npc0": 0.04833573644811457, "sim_compute_robot_state-npc1": 0.047572786157781426, "sim_compute_robot_state-npc2": 0.04937142675573176, "sim_compute_robot_state-npc3": 0.046356157823042435}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.116853695866203, "sim_physics": 0.21070505181948343, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07968660528663696, "sim_render-ego": 0.06262053052584331, "in-drivable-lane": 0, "agent_compute-ego": 0.17481245597203574, "deviation-heading": 0.6396453122102181, "set_robot_commands": 0.10495501756668092, "deviation-center-line": 0.09349582399489366, "driven_lanedir_consec": 0.07968660528663696, "sim_compute_sim_state": 0.04278994599978129, "sim_compute_performance-ego": 0.0682231883207957, "sim_compute_robot_state-ego": 0.07707331577936809, "sim_compute_robot_state-npc0": 0.06864480177561443, "sim_compute_robot_state-npc1": 0.06633354226748149, "sim_compute_robot_state-npc2": 0.06913075844446818, "sim_compute_robot_state-npc3": 0.0686887005964915}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2215286862315604, "sim_physics": 0.2105605371536747, "survival_time": 1.5500000000000007, "driven_lanedir": 0.15457497851859925, "sim_render-ego": 0.06258345419360746, "in-drivable-lane": 0, "agent_compute-ego": 0.17259450112619706, "deviation-heading": 0.881768815063205, "set_robot_commands": 0.0896367565278084, "deviation-center-line": 0.07019100232573273, "driven_lanedir_consec": 0.15457497851859925, "sim_compute_sim_state": 0.0378578862836284, "sim_compute_performance-ego": 0.07005939945097893, "sim_compute_robot_state-ego": 0.0785317805505568, "sim_compute_robot_state-npc0": 0.09260972084537628, "sim_compute_robot_state-npc1": 0.06839669904401226, "sim_compute_robot_state-npc2": 0.0714694376914732, "sim_compute_robot_state-npc3": 0.06866033615604523}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1641952391119638, "sim_physics": 0.1252529239654541, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09282464622938448, "sim_render-ego": 0.04668309211730957, "in-drivable-lane": 0, "agent_compute-ego": 0.12061829566955566, "deviation-heading": 0.9201679280918876, "set_robot_commands": 0.06526164054870605, "deviation-center-line": 0.06316699481359707, "driven_lanedir_consec": 0.09282464622938448, "sim_compute_sim_state": 0.02619553565979004, "sim_compute_performance-ego": 0.050743942260742185, "sim_compute_robot_state-ego": 0.05214596748352051, "sim_compute_robot_state-npc0": 0.050286483764648435, "sim_compute_robot_state-npc1": 0.04979669570922852, "sim_compute_robot_state-npc2": 0.05052759170532226, "sim_compute_robot_state-npc3": 0.0478201961517334}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.13542019998890562, "sim_physics": 0.14321855703989664, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05385463455625672, "sim_render-ego": 0.04181179404258728, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1193694273630778, "deviation-heading": 0.9346314192447778, "set_robot_commands": 0.06220475832621256, "deviation-center-line": 0.047299844807480354, "driven_lanedir_consec": 0.05385463455625672, "sim_compute_sim_state": 0.02786281704902649, "sim_compute_performance-ego": 0.0448094109694163, "sim_compute_robot_state-ego": 0.04778599739074707, "sim_compute_robot_state-npc0": 0.04685805241266886, "sim_compute_robot_state-npc1": 0.04452162981033325, "sim_compute_robot_state-npc2": 0.04884726802508036, "sim_compute_robot_state-npc3": 0.044694711764653526}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.10750533216448294, "sim_physics": 0.15639687776565553, "survival_time": 1.0000000000000002, "driven_lanedir": 0.07148435863602254, "sim_render-ego": 0.05644594430923462, "in-drivable-lane": 0, "agent_compute-ego": 0.16240862607955933, "deviation-heading": 0.5596174758982276, "set_robot_commands": 0.08955326080322265, "deviation-center-line": 0.08703719411921414, "driven_lanedir_consec": 0.07148435863602254, "sim_compute_sim_state": 0.0364471435546875, "sim_compute_performance-ego": 0.05988873243331909, "sim_compute_robot_state-ego": 0.06679120063781738, "sim_compute_robot_state-npc0": 0.06822129487991332, "sim_compute_robot_state-npc1": 0.06729438304901122, "sim_compute_robot_state-npc2": 0.06431452035903931, "sim_compute_robot_state-npc3": 0.06467206478118896}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.24239365835143872, "sim_physics": 0.17054875900870875, "survival_time": 1.900000000000001, "driven_lanedir": 0.10792325468096686, "sim_render-ego": 0.05752513910594739, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1505509050268876, "deviation-heading": 0.8113096317148016, "set_robot_commands": 0.08779105387235943, "deviation-center-line": 0.07611691581775067, "driven_lanedir_consec": 0.10792325468096686, "sim_compute_sim_state": 0.03624655698475085, "sim_compute_performance-ego": 0.06250870855231035, "sim_compute_robot_state-ego": 0.06694960594177246, "sim_compute_robot_state-npc0": 0.062487508121289705, "sim_compute_robot_state-npc1": 0.06280542047400224, "sim_compute_robot_state-npc2": 0.06319611323507209, "sim_compute_robot_state-npc3": 0.06348768033479389}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1370056416082507, "sim_physics": 0.1987845690354057, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09804582411851824, "sim_render-ego": 0.06397635003794795, "in-drivable-lane": 0, "agent_compute-ego": 0.17677677196005118, "deviation-heading": 0.5590188259779947, "set_robot_commands": 0.0874500792959462, "deviation-center-line": 0.0916591981793876, "driven_lanedir_consec": 0.09804582411851824, "sim_compute_sim_state": 0.04028159639109736, "sim_compute_performance-ego": 0.07179306901019553, "sim_compute_robot_state-ego": 0.08113788521808127, "sim_compute_robot_state-npc0": 0.06459576150645381, "sim_compute_robot_state-npc1": 0.06541952879532524, "sim_compute_robot_state-npc2": 0.06654328885285751, "sim_compute_robot_state-npc3": 0.06699766283449919}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.16136817074221171, "sim_physics": 0.1631707085503472, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11759000353055038, "sim_render-ego": 0.05612853721336082, "in-drivable-lane": 0, "agent_compute-ego": 0.1576187080807156, "deviation-heading": 0.6989428170333163, "set_robot_commands": 0.0915546417236328, "deviation-center-line": 0.08585282410621915, "driven_lanedir_consec": 0.11759000353055038, "sim_compute_sim_state": 0.03842501287107115, "sim_compute_performance-ego": 0.06627287688078703, "sim_compute_robot_state-ego": 0.06290510848716453, "sim_compute_robot_state-npc0": 0.06620795638472945, "sim_compute_robot_state-npc1": 0.06709177405745895, "sim_compute_robot_state-npc2": 0.065165051707515, "sim_compute_robot_state-npc3": 0.07004019066139504}}
set_robot_commands_max	0.10495501756668092
set_robot_commands_mean	0.08396682195177153
set_robot_commands_median	0.0874500792959462
set_robot_commands_min	0.06220475832621256
sim_compute_performance-ego_max	0.07179306901019553
sim_compute_performance-ego_mean	0.0613241002459367
sim_compute_performance-ego_median	0.06298221241344105
sim_compute_performance-ego_min	0.0448094109694163
sim_compute_robot_state-ego_max	0.08226022937081078
sim_compute_robot_state-ego_mean	0.06639536495023438
sim_compute_robot_state-ego_median	0.06679120063781738
sim_compute_robot_state-ego_min	0.04778599739074707
sim_compute_robot_state-npc0_max	0.09260972084537628
sim_compute_robot_state-npc0_mean	0.06266858602097061
sim_compute_robot_state-npc0_median	0.062487508121289705
sim_compute_robot_state-npc0_min	0.04685805241266886
sim_compute_robot_state-npc1_max	0.06839669904401226
sim_compute_robot_state-npc1_mean	0.06053117310474642
sim_compute_robot_state-npc1_median	0.06440181081945245
sim_compute_robot_state-npc1_min	0.04452162981033325
sim_compute_robot_state-npc2_max	0.0714694376914732
sim_compute_robot_state-npc2_mean	0.06143351478329473
sim_compute_robot_state-npc2_median	0.06431452035903931
sim_compute_robot_state-npc2_min	0.04884726802508036
sim_compute_robot_state-npc3_max	0.07032465253557478
sim_compute_robot_state-npc3_mean	0.06125400196768902
sim_compute_robot_state-npc3_median	0.06467206478118896
sim_compute_robot_state-npc3_min	0.044694711764653526
sim_compute_sim_state_max	0.04278994599978129
sim_compute_sim_state_mean	0.03512300346706078
sim_compute_sim_state_median	0.0364471435546875
sim_compute_sim_state_min	0.02619553565979004
sim_physics_max	0.21070505181948343
sim_physics_mean	0.16651867843138152
sim_physics_median	0.1631707085503472
sim_physics_min	0.1214630292809528
sim_render-ego_max	0.06397635003794795
sim_render-ego_mean	0.05568749677923512
sim_render-ego_median	0.05699193116390344
sim_render-ego_min	0.04181179404258728
simulation-passed	1
survival_time_max	1.900000000000001
survival_time_mean	1.3466666666666671
survival_time_min	1.0000000000000002

No reset possible

21232

2503

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:09:15+00:00

2019-04-27 21:09:55+00:00

0:00:40

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21227

2508

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:08:05+00:00

2019-04-27 21:08:42+00:00

0:00:37

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21225

2513

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:07:07+00:00

2019-04-27 21:07:52+00:00

0:00:45

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21221

2521

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 21:06:27+00:00

2019-04-27 21:07:00+00:00

0:00:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21204

2538

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 21:00:42+00:00

2019-04-27 21:06:06+00:00

0:05:24

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21171

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 20:02:52+00:00

2019-04-27 21:00:14+00:00

0:57:22

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-42-167-7357-job21171/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21156

2582

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 20:00:26+00:00

2019-04-27 20:02:37+00:00

0:02:11

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21139

2612

Konstantin Chaika

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-27 19:36:15+00:00

2019-04-27 20:00:04+00:00

0:23:49

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2612/step1-simulation-ip-172-31-42-167-7357-job21139/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21136

2617

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 19:30:18+00:00

2019-04-27 19:35:48+00:00

0:05:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15569708861556708
agent_compute-ego_mean	0.1459210335337607
agent_compute-ego_median	0.14777557457549662
agent_compute-ego_min	0.13371382040136
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10490158310642948, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059363206227620445, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15493829162032516, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0888405199404116, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03804092937045627, "sim_compute_performance-ego": 0.07090285530796757, "sim_compute_robot_state-ego": 0.06998932803118671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12782775654512293, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06112170219421387, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15569708861556708, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0971838913711847, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0455629217858408, "sim_compute_performance-ego": 0.06557986783046349, "sim_compute_robot_state-ego": 0.07727192429935231}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.12475162393906536, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05607959803412942, "in-drivable-lane": 0, "agent_compute-ego": 0.13371382040136, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08473521120408002, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03721973475287942, "sim_compute_performance-ego": 0.061429865220013785, "sim_compute_robot_state-ego": 0.06590941373039694}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11733502388000489, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05774788856506348, "in-drivable-lane": 0, "agent_compute-ego": 0.1374803924560547, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09564239501953126, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03648118019104004, "sim_compute_performance-ego": 0.06248193740844726, "sim_compute_robot_state-ego": 0.0674617862701416}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10397213621984554, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05634922015516064, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14777557457549662, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.092125614987144, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037278513365154024, "sim_compute_performance-ego": 0.06345074991636639, "sim_compute_robot_state-ego": 0.067136028144933}}
set_robot_commands_max	0.0971838913711847
set_robot_commands_mean	0.09170552650447032
set_robot_commands_median	0.092125614987144
set_robot_commands_min	0.08473521120408002
sim_compute_performance-ego_max	0.07090285530796757
sim_compute_performance-ego_mean	0.06476905513665171
sim_compute_performance-ego_median	0.06345074991636639
sim_compute_performance-ego_min	0.061429865220013785
sim_compute_robot_state-ego_max	0.07727192429935231
sim_compute_robot_state-ego_mean	0.06955369609520212
sim_compute_robot_state-ego_median	0.0674617862701416
sim_compute_robot_state-ego_min	0.06590941373039694
sim_compute_sim_state_max	0.0455629217858408
sim_compute_sim_state_mean	0.03891665589307411
sim_compute_sim_state_median	0.037278513365154024
sim_compute_sim_state_min	0.03648118019104004
sim_physics_max	0.12782775654512293
sim_physics_mean	0.11575762473809365
sim_physics_median	0.11733502388000489
sim_physics_min	0.10397213621984554
sim_render-ego_max	0.06112170219421387
sim_render-ego_mean	0.058132323035237576
sim_render-ego_median	0.05774788856506348
sim_render-ego_min	0.05607959803412942
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21132

2625

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 19:20:16+00:00

2019-04-27 19:29:08+00:00

0:08:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.15062864124774933
agent_compute-ego_mean	0.1395985574907672
agent_compute-ego_median	0.14056094386909582
agent_compute-ego_min	0.1284192715372358
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.18450969382177423, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.058892500551441046, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14056094386909582, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09203818478161777, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03776932064490982, "sim_compute_performance-ego": 0.06414000293876551, "sim_compute_robot_state-ego": 0.07324021073836315, "sim_compute_robot_state-npc0": 0.0673544678506972, "sim_compute_robot_state-npc1": 0.06566774392429786, "sim_compute_robot_state-npc2": 0.06422750557525249, "sim_compute_robot_state-npc3": 0.0629557265511042}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.16792150906154088, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.055701145103999546, "in-drivable-lane": 0, "agent_compute-ego": 0.1284192715372358, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08431561504091535, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03185391426086426, "sim_compute_performance-ego": 0.05477502516337803, "sim_compute_robot_state-ego": 0.06418352467673165, "sim_compute_robot_state-npc0": 0.060691731316702704, "sim_compute_robot_state-npc1": 0.06163686513900757, "sim_compute_robot_state-npc2": 0.057966019426073344, "sim_compute_robot_state-npc3": 0.057551486151559014}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.17656945256353582, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05804396138607877, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14322192923536578, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08481897891146466, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.035549300388225076, "sim_compute_performance-ego": 0.06362841198745284, "sim_compute_robot_state-ego": 0.06610040294313893, "sim_compute_robot_state-npc0": 0.06340469665897702, "sim_compute_robot_state-npc1": 0.0648880768748163, "sim_compute_robot_state-npc2": 0.064028605674077, "sim_compute_robot_state-npc3": 0.06203092649145034}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.21765494346618652, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06111153463522593, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15062864124774933, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09126131236553192, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.040860310196876526, "sim_compute_performance-ego": 0.06896886726220448, "sim_compute_robot_state-ego": 0.07593127091725667, "sim_compute_robot_state-npc0": 0.06676909824212392, "sim_compute_robot_state-npc1": 0.06511455277601878, "sim_compute_robot_state-npc2": 0.06423294544219971, "sim_compute_robot_state-npc3": 0.06379542251427968}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20241892905462355, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.057745263690040224, "in-drivable-lane": 0, "agent_compute-ego": 0.13516200156438918, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09277986344837008, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03996431259881882, "sim_compute_performance-ego": 0.06586305300394694, "sim_compute_robot_state-ego": 0.06924273854210264, "sim_compute_robot_state-npc0": 0.07050742421831403, "sim_compute_robot_state-npc1": 0.0692770140511649, "sim_compute_robot_state-npc2": 0.07258320990062896, "sim_compute_robot_state-npc3": 0.07133159183320545}}
set_robot_commands_max	0.09277986344837008
set_robot_commands_mean	0.08904279090957995
set_robot_commands_median	0.09126131236553192
set_robot_commands_min	0.08431561504091535
sim_compute_performance-ego_max	0.06896886726220448
sim_compute_performance-ego_mean	0.06347507207114957
sim_compute_performance-ego_median	0.06414000293876551
sim_compute_performance-ego_min	0.05477502516337803
sim_compute_robot_state-ego_max	0.07593127091725667
sim_compute_robot_state-ego_mean	0.0697396295635186
sim_compute_robot_state-ego_median	0.06924273854210264
sim_compute_robot_state-ego_min	0.06418352467673165
sim_compute_robot_state-npc0_max	0.07050742421831403
sim_compute_robot_state-npc0_mean	0.06574548365736296
sim_compute_robot_state-npc0_median	0.06676909824212392
sim_compute_robot_state-npc0_min	0.060691731316702704
sim_compute_robot_state-npc1_max	0.0692770140511649
sim_compute_robot_state-npc1_mean	0.06531685055306109
sim_compute_robot_state-npc1_median	0.06511455277601878
sim_compute_robot_state-npc1_min	0.06163686513900757
sim_compute_robot_state-npc2_max	0.07258320990062896
sim_compute_robot_state-npc2_mean	0.0646076572036463
sim_compute_robot_state-npc2_median	0.06422750557525249
sim_compute_robot_state-npc2_min	0.057966019426073344
sim_compute_robot_state-npc3_max	0.07133159183320545
sim_compute_robot_state-npc3_mean	0.06353303070831973
sim_compute_robot_state-npc3_median	0.0629557265511042
sim_compute_robot_state-npc3_min	0.057551486151559014
sim_compute_sim_state_max	0.040860310196876526
sim_compute_sim_state_mean	0.0371994316179389
sim_compute_sim_state_median	0.03776932064490982
sim_compute_sim_state_min	0.03185391426086426
sim_physics_max	0.21765494346618652
sim_physics_mean	0.1898149055935322
sim_physics_median	0.18450969382177423
sim_physics_min	0.16792150906154088
sim_render-ego_max	0.06111153463522593
sim_render-ego_mean	0.0582988810733571
sim_render-ego_median	0.05804396138607877
sim_render-ego_min	0.055701145103999546
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21112

2632

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 19:00:14+00:00

2019-04-27 19:20:09+00:00

0:19:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.16010649681091307
agent_compute-ego_mean	0.1479096446207366
agent_compute-ego_median	0.14831720079694474
agent_compute-ego_min	0.13312570615248245
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16746237542894152, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06179645767918339, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14944960011376274, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09406089341198956, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.038417304003680194, "sim_compute_performance-ego": 0.06990239796815095, "sim_compute_robot_state-ego": 0.07379841362988507, "sim_compute_robot_state-npc0": 0.06727198759714763, "sim_compute_robot_state-npc1": 0.06861263734323007, "sim_compute_robot_state-npc2": 0.06854212284088135, "sim_compute_robot_state-npc3": 0.06835284498002794}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.18638998985290528, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06594414710998535, "in-drivable-lane": 0, "agent_compute-ego": 0.15085100173950194, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09401938438415527, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.036677894592285154, "sim_compute_performance-ego": 0.07016482353210449, "sim_compute_robot_state-ego": 0.07272703170776368, "sim_compute_robot_state-npc0": 0.06915338516235352, "sim_compute_robot_state-npc1": 0.07005826950073242, "sim_compute_robot_state-npc2": 0.06722870826721192, "sim_compute_robot_state-npc3": 0.06832658767700195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18349834492332057, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05840394998851575, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14558105719716927, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09319605639106349, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03918871126676861, "sim_compute_performance-ego": 0.06696961741698415, "sim_compute_robot_state-ego": 0.07115533477381657, "sim_compute_robot_state-npc0": 0.06686698449285407, "sim_compute_robot_state-npc1": 0.06783754888333772, "sim_compute_robot_state-npc2": 0.06712560590944792, "sim_compute_robot_state-npc3": 0.06594741971869218}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.15443053728417505, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05733203284348114, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1449237654480753, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08274368092983583, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.034128705157509334, "sim_compute_performance-ego": 0.060169582125506826, "sim_compute_robot_state-ego": 0.06463716603532622, "sim_compute_robot_state-npc0": 0.06614302079888838, "sim_compute_robot_state-npc1": 0.0690872337244734, "sim_compute_robot_state-npc2": 0.06169649920886076, "sim_compute_robot_state-npc3": 0.06153567531440832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.16752454212733678, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06047368049621582, "in-drivable-lane": 0, "agent_compute-ego": 0.14831720079694474, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09385440179279872, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03621666772024972, "sim_compute_performance-ego": 0.06637048721313477, "sim_compute_robot_state-ego": 0.06921889100755964, "sim_compute_robot_state-npc0": 0.06814420223236084, "sim_compute_robot_state-npc1": 0.07796916791370936, "sim_compute_robot_state-npc2": 0.06672132015228271, "sim_compute_robot_state-npc3": 0.06952829871858869}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.11867799582304778, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.04702231177577266, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.14623132899955468, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.07742426130506727, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03301786051856147, "sim_compute_performance-ego": 0.054932355880737305, "sim_compute_robot_state-ego": 0.06852857271830241, "sim_compute_robot_state-npc0": 0.05258342071815773, "sim_compute_robot_state-npc1": 0.054533671449731896, "sim_compute_robot_state-npc2": 0.05243008666568332, "sim_compute_robot_state-npc3": 0.0595227700692636}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16777109658276593, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06200612915886773, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.15208843019273546, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09562785978670474, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.03931374461562545, "sim_compute_performance-ego": 0.07069108221266004, "sim_compute_robot_state-ego": 0.0760182363015634, "sim_compute_robot_state-npc0": 0.06797550342701099, "sim_compute_robot_state-npc1": 0.06735554889396385, "sim_compute_robot_state-npc2": 0.06905167632632786, "sim_compute_robot_state-npc3": 0.07126956957357901}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.18073465559217664, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.05682352913750543, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14237291018168133, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.08642801708645291, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03704829216003418, "sim_compute_performance-ego": 0.05993878576490614, "sim_compute_robot_state-ego": 0.06290380689832899, "sim_compute_robot_state-npc0": 0.06744721200731066, "sim_compute_robot_state-npc1": 0.06368358929951985, "sim_compute_robot_state-npc2": 0.05962945620218913, "sim_compute_robot_state-npc3": 0.06376292440626356}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.14869150908096976, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.056619431661522904, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.13759446662405264, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.08977049330006474, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03685527262480363, "sim_compute_performance-ego": 0.06187694487364396, "sim_compute_robot_state-ego": 0.06096777190332827, "sim_compute_robot_state-npc0": 0.06531983354817265, "sim_compute_robot_state-npc1": 0.07009552354397981, "sim_compute_robot_state-npc2": 0.06539968822313391, "sim_compute_robot_state-npc3": 0.06626949102982231}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.21119990348815915, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06484573364257812, "in-drivable-lane": 0, "agent_compute-ego": 0.16010649681091307, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.1021366310119629, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03883590698242187, "sim_compute_performance-ego": 0.07658060073852539, "sim_compute_robot_state-ego": 0.08064557552337646, "sim_compute_robot_state-npc0": 0.07155804634094239, "sim_compute_robot_state-npc1": 0.06829883575439454, "sim_compute_robot_state-npc2": 0.06763200283050537, "sim_compute_robot_state-npc3": 0.06980051040649414}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.2056452751159668, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.060141122341156, "in-drivable-lane": 0, "agent_compute-ego": 0.14991565942764282, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.08717553615570069, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03553861379623413, "sim_compute_performance-ego": 0.07049003839492798, "sim_compute_robot_state-ego": 0.06414908170700073, "sim_compute_robot_state-npc0": 0.06585885286331176, "sim_compute_robot_state-npc1": 0.06860874891281128, "sim_compute_robot_state-npc2": 0.06803091764450073, "sim_compute_robot_state-npc3": 0.063837730884552}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.17478892677708677, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06484404363130268, "in-drivable-lane": 0, "agent_compute-ego": 0.15805836727744654, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09390508501153244, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.03626051701997456, "sim_compute_performance-ego": 0.06994799563759252, "sim_compute_robot_state-ego": 0.06998953066374126, "sim_compute_robot_state-npc0": 0.06783451532062731, "sim_compute_robot_state-npc1": 0.0692380102057206, "sim_compute_robot_state-npc2": 0.0642645233555844, "sim_compute_robot_state-npc3": 0.06729119702389366}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1569307088851929, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.05967864513397217, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15425543785095214, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.08889852046966552, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.033715677261352536, "sim_compute_performance-ego": 0.06555978775024414, "sim_compute_robot_state-ego": 0.06807595729827881, "sim_compute_robot_state-npc0": 0.06524256229400635, "sim_compute_robot_state-npc1": 0.06325708389282227, "sim_compute_robot_state-npc2": 0.0617741060256958, "sim_compute_robot_state-npc3": 0.06146047592163086}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.18569427186792548, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.05770560828122226, "in-drivable-lane": 0, "agent_compute-ego": 0.13312570615248245, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.08887742866169322, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.033732576803727585, "sim_compute_performance-ego": 0.06558267636732622, "sim_compute_robot_state-ego": 0.0720128362829035, "sim_compute_robot_state-npc0": 0.07018631154840643, "sim_compute_robot_state-npc1": 0.06975026564164595, "sim_compute_robot_state-npc2": 0.06501564112576572, "sim_compute_robot_state-npc3": 0.0568559928373857}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.1751908526128652, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06269092462500747, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.14577324049813406, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.08843311971547652, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.038730538621240734, "sim_compute_performance-ego": 0.06444934436253139, "sim_compute_robot_state-ego": 0.06409407148555833, "sim_compute_robot_state-npc0": 0.06328042186036402, "sim_compute_robot_state-npc1": 0.06499899650106625, "sim_compute_robot_state-npc2": 0.06530019701743613, "sim_compute_robot_state-npc3": 0.06822708188271036}}
set_robot_commands_max	0.1021366310119629
set_robot_commands_mean	0.09043675796094423
set_robot_commands_median	0.08977049330006474
set_robot_commands_min	0.07742426130506727
sim_compute_performance-ego_max	0.07658060073852539
sim_compute_performance-ego_mean	0.06624176801593175
sim_compute_performance-ego_median	0.06637048721313477
sim_compute_performance-ego_min	0.054932355880737305
sim_compute_robot_state-ego_max	0.08064557552337646
sim_compute_robot_state-ego_mean	0.06926148519578222
sim_compute_robot_state-ego_median	0.06921889100755964
sim_compute_robot_state-ego_min	0.06096777190332827
sim_compute_robot_state-npc0_max	0.07155804634094239
sim_compute_robot_state-npc0_mean	0.06632441734746099
sim_compute_robot_state-npc0_median	0.06727198759714763
sim_compute_robot_state-npc0_min	0.05258342071815773
sim_compute_robot_state-npc1_max	0.07796916791370936
sim_compute_robot_state-npc1_mean	0.06755900876407597
sim_compute_robot_state-npc1_median	0.06860874891281128
sim_compute_robot_state-npc1_min	0.054533671449731896
sim_compute_robot_state-npc2_max	0.06905167632632786
sim_compute_robot_state-npc2_mean	0.06465617011970047
sim_compute_robot_state-npc2_median	0.06539968822313391
sim_compute_robot_state-npc2_min	0.05243008666568332
sim_compute_robot_state-npc3_max	0.07126956957357901
sim_compute_robot_state-npc3_mean	0.06546590469628762
sim_compute_robot_state-npc3_median	0.06626949102982231
sim_compute_robot_state-npc3_min	0.0568559928373857
sim_compute_sim_state_max	0.03931374461562545
sim_compute_sim_state_mean	0.03651188554296461
sim_compute_sim_state_median	0.036677894592285154
sim_compute_sim_state_min	0.03301786051856147
sim_physics_max	0.21119990348815915
sim_physics_mean	0.1723087323628557
sim_physics_median	0.17478892677708677
sim_physics_min	0.11867799582304778
sim_render-ego_max	0.06594414710998535
sim_render-ego_mean	0.059755183167085925
sim_render-ego_median	0.060141122341156
sim_render-ego_min	0.04702231177577266
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

21110

2645

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-27 18:59:48+00:00

2019-04-27 19:00:07+00:00

0:00:19

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2645/step1-simulation-ip-172-31-42-167-7357-job21110/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21094

2681

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 18:23:38+00:00

2019-04-27 18:59:27+00:00

0:35:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9957937578101996
survival_time_median	13.70000000000006
deviation-center-line_median	0.8919033096715387
in-drivable-lane_median	3.2500000000000213

other stats

agent_compute-ego_max	0.09059424877166748
agent_compute-ego_mean	0.08936551493322044
agent_compute-ego_median	0.08912953701648084
agent_compute-ego_min	0.08839945157368978
deviation-center-line_max	1.2581235091803151
deviation-center-line_mean	0.8751610563365022
deviation-center-line_min	0.36764988746677113
deviation-heading_max	5.904874199503731
deviation-heading_mean	4.161807181581326
deviation-heading_median	4.764497426634542
deviation-heading_min	0.9239633058573166
driven_any_max	2.3489458661644
driven_any_mean	1.9324367141189296
driven_any_median	2.1476765385276213
driven_any_min	0.6936907434607329
driven_lanedir_consec_max	1.3207412666109584
driven_lanedir_consec_mean	0.9981694774969612
driven_lanedir_consec_min	0.6781641145269627
driven_lanedir_max	2.0358244540105064
driven_lanedir_mean	1.3642280822487858
driven_lanedir_median	1.238397712208239
driven_lanedir_min	0.6781641145269627
in-drivable-lane_max	3.8000000000000016
in-drivable-lane_mean	2.2000000000000104
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1229560319859595, "sim_physics": 0.21011557771172715, "survival_time": 13.65000000000006, "driven_lanedir": 1.2145077467941174, "sim_render-ego": 0.07190062187530183, "in-drivable-lane": 3.8000000000000016, "agent_compute-ego": 0.08912953701648084, "deviation-heading": 4.764497426634542, "set_robot_commands": 0.11433945907341254, "deviation-center-line": 0.8221030822709682, "driven_lanedir_consec": 0.9957937578101996, "sim_compute_sim_state": 0.044265807329953374, "sim_compute_performance-ego": 0.08004131596603672, "sim_compute_robot_state-ego": 0.08986503649980594, "sim_compute_robot_state-npc0": 0.07997728442097758, "sim_compute_robot_state-npc1": 0.07906715861170283, "sim_compute_robot_state-npc2": 0.0803154964586754, "sim_compute_robot_state-npc3": 0.0788285391671317}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3489143904559344, "sim_physics": 0.2255681729316711, "survival_time": 14.950000000000076, "driven_lanedir": 1.6542463837041033, "sim_render-ego": 0.07176458676656088, "in-drivable-lane": 3.2500000000000213, "agent_compute-ego": 0.08839945157368978, "deviation-heading": 4.1894688604145625, "set_robot_commands": 0.11573743343353272, "deviation-center-line": 0.8919033096715387, "driven_lanedir_consec": 1.1677571855209754, "sim_compute_sim_state": 0.04508675575256347, "sim_compute_performance-ego": 0.08008323351542156, "sim_compute_robot_state-ego": 0.08945188363393147, "sim_compute_robot_state-npc0": 0.08048590262730916, "sim_compute_robot_state-npc1": 0.08019828001658122, "sim_compute_robot_state-npc2": 0.0808284584681193, "sim_compute_robot_state-npc3": 0.07900531768798828}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3489458661644, "sim_physics": 0.21248416503270467, "survival_time": 14.950000000000076, "driven_lanedir": 2.0358244540105064, "sim_render-ego": 0.07080610116322836, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.09059424877166748, "deviation-heading": 5.026232115496474, "set_robot_commands": 0.11218767166137696, "deviation-center-line": 1.2581235091803151, "driven_lanedir_consec": 1.3207412666109584, "sim_compute_sim_state": 0.04452215433120728, "sim_compute_performance-ego": 0.0790914527575175, "sim_compute_robot_state-ego": 0.08758938074111938, "sim_compute_robot_state-npc0": 0.08054750204086304, "sim_compute_robot_state-npc1": 0.07888628005981445, "sim_compute_robot_state-npc2": 0.07966272751490275, "sim_compute_robot_state-npc3": 0.0802730123202006}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1476765385276213, "sim_physics": 0.2251732897584456, "survival_time": 13.70000000000006, "driven_lanedir": 1.238397712208239, "sim_render-ego": 0.07075115973061889, "in-drivable-lane": 3.400000000000021, "agent_compute-ego": 0.08866259477434367, "deviation-heading": 5.904874199503731, "set_robot_commands": 0.11650410098751096, "deviation-center-line": 1.036025493092918, "driven_lanedir_consec": 0.8283910630157103, "sim_compute_sim_state": 0.044406065975662566, "sim_compute_performance-ego": 0.07991726033008882, "sim_compute_robot_state-ego": 0.08882726021926768, "sim_compute_robot_state-npc0": 0.08082061788461505, "sim_compute_robot_state-npc1": 0.07981448451968005, "sim_compute_robot_state-npc2": 0.08024440542624815, "sim_compute_robot_state-npc3": 0.07941135437819209}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6936907434607329, "sim_physics": 0.21167700008679463, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6781641145269627, "sim_render-ego": 0.07015076760322816, "in-drivable-lane": 0, "agent_compute-ego": 0.09004174252992035, "deviation-heading": 0.9239633058573166, "set_robot_commands": 0.11689859308222288, "deviation-center-line": 0.36764988746677113, "driven_lanedir_consec": 0.6781641145269627, "sim_compute_sim_state": 0.04441224631442819, "sim_compute_performance-ego": 0.07967128292206795, "sim_compute_robot_state-ego": 0.09049624012362573, "sim_compute_robot_state-npc0": 0.07915715761082147, "sim_compute_robot_state-npc1": 0.07775285936171009, "sim_compute_robot_state-npc2": 0.07675842315919938, "sim_compute_robot_state-npc3": 0.07786886153682586}}
set_robot_commands_max	0.11689859308222288
set_robot_commands_mean	0.1151334516476112
set_robot_commands_median	0.11573743343353272
set_robot_commands_min	0.11218767166137696
sim_compute_performance-ego_max	0.08008323351542156
sim_compute_performance-ego_mean	0.0797609090982265
sim_compute_performance-ego_median	0.07991726033008882
sim_compute_performance-ego_min	0.0790914527575175
sim_compute_robot_state-ego_max	0.09049624012362573
sim_compute_robot_state-ego_mean	0.08924596024355004
sim_compute_robot_state-ego_median	0.08945188363393147
sim_compute_robot_state-ego_min	0.08758938074111938
sim_compute_robot_state-npc0_max	0.08082061788461505
sim_compute_robot_state-npc0_mean	0.08019769291691727
sim_compute_robot_state-npc0_median	0.08048590262730916
sim_compute_robot_state-npc0_min	0.07915715761082147
sim_compute_robot_state-npc1_max	0.08019828001658122
sim_compute_robot_state-npc1_mean	0.07914381251389772
sim_compute_robot_state-npc1_median	0.07906715861170283
sim_compute_robot_state-npc1_min	0.07775285936171009
sim_compute_robot_state-npc2_max	0.0808284584681193
sim_compute_robot_state-npc2_mean	0.079561902205429
sim_compute_robot_state-npc2_median	0.08024440542624815
sim_compute_robot_state-npc2_min	0.07675842315919938
sim_compute_robot_state-npc3_max	0.0802730123202006
sim_compute_robot_state-npc3_mean	0.07907741701806771
sim_compute_robot_state-npc3_median	0.07900531768798828
sim_compute_robot_state-npc3_min	0.07786886153682586
sim_compute_sim_state_max	0.04508675575256347
sim_compute_sim_state_mean	0.04453860594076298
sim_compute_sim_state_median	0.04441224631442819
sim_compute_sim_state_min	0.044265807329953374
sim_physics_max	0.2255681729316711
sim_physics_mean	0.21700364110426865
sim_physics_median	0.21248416503270467
sim_physics_min	0.21011557771172715
sim_render-ego_max	0.07190062187530183
sim_render-ego_mean	0.07107464742778762
sim_render-ego_median	0.07080610116322836
sim_render-ego_min	0.07015076760322816
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.380000000000052
survival_time_min	4.6499999999999915

No reset possible

21081

2699

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 18:01:20+00:00

2019-04-27 18:22:52+00:00

0:21:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3787704196622297
survival_time_median	4.749999999999991
deviation-center-line_median	0.3565112702888225
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.09579787254333497
agent_compute-ego_mean	0.08873557041078427
agent_compute-ego_median	0.08875322182973226
agent_compute-ego_min	0.0772650166561729
deviation-center-line_max	0.995955273991036
deviation-center-line_mean	0.49241348298819154
deviation-center-line_min	0.17794855799105644
deviation-heading_max	3.8352425655030986
deviation-heading_mean	2.363563454255281
deviation-heading_median	2.5814873595331584
deviation-heading_min	0.5829145165746271
driven_any_max	2.3490720300795833
driven_any_mean	1.019701702716889
driven_any_median	0.6927327493805732
driven_any_min	0.29188406193902433
driven_lanedir_consec_max	1.903203149124654
driven_lanedir_consec_mean	0.6969957330169633
driven_lanedir_consec_min	0.24777766139883556
driven_lanedir_max	2.215991172656607
driven_lanedir_mean	0.8475257609026878
driven_lanedir_median	0.4622392324629913
driven_lanedir_min	0.2634693851627814
in-drivable-lane_max	1.2500000000000062
in-drivable-lane_mean	0.3600000000000011
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.6927327493805732, "sim_physics": 0.19907011232878033, "survival_time": 4.749999999999991, "driven_lanedir": 0.4622392324629913, "sim_render-ego": 0.0592831435956453, "in-drivable-lane": 0.30000000000000004, "agent_compute-ego": 0.0772650166561729, "deviation-heading": 2.5814873595331584, "set_robot_commands": 0.08950410140188117, "deviation-center-line": 0.3565112702888225, "driven_lanedir_consec": 0.24777766139883556, "sim_compute_sim_state": 0.033331090525576944, "sim_compute_performance-ego": 0.062341095271863434, "sim_compute_robot_state-ego": 0.07201837489479467, "sim_compute_robot_state-npc0": 0.06140649193211606, "sim_compute_robot_state-npc1": 0.05985050452382941, "sim_compute_robot_state-npc2": 0.05833724423458702, "sim_compute_robot_state-npc3": 0.05842054015711734}, "udem1-1-0": {"driven_any": 0.4124180421689091, "sim_physics": 0.24245852848579144, "survival_time": 2.8999999999999977, "driven_lanedir": 0.3787704196622297, "sim_render-ego": 0.07977523474857726, "in-drivable-lane": 0, "agent_compute-ego": 0.09331934616483492, "deviation-heading": 1.058953310985765, "set_robot_commands": 0.11420636341489594, "deviation-center-line": 0.24011729880988025, "driven_lanedir_consec": 0.3787704196622297, "sim_compute_sim_state": 0.0460496031004807, "sim_compute_performance-ego": 0.07641519349196861, "sim_compute_robot_state-ego": 0.08465650985980856, "sim_compute_robot_state-npc0": 0.08039469143439984, "sim_compute_robot_state-npc1": 0.07880406955192829, "sim_compute_robot_state-npc2": 0.07852974020201585, "sim_compute_robot_state-npc3": 0.08317642787407184}, "udem1-2-0": {"driven_any": 1.352401630016357, "sim_physics": 0.2391613892146519, "survival_time": 8.74999999999999, "driven_lanedir": 0.9171585945688294, "sim_render-ego": 0.07402229445321219, "in-drivable-lane": 1.2500000000000062, "agent_compute-ego": 0.09579787254333497, "deviation-heading": 3.8352425655030986, "set_robot_commands": 0.10914977482386998, "deviation-center-line": 0.6915350138601626, "driven_lanedir_consec": 0.6917580497363156, "sim_compute_sim_state": 0.04336758204868862, "sim_compute_performance-ego": 0.07931509699140277, "sim_compute_robot_state-ego": 0.08660522597176688, "sim_compute_robot_state-npc0": 0.07682615143912179, "sim_compute_robot_state-npc1": 0.07696375574384416, "sim_compute_robot_state-npc2": 0.07935257502964564, "sim_compute_robot_state-npc3": 0.07764775548662459}, "udem1-3-0": {"driven_any": 0.29188406193902433, "sim_physics": 0.26152580283408944, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2634693851627814, "sim_render-ego": 0.06770732790924781, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08854239485984625, "deviation-heading": 0.5829145165746271, "set_robot_commands": 0.1109273821808571, "deviation-center-line": 0.17794855799105644, "driven_lanedir_consec": 0.2634693851627814, "sim_compute_sim_state": 0.04564330744188885, "sim_compute_performance-ego": 0.07316308243330134, "sim_compute_robot_state-ego": 0.07928129129631575, "sim_compute_robot_state-npc0": 0.0780912998110749, "sim_compute_robot_state-npc1": 0.08179065238597781, "sim_compute_robot_state-npc2": 0.0827751547791237, "sim_compute_robot_state-npc3": 0.08072426707245582}, "udem1-4-0": {"driven_any": 2.3490720300795833, "sim_physics": 0.2412813369433085, "survival_time": 14.950000000000076, "driven_lanedir": 2.215991172656607, "sim_render-ego": 0.06993374903996785, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.08875322182973226, "deviation-heading": 3.759219518679757, "set_robot_commands": 0.11087623198827108, "deviation-center-line": 0.995955273991036, "driven_lanedir_consec": 1.903203149124654, "sim_compute_sim_state": 0.0437113626797994, "sim_compute_performance-ego": 0.07857139825820923, "sim_compute_robot_state-ego": 0.08950861136118571, "sim_compute_robot_state-npc0": 0.07821232318878174, "sim_compute_robot_state-npc1": 0.07927296082178752, "sim_compute_robot_state-npc2": 0.07894835392634074, "sim_compute_robot_state-npc3": 0.07899722735087077}}
set_robot_commands_max	0.11420636341489594
set_robot_commands_mean	0.10693277076195506
set_robot_commands_median	0.11087623198827108
set_robot_commands_min	0.08950410140188117
sim_compute_performance-ego_max	0.07931509699140277
sim_compute_performance-ego_mean	0.07396117328934908
sim_compute_performance-ego_median	0.07641519349196861
sim_compute_performance-ego_min	0.062341095271863434
sim_compute_robot_state-ego_max	0.08950861136118571
sim_compute_robot_state-ego_mean	0.08241400267677432
sim_compute_robot_state-ego_median	0.08465650985980856
sim_compute_robot_state-ego_min	0.07201837489479467
sim_compute_robot_state-npc0_max	0.08039469143439984
sim_compute_robot_state-npc0_mean	0.07498619156109886
sim_compute_robot_state-npc0_median	0.0780912998110749
sim_compute_robot_state-npc0_min	0.06140649193211606
sim_compute_robot_state-npc1_max	0.08179065238597781
sim_compute_robot_state-npc1_mean	0.07533638860547345
sim_compute_robot_state-npc1_median	0.07880406955192829
sim_compute_robot_state-npc1_min	0.05985050452382941
sim_compute_robot_state-npc2_max	0.0827751547791237
sim_compute_robot_state-npc2_mean	0.07558861363434258
sim_compute_robot_state-npc2_median	0.07894835392634074
sim_compute_robot_state-npc2_min	0.05833724423458702
sim_compute_robot_state-npc3_max	0.08317642787407184
sim_compute_robot_state-npc3_mean	0.07579324358822807
sim_compute_robot_state-npc3_median	0.07899722735087077
sim_compute_robot_state-npc3_min	0.05842054015711734
sim_compute_sim_state_max	0.0460496031004807
sim_compute_sim_state_mean	0.042420589159286905
sim_compute_sim_state_median	0.0437113626797994
sim_compute_sim_state_min	0.033331090525576944
sim_physics_max	0.26152580283408944
sim_physics_mean	0.2366994339613243
sim_physics_median	0.2412813369433085
sim_physics_min	0.19907011232878033
sim_render-ego_max	0.07977523474857726
sim_render-ego_mean	0.07014434994933008
sim_render-ego_median	0.06993374903996785
sim_render-ego_min	0.0592831435956453
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.700000000000012
survival_time_min	2.1500000000000004

No reset possible

21074

2704

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:49:31+00:00

2019-04-27 18:00:05+00:00

0:10:34

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2704/step1-simulation-ip-172-31-42-167-7357-job21074/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21066

2719

test for ppo

step1-simulation

error

2019-04-27 17:47:16+00:00

2019-04-27 17:48:54+00:00

0:01:38

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21062

3110

Sergey Sviridov 🇷🇺

Baseline

aido2-AMOD-fleet_size

step2-scoring

success

yes

2019-04-27 17:46:41+00:00

2019-04-27 17:46:54+00:00

0:00:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

fleet_size

-1000000000

other stats

efficiency	-62.9040012273548
service_quality	-32.277470306839234

No reset possible

21054

3110

Sergey Sviridov 🇷🇺

Baseline

aido2-AMOD-fleet_size

step1-simulation

success

yes

2019-04-27 17:40:41+00:00

2019-04-27 17:46:25+00:00

0:05:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

passed

true

No reset possible

21050

2735

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

failed

2019-04-27 17:38:27+00:00

2019-04-27 17:40:11+00:00

0:01:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21039

2755

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 17:31:34+00:00

2019-04-27 17:37:30+00:00

0:05:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.1166759393545397
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.08042408029238383
agent_compute-ego_mean	0.0744516192715539
agent_compute-ego_median	0.0769704943117888
agent_compute-ego_min	0.06773609174808985
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871981
deviation-heading_mean	0.4194004386292103
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829774
driven_any_max	0.922682252912863
driven_any_mean	0.6324710235085378
driven_any_median	0.609146202404747
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572027
driven_lanedir_consec_mean	0.4245071231796042
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572027
driven_lanedir_mean	0.4245071231796042
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11241280528861032, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05976748802292515, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06773609174808985, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09375318674974038, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03734597689668897, "sim_compute_performance-ego": 0.06827812799265687, "sim_compute_robot_state-ego": 0.07049085388720876}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11494309504826863, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06363523006439209, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06975647211074829, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09292628367741902, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0387411912282308, "sim_compute_performance-ego": 0.07086348136266073, "sim_compute_robot_state-ego": 0.07336330811182658}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.1438872922550548, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.07304047454487193, "in-drivable-lane": 0, "agent_compute-ego": 0.07737095789475874, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.10830926895141602, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.040781497955322266, "sim_compute_performance-ego": 0.08281641656702216, "sim_compute_robot_state-ego": 0.09588909149169922}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.14068409303824106, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.07013161977132161, "in-drivable-lane": 0, "agent_compute-ego": 0.08042408029238383, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.10867216189702351, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04201517502466837, "sim_compute_performance-ego": 0.07646183172861735, "sim_compute_robot_state-ego": 0.08670087158679962}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12229880560999332, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06615335008372432, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.0769704943117888, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09891896144203516, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.041793807693149734, "sim_compute_performance-ego": 0.07557806761368462, "sim_compute_robot_state-ego": 0.07805738760077435}}
set_robot_commands_max	0.10867216189702351
set_robot_commands_mean	0.10051597254352682
set_robot_commands_median	0.09891896144203516
set_robot_commands_min	0.09292628367741902
sim_compute_performance-ego_max	0.08281641656702216
sim_compute_performance-ego_mean	0.07479958505292836
sim_compute_performance-ego_median	0.07557806761368462
sim_compute_performance-ego_min	0.06827812799265687
sim_compute_robot_state-ego_max	0.09588909149169922
sim_compute_robot_state-ego_mean	0.0809003025356617
sim_compute_robot_state-ego_median	0.07805738760077435
sim_compute_robot_state-ego_min	0.07049085388720876
sim_compute_sim_state_max	0.04201517502466837
sim_compute_sim_state_mean	0.04013552975961203
sim_compute_sim_state_median	0.040781497955322266
sim_compute_sim_state_min	0.03734597689668897
sim_physics_max	0.1438872922550548
sim_physics_mean	0.12684521824803363
sim_physics_median	0.12229880560999332
sim_physics_min	0.11241280528861032
sim_render-ego_max	0.07304047454487193
sim_render-ego_mean	0.06654563249744702
sim_render-ego_median	0.06615335008372432
sim_render-ego_min	0.05976748802292515
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

21023

2771

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 17:04:54+00:00

2019-04-27 17:31:07+00:00

0:26:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8051142638844548
survival_time_median	5.449999999999989
deviation-center-line_median	0.5808189309647263
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.11633856659350188
agent_compute-ego_mean	0.11359653609567552
agent_compute-ego_median	0.11376319002749316
agent_compute-ego_min	0.11034358750789536
deviation-center-line_max	0.9951497579123628
deviation-center-line_mean	0.6043209120988936
deviation-center-line_min	0.3255459793589536
deviation-heading_max	6.538492724279429
deviation-heading_mean	2.7726950621118536
deviation-heading_median	0.945155952310194
deviation-heading_min	0.5270819532137857
driven_any_max	2.348865309166556
driven_any_mean	1.336549046098488
driven_any_median	0.8222547022109343
driven_any_min	0.4847484533683435
driven_lanedir_consec_max	1.4848849597959752
driven_lanedir_consec_mean	0.8929172821524283
driven_lanedir_consec_min	0.4756369339491142
driven_lanedir_max	1.9736424934854833
driven_lanedir_mean	1.156989535536715
driven_lanedir_median	0.8051142638844548
driven_lanedir_min	0.4756369339491142
in-drivable-lane_max	1.5000000000000109
in-drivable-lane_mean	0.3800000000000033
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3412116495840505, "sim_physics": 0.22656658172607425, "survival_time": 14.950000000000076, "driven_lanedir": 1.8540463418166544, "sim_render-ego": 0.07101928075154622, "in-drivable-lane": 1.5000000000000109, "agent_compute-ego": 0.11352686325709026, "deviation-heading": 5.154590354912233, "set_robot_commands": 0.1137361486752828, "deviation-center-line": 0.9951497579123628, "driven_lanedir_consec": 1.022442608584729, "sim_compute_sim_state": 0.04539975563685099, "sim_compute_performance-ego": 0.07992603858311971, "sim_compute_robot_state-ego": 0.09202129999796547, "sim_compute_robot_state-npc0": 0.07884116172790527, "sim_compute_robot_state-npc1": 0.0792393167813619, "sim_compute_robot_state-npc2": 0.08188267389933268, "sim_compute_robot_state-npc3": 0.07984910249710082}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348865309166556, "sim_physics": 0.2178173311551412, "survival_time": 14.950000000000076, "driven_lanedir": 1.9736424934854833, "sim_render-ego": 0.07175499677658081, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.11401047309239704, "deviation-heading": 6.538492724279429, "set_robot_commands": 0.1142226791381836, "deviation-center-line": 0.7335845588356761, "driven_lanedir_consec": 1.4848849597959752, "sim_compute_sim_state": 0.044372539520263675, "sim_compute_performance-ego": 0.08344502369562785, "sim_compute_robot_state-ego": 0.09173165321350098, "sim_compute_robot_state-npc0": 0.0796126397450765, "sim_compute_robot_state-npc1": 0.08005479256312052, "sim_compute_robot_state-npc2": 0.07984672625859579, "sim_compute_robot_state-npc3": 0.07868810415267945}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8222547022109343, "sim_physics": 0.22658751645219435, "survival_time": 5.449999999999989, "driven_lanedir": 0.8051142638844548, "sim_render-ego": 0.07112643040648294, "in-drivable-lane": 0, "agent_compute-ego": 0.11034358750789536, "deviation-heading": 0.945155952310194, "set_robot_commands": 0.10770459131363334, "deviation-center-line": 0.5808189309647263, "driven_lanedir_consec": 0.8051142638844548, "sim_compute_sim_state": 0.04468498754938808, "sim_compute_performance-ego": 0.07968209642882741, "sim_compute_robot_state-ego": 0.09579328878210223, "sim_compute_robot_state-npc0": 0.07823426789100017, "sim_compute_robot_state-npc1": 0.07875919123308374, "sim_compute_robot_state-npc2": 0.08062128408239522, "sim_compute_robot_state-npc3": 0.07861850239814969}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4847484533683435, "sim_physics": 0.23204700982392723, "survival_time": 3.349999999999996, "driven_lanedir": 0.4756369339491142, "sim_render-ego": 0.072283260857881, "in-drivable-lane": 0, "agent_compute-ego": 0.11376319002749316, "deviation-heading": 0.5270819532137857, "set_robot_commands": 0.11367123162568506, "deviation-center-line": 0.3255459793589536, "driven_lanedir_consec": 0.4756369339491142, "sim_compute_sim_state": 0.04453133113348662, "sim_compute_performance-ego": 0.07882930983358355, "sim_compute_robot_state-ego": 0.08811656396780441, "sim_compute_robot_state-npc0": 0.0798670071274487, "sim_compute_robot_state-npc1": 0.0797706753460329, "sim_compute_robot_state-npc2": 0.07860733857795374, "sim_compute_robot_state-npc3": 0.07964965834546445}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6856651161625565, "sim_physics": 0.20587443268817404, "survival_time": 4.599999999999992, "driven_lanedir": 0.6765076445478682, "sim_render-ego": 0.07231656105622002, "in-drivable-lane": 0, "agent_compute-ego": 0.11633856659350188, "deviation-heading": 0.6981543258436246, "set_robot_commands": 0.115789999132571, "deviation-center-line": 0.3865053334227497, "driven_lanedir_consec": 0.6765076445478682, "sim_compute_sim_state": 0.044847545416458794, "sim_compute_performance-ego": 0.07994494749152142, "sim_compute_robot_state-ego": 0.09214671539223712, "sim_compute_robot_state-npc0": 0.07710345413373865, "sim_compute_robot_state-npc1": 0.07867971192235532, "sim_compute_robot_state-npc2": 0.08196847076001375, "sim_compute_robot_state-npc3": 0.082059093143629}}
set_robot_commands_max	0.115789999132571
set_robot_commands_mean	0.11302492997707116
set_robot_commands_median	0.1137361486752828
set_robot_commands_min	0.10770459131363334
sim_compute_performance-ego_max	0.08344502369562785
sim_compute_performance-ego_mean	0.080365483206536
sim_compute_performance-ego_median	0.07992603858311971
sim_compute_performance-ego_min	0.07882930983358355
sim_compute_robot_state-ego_max	0.09579328878210223
sim_compute_robot_state-ego_mean	0.09196190427072204
sim_compute_robot_state-ego_median	0.09202129999796547
sim_compute_robot_state-ego_min	0.08811656396780441
sim_compute_robot_state-npc0_max	0.0798670071274487
sim_compute_robot_state-npc0_mean	0.07873170612503386
sim_compute_robot_state-npc0_median	0.07884116172790527
sim_compute_robot_state-npc0_min	0.07710345413373865
sim_compute_robot_state-npc1_max	0.08005479256312052
sim_compute_robot_state-npc1_mean	0.07930073756919087
sim_compute_robot_state-npc1_median	0.0792393167813619
sim_compute_robot_state-npc1_min	0.07867971192235532
sim_compute_robot_state-npc2_max	0.08196847076001375
sim_compute_robot_state-npc2_mean	0.08058529871565824
sim_compute_robot_state-npc2_median	0.08062128408239522
sim_compute_robot_state-npc2_min	0.07860733857795374
sim_compute_robot_state-npc3_max	0.082059093143629
sim_compute_robot_state-npc3_mean	0.07977289210740468
sim_compute_robot_state-npc3_median	0.07964965834546445
sim_compute_robot_state-npc3_min	0.07861850239814969
sim_compute_sim_state_max	0.04539975563685099
sim_compute_sim_state_mean	0.044767231851289634
sim_compute_sim_state_median	0.04468498754938808
sim_compute_sim_state_min	0.044372539520263675
sim_physics_max	0.23204700982392723
sim_physics_mean	0.22177857436910223
sim_physics_median	0.22656658172607425
sim_physics_min	0.20587443268817404
sim_render-ego_max	0.07231656105622002
sim_render-ego_mean	0.0717001059697422
sim_render-ego_median	0.07175499677658081
sim_render-ego_min	0.07101928075154622
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.660000000000027
survival_time_min	3.349999999999996

No reset possible

21018

2783

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:03:47+00:00

2019-04-27 17:04:19+00:00

0:00:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21003

2792

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 17:00:05+00:00

2019-04-27 17:03:40+00:00

0:03:35

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20974

2856

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 16:24:39+00:00

2019-04-27 16:59:51+00:00

0:35:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3581949699453477
survival_time_median	5.14999999999999
deviation-center-line_median	0.2084327403075257
in-drivable-lane_median	0.6499999999999977

other stats

agent_compute-ego_max	0.11513806819915771
agent_compute-ego_mean	0.1001170235276804
agent_compute-ego_median	0.10077890555063884
agent_compute-ego_min	0.08048064368111747
deviation-center-line_max	0.36609129635569554
deviation-center-line_mean	0.20295455267023035
deviation-center-line_min	0.07972249000428101
deviation-heading_max	2.4331134830690715
deviation-heading_mean	1.651392143336207
deviation-heading_median	1.6898654544228242
deviation-heading_min	1.0404799375124676
driven_any_max	1.17453677627779
driven_any_mean	0.5643544839993915
driven_any_median	0.3870265153191234
driven_any_min	0.14192336510540687
driven_lanedir_consec_max	0.5113036954330585
driven_lanedir_consec_mean	0.33094291353871425
driven_lanedir_consec_min	0.10623165239140409
driven_lanedir_max	0.5113036954330585
driven_lanedir_mean	0.33094291353871425
driven_lanedir_median	0.3581949699453477
driven_lanedir_min	0.10623165239140409
in-drivable-lane_max	7.950000000000094
in-drivable-lane_mean	2.350000000000024
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1707185139081682, "sim_physics": 0.12689630587895712, "survival_time": 14.950000000000076, "driven_lanedir": 0.5113036954330585, "sim_render-ego": 0.06970129569371541, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.11513806819915771, "deviation-heading": 1.7870491119677296, "set_robot_commands": 0.11045352617899576, "deviation-center-line": 0.2742403391197186, "driven_lanedir_consec": 0.5113036954330585, "sim_compute_sim_state": 0.0433549698193868, "sim_compute_performance-ego": 0.07765308856964111, "sim_compute_robot_state-ego": 0.08617831071217855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21021321815663324, "sim_physics": 0.09865514302657824, "survival_time": 2.9499999999999975, "driven_lanedir": 0.11238021629225392, "sim_render-ego": 0.059727398015685, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09791663137532897, "deviation-heading": 1.330578524267241, "set_robot_commands": 0.0950013176869538, "deviation-center-line": 0.08230261744605692, "driven_lanedir_consec": 0.11238021629225392, "sim_compute_sim_state": 0.03915478415408377, "sim_compute_performance-ego": 0.06893865132735948, "sim_compute_robot_state-ego": 0.0776512016684322}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14192336510540687, "sim_physics": 0.0853828475588844, "survival_time": 2.1000000000000005, "driven_lanedir": 0.11613903153538274, "sim_render-ego": 0.04553328241620745, "in-drivable-lane": 0, "agent_compute-ego": 0.08048064368111747, "deviation-heading": 1.0404799375124676, "set_robot_commands": 0.07462407861437116, "deviation-center-line": 0.20332610629981135, "driven_lanedir_consec": 0.11613903153538274, "sim_compute_sim_state": 0.03344127677735828, "sim_compute_performance-ego": 0.052456078075227286, "sim_compute_robot_state-ego": 0.05604923906780425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5477429518756478, "sim_physics": 0.1157023289820531, "survival_time": 7.149999999999983, "driven_lanedir": 0.4807143964063374, "sim_render-ego": 0.06113336303017356, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10175171598687872, "deviation-heading": 2.039336227550392, "set_robot_commands": 0.09579975454957336, "deviation-center-line": 0.22455249635290225, "driven_lanedir_consec": 0.4807143964063374, "sim_compute_sim_state": 0.03869704433254429, "sim_compute_performance-ego": 0.0680650314251026, "sim_compute_robot_state-ego": 0.07445341723782199}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.539700175382884, "sim_physics": 0.09554641466614204, "survival_time": 7.049999999999983, "driven_lanedir": 0.4430532861735075, "sim_render-ego": 0.05552109420722258, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09275862511168136, "deviation-heading": 1.6898654544228242, "set_robot_commands": 0.08161824645725548, "deviation-center-line": 0.2009608928383967, "driven_lanedir_consec": 0.4430532861735075, "sim_compute_sim_state": 0.03584526447539634, "sim_compute_performance-ego": 0.06055902082023891, "sim_compute_robot_state-ego": 0.06275337131310862}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.358881432506834, "sim_physics": 0.12012283752361934, "survival_time": 4.799999999999991, "driven_lanedir": 0.24996581983127353, "sim_render-ego": 0.0654250979423523, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.1061173900961876, "deviation-heading": 1.726371760301949, "set_robot_commands": 0.10323209315538406, "deviation-center-line": 0.2084327403075257, "driven_lanedir_consec": 0.24996581983127353, "sim_compute_sim_state": 0.03982158501942953, "sim_compute_performance-ego": 0.0717134674390157, "sim_compute_robot_state-ego": 0.07901836186647415}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.17453677627779, "sim_physics": 0.11441794157028198, "survival_time": 14.950000000000076, "driven_lanedir": 0.48088566591954773, "sim_render-ego": 0.061637837092081704, "in-drivable-lane": 7.950000000000094, "agent_compute-ego": 0.10258583068847656, "deviation-heading": 1.9847456966991743, "set_robot_commands": 0.0962846565246582, "deviation-center-line": 0.24382890559608433, "driven_lanedir_consec": 0.48088566591954773, "sim_compute_sim_state": 0.03963606595993042, "sim_compute_performance-ego": 0.07028235912322998, "sim_compute_robot_state-ego": 0.07464788993199667}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.20621359603167877, "sim_physics": 0.11314811377689755, "survival_time": 2.8999999999999977, "driven_lanedir": 0.18543448638799864, "sim_render-ego": 0.06497338722492087, "in-drivable-lane": 0, "agent_compute-ego": 0.10325507871035872, "deviation-heading": 1.0465207616495278, "set_robot_commands": 0.1056834048238294, "deviation-center-line": 0.27193111592444685, "driven_lanedir_consec": 0.18543448638799864, "sim_compute_sim_state": 0.04310392922368543, "sim_compute_performance-ego": 0.07381112822170915, "sim_compute_robot_state-ego": 0.08073200850651183}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.31870047767432663, "sim_physics": 0.11380684652993846, "survival_time": 4.299999999999993, "driven_lanedir": 0.2164196801561724, "sim_render-ego": 0.06417983077293218, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09849852739378465, "deviation-heading": 1.47345272188792, "set_robot_commands": 0.1008556693099266, "deviation-center-line": 0.07972249000428101, "driven_lanedir_consec": 0.2164196801561724, "sim_compute_sim_state": 0.04041177172993505, "sim_compute_performance-ego": 0.07032502252002094, "sim_compute_robot_state-ego": 0.07460545939068462}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.174532551451532, "sim_physics": 0.1201076078414917, "survival_time": 14.950000000000076, "driven_lanedir": 0.4840820387577538, "sim_render-ego": 0.06145534197489421, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.10077890555063884, "deviation-heading": 2.4331134830690715, "set_robot_commands": 0.09420366764068604, "deviation-center-line": 0.20871812505779327, "driven_lanedir_consec": 0.4840820387577538, "sim_compute_sim_state": 0.038951122760772706, "sim_compute_performance-ego": 0.06773035526275635, "sim_compute_robot_state-ego": 0.07400815407435099}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5276520830396947, "sim_physics": 0.11486936652142068, "survival_time": 6.8999999999999835, "driven_lanedir": 0.45190314325713365, "sim_render-ego": 0.06603879859482033, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10702788829803468, "deviation-heading": 1.9731664965566111, "set_robot_commands": 0.10217772532200468, "deviation-center-line": 0.1908756891499077, "driven_lanedir_consec": 0.45190314325713365, "sim_compute_sim_state": 0.04178316005762073, "sim_compute_performance-ego": 0.07514160612355107, "sim_compute_robot_state-ego": 0.08221308735833652}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.174534147585338, "sim_physics": 0.1168354074160258, "survival_time": 14.950000000000076, "driven_lanedir": 0.5108436365186972, "sim_render-ego": 0.06309922695159913, "in-drivable-lane": 7.750000000000095, "agent_compute-ego": 0.10137202819188436, "deviation-heading": 1.7500602038902686, "set_robot_commands": 0.09546299934387208, "deviation-center-line": 0.2962803265156284, "driven_lanedir_consec": 0.5108436365186972, "sim_compute_sim_state": 0.039906546274820966, "sim_compute_performance-ego": 0.07227645715077718, "sim_compute_robot_state-ego": 0.07539681434631347}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.21021421077048788, "sim_physics": 0.10446296708058504, "survival_time": 2.9499999999999975, "driven_lanedir": 0.10623165239140409, "sim_render-ego": 0.05926477707038492, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0941256830247782, "deviation-heading": 1.3980013240669922, "set_robot_commands": 0.09929977029056872, "deviation-center-line": 0.09253526703526956, "driven_lanedir_consec": 0.10623165239140409, "sim_compute_sim_state": 0.038349551669621874, "sim_compute_performance-ego": 0.06724806559287895, "sim_compute_robot_state-ego": 0.07177103980112884}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3227272449053274, "sim_physics": 0.11657965868368916, "survival_time": 4.3499999999999925, "driven_lanedir": 0.2565919840748454, "sim_render-ego": 0.06023160890601147, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.09937863240296814, "deviation-heading": 1.5457389209302446, "set_robot_commands": 0.0965188536150702, "deviation-center-line": 0.1005198820499375, "driven_lanedir_consec": 0.2565919840748454, "sim_compute_sim_state": 0.03972476104210163, "sim_compute_performance-ego": 0.06982499977637982, "sim_compute_robot_state-ego": 0.07368188068784516}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.3870265153191234, "sim_physics": 0.11398442972053602, "survival_time": 5.14999999999999, "driven_lanedir": 0.3581949699453477, "sim_render-ego": 0.06074175325412195, "in-drivable-lane": 0, "agent_compute-ego": 0.10056970420392972, "deviation-heading": 1.5524015252706942, "set_robot_commands": 0.0991276051234273, "deviation-center-line": 0.36609129635569554, "driven_lanedir_consec": 0.3581949699453477, "sim_compute_sim_state": 0.040602839108809685, "sim_compute_performance-ego": 0.06911040509788735, "sim_compute_robot_state-ego": 0.0729380857597277}}
set_robot_commands_max	0.11045352617899576
set_robot_commands_mean	0.09668955790910512
set_robot_commands_median	0.0965188536150702
set_robot_commands_min	0.07462407861437116
sim_compute_performance-ego_max	0.07765308856964111
sim_compute_performance-ego_mean	0.06900904910171839
sim_compute_performance-ego_median	0.06982499977637982
sim_compute_performance-ego_min	0.052456078075227286
sim_compute_robot_state-ego_max	0.08617831071217855
sim_compute_robot_state-ego_mean	0.0744065547815144
sim_compute_robot_state-ego_median	0.07460545939068462
sim_compute_robot_state-ego_min	0.05604923906780425
sim_compute_sim_state_max	0.0433549698193868
sim_compute_sim_state_mean	0.03951897816036651
sim_compute_sim_state_median	0.03972476104210163
sim_compute_sim_state_min	0.03344127677735828
sim_physics_max	0.12689630587895712
sim_physics_mean	0.11136788111847336
sim_physics_median	0.11441794157028198
sim_physics_min	0.0853828475588844
sim_render-ego_max	0.06970129569371541
sim_render-ego_mean	0.06124427287647486
sim_render-ego_median	0.06145534197489421
sim_render-ego_min	0.04553328241620745
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.3600000000000145
survival_time_min	2.1000000000000005

No reset possible

20965

2868

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 16:02:06+00:00

2019-04-27 16:24:06+00:00

0:22:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6618321953718848
survival_time_median	2.799999999999998
deviation-center-line_median	0.1539069600685497
in-drivable-lane_median	0.5

other stats

agent_compute-ego_max	0.20023295126463236
agent_compute-ego_mean	0.18107487261399863
agent_compute-ego_median	0.18107648690541583
agent_compute-ego_min	0.16275385898702285
deviation-center-line_max	0.33876816302538065
deviation-center-line_mean	0.16480398817009012
deviation-center-line_min	0.08803040147239628
deviation-heading_max	3.169028366658603
deviation-heading_mean	1.0134985334661182
deviation-heading_median	0.8894633572639655
deviation-heading_min	0.17109644157637127
driven_any_max	2.4991996168646855
driven_any_mean	1.3550276410622764
driven_any_median	1.2450683356136338
driven_any_min	0.6304669082956122
driven_lanedir_consec_max	1.178888444815321
driven_lanedir_consec_mean	0.729157446337953
driven_lanedir_consec_min	0.27748449636054673
driven_lanedir_max	1.3336725659515851
driven_lanedir_mean	0.8106651393853994
driven_lanedir_median	0.7683340572351427
driven_lanedir_min	0.34557102311065613
in-drivable-lane_max	2.149999999999995
in-drivable-lane_mean	0.7366666666666654
in-drivable-lane_min	0.10000000000000007
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0468094694549512, "sim_physics": 0.1333758451721885, "survival_time": 2.2, "driven_lanedir": 0.6017107443817986, "sim_render-ego": 0.06812060963023793, "in-drivable-lane": 0.7999999999999996, "agent_compute-ego": 0.18534380197525024, "deviation-heading": 0.17109644157637127, "set_robot_commands": 0.09720329262993552, "deviation-center-line": 0.1260734574240712, "driven_lanedir_consec": 0.6017107443817986, "sim_compute_sim_state": 0.04023149338635531, "sim_compute_performance-ego": 0.07625832340934059, "sim_compute_robot_state-ego": 0.08472749861803922}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5976666553638803, "sim_physics": 0.11669362613133022, "survival_time": 3.4999999999999956, "driven_lanedir": 1.1897082042802245, "sim_render-ego": 0.06417696135384696, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.17467100279671804, "deviation-heading": 1.540831380838597, "set_robot_commands": 0.09502672127314976, "deviation-center-line": 0.27830626591106444, "driven_lanedir_consec": 1.1339592810336134, "sim_compute_sim_state": 0.037985648427690775, "sim_compute_performance-ego": 0.06745916434696743, "sim_compute_robot_state-ego": 0.07078158514840262}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6304669082956122, "sim_physics": 0.12040019697613186, "survival_time": 1.800000000000001, "driven_lanedir": 0.34557102311065613, "sim_render-ego": 0.06326509846581353, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.17002956734763253, "deviation-heading": 0.8957859987902634, "set_robot_commands": 0.09279911385642158, "deviation-center-line": 0.11127868186691012, "driven_lanedir_consec": 0.27748449636054673, "sim_compute_sim_state": 0.03673998514811198, "sim_compute_performance-ego": 0.07063384850819905, "sim_compute_robot_state-ego": 0.0761789149708218}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4991996168646855, "sim_physics": 0.12256118123845536, "survival_time": 6.449999999999985, "driven_lanedir": 1.3336725659515851, "sim_render-ego": 0.06331055848173393, "in-drivable-lane": 1.449999999999996, "agent_compute-ego": 0.18127059382061625, "deviation-heading": 3.169028366658603, "set_robot_commands": 0.09826406952022582, "deviation-center-line": 0.33876816302538065, "driven_lanedir_consec": 0.8330821733490361, "sim_compute_sim_state": 0.04003985353218493, "sim_compute_performance-ego": 0.07030276919520179, "sim_compute_robot_state-ego": 0.07576379110646803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5172175051035184, "sim_physics": 0.12048929352914134, "survival_time": 3.099999999999997, "driven_lanedir": 0.992271899317832, "sim_render-ego": 0.06289224086269256, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.17894051151890908, "deviation-heading": 0.17709814710669028, "set_robot_commands": 0.0965479689259683, "deviation-center-line": 0.18988211084516624, "driven_lanedir_consec": 0.992271899317832, "sim_compute_sim_state": 0.04202811948714718, "sim_compute_performance-ego": 0.0725511004847865, "sim_compute_robot_state-ego": 0.07613098236822313}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.9522926396557352, "sim_physics": 0.1301970332860947, "survival_time": 3.999999999999994, "driven_lanedir": 0.5050134566469384, "sim_render-ego": 0.06297040283679962, "in-drivable-lane": 2.149999999999995, "agent_compute-ego": 0.18399904072284695, "deviation-heading": 1.1536021275496569, "set_robot_commands": 0.0979436367750168, "deviation-center-line": 0.12638216128899585, "driven_lanedir_consec": 0.5050134566469384, "sim_compute_sim_state": 0.0405597060918808, "sim_compute_performance-ego": 0.06856100261211395, "sim_compute_robot_state-ego": 0.07814750075340271}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.8066306023723698, "sim_physics": 0.14957662005173533, "survival_time": 1.900000000000001, "driven_lanedir": 0.5184081472354793, "sim_render-ego": 0.06290180432169061, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.20023295126463236, "deviation-heading": 0.6081751472934191, "set_robot_commands": 0.10200647303932592, "deviation-center-line": 0.10688912345154727, "driven_lanedir_consec": 0.4996194744690303, "sim_compute_sim_state": 0.0439510094492059, "sim_compute_performance-ego": 0.07364919938539204, "sim_compute_robot_state-ego": 0.08825407530132093}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.8969432832014648, "sim_physics": 0.12132791110447474, "survival_time": 3.8499999999999943, "driven_lanedir": 0.9358470944577976, "sim_render-ego": 0.05926294141001515, "in-drivable-lane": 1.5999999999999972, "agent_compute-ego": 0.18026429027706, "deviation-heading": 0.8894633572639655, "set_robot_commands": 0.09602312917833204, "deviation-center-line": 0.15894873938907766, "driven_lanedir_consec": 0.9358470944577976, "sim_compute_sim_state": 0.04083569947775308, "sim_compute_performance-ego": 0.06748911312648229, "sim_compute_robot_state-ego": 0.07205264599292309}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2450683356136338, "sim_physics": 0.11958414316177368, "survival_time": 2.799999999999998, "driven_lanedir": 0.9552167561361352, "sim_render-ego": 0.06358319095202855, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.18016423923628672, "deviation-heading": 1.0719702232394532, "set_robot_commands": 0.09852217776434762, "deviation-center-line": 0.17247235932964516, "driven_lanedir_consec": 0.8451894912108902, "sim_compute_sim_state": 0.04299392870494297, "sim_compute_performance-ego": 0.066717015845435, "sim_compute_robot_state-ego": 0.07204238431794303}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.013292588189051, "sim_physics": 0.1184267486844744, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6646171787896209, "sim_render-ego": 0.05788903009323847, "in-drivable-lane": 0.5, "agent_compute-ego": 0.18107648690541583, "deviation-heading": 0.4120201364805494, "set_robot_commands": 0.09629486288343156, "deviation-center-line": 0.09207329369738594, "driven_lanedir_consec": 0.6618321953718848, "sim_compute_sim_state": 0.03741376172928583, "sim_compute_performance-ego": 0.06602245853060767, "sim_compute_robot_state-ego": 0.07130813598632812}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.6527277913110758, "sim_physics": 0.1183324701645795, "survival_time": 3.399999999999996, "driven_lanedir": 1.1907568684718202, "sim_render-ego": 0.05302990885341869, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.16275385898702285, "deviation-heading": 0.4985598628185827, "set_robot_commands": 0.08673663700328153, "deviation-center-line": 0.1539069600685497, "driven_lanedir_consec": 1.178888444815321, "sim_compute_sim_state": 0.03635303763782277, "sim_compute_performance-ego": 0.06119210229200475, "sim_compute_robot_state-ego": 0.06605269628412583}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0064266593015756, "sim_physics": 0.13707490497165256, "survival_time": 2.25, "driven_lanedir": 0.5767937260556738, "sim_render-ego": 0.06266947852240669, "in-drivable-lane": 0.4999999999999995, "agent_compute-ego": 0.1875950601365831, "deviation-heading": 0.7851354650834198, "set_robot_commands": 0.08974924087524414, "deviation-center-line": 0.12242935425238102, "driven_lanedir_consec": 0.5718098333670779, "sim_compute_sim_state": 0.03908514976501465, "sim_compute_performance-ego": 0.06930112308926052, "sim_compute_robot_state-ego": 0.08703225983513727}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.743859854115065, "sim_physics": 0.1278190436186614, "survival_time": 4.049999999999994, "driven_lanedir": 1.2252740218259568, "sim_render-ego": 0.06619475211626218, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.1910247008005778, "deviation-heading": 2.0992789836650534, "set_robot_commands": 0.10287324881847994, "deviation-center-line": 0.23516979219832015, "driven_lanedir_consec": 1.0175542278330163, "sim_compute_sim_state": 0.0419031219717897, "sim_compute_performance-ego": 0.0739074077135251, "sim_compute_robot_state-ego": 0.08166958373269917}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.0462971822798006, "sim_physics": 0.13755502700805664, "survival_time": 2.499999999999999, "driven_lanedir": 0.7683340572351427, "sim_render-ego": 0.06439098834991455, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18925687789916992, "deviation-heading": 1.2885717860271213, "set_robot_commands": 0.10231482982635498, "deviation-center-line": 0.1714489583304597, "driven_lanedir_consec": 0.529447505368204, "sim_compute_sim_state": 0.040455803871154786, "sim_compute_performance-ego": 0.07295615673065185, "sim_compute_robot_state-ego": 0.08335443019866944}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6705155248117249, "sim_physics": 0.12363819515003878, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3567813468843295, "sim_render-ego": 0.061122494585373825, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1695001055212582, "deviation-heading": 0.4418605776000256, "set_robot_commands": 0.09698684075299432, "deviation-center-line": 0.08803040147239628, "driven_lanedir_consec": 0.3536513770863081, "sim_compute_sim_state": 0.040567755699157715, "sim_compute_performance-ego": 0.06623524778029498, "sim_compute_robot_state-ego": 0.07193930008832146}}
set_robot_commands_max	0.10287324881847994
set_robot_commands_mean	0.096619482874834
set_robot_commands_median	0.09698684075299432
set_robot_commands_min	0.08673663700328153
sim_compute_performance-ego_max	0.07625832340934059
sim_compute_performance-ego_mean	0.06954906887001755
sim_compute_performance-ego_median	0.06930112308926052
sim_compute_performance-ego_min	0.06119210229200475
sim_compute_robot_state-ego_max	0.08825407530132093
sim_compute_robot_state-ego_mean	0.07702905231352174
sim_compute_robot_state-ego_median	0.07613098236822313
sim_compute_robot_state-ego_min	0.06605269628412583
sim_compute_sim_state_max	0.0439510094492059
sim_compute_sim_state_mean	0.04007627162529989
sim_compute_sim_state_median	0.040455803871154786
sim_compute_sim_state_min	0.03635303763782277
sim_physics_max	0.14957662005173533
sim_physics_mean	0.12647014934991926
sim_physics_median	0.12256118123845536
sim_physics_min	0.11669362613133022
sim_render-ego_max	0.06812060963023793
sim_render-ego_mean	0.06238536405569821
sim_render-ego_median	0.06297040283679962
sim_render-ego_min	0.05302990885341869
simulation-passed	1
survival_time_max	6.449999999999985
survival_time_mean	3.039999999999998
survival_time_min	1.7000000000000008

No reset possible

20941

2912

Thies Lennart Alff 🇩🇪

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 15:35:35+00:00

2019-04-27 16:00:11+00:00

0:24:36

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2912/step1-simulation-ip-172-31-42-167-7357-job20941/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20917

2948

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 15:00:35+00:00

2019-04-27 15:34:26+00:00

0:33:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06481553712617039
survival_time_median	1.6000000000000008
deviation-center-line_median	0.08053590386253318
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.18929727615848663
agent_compute-ego_mean	0.1644376292033725
agent_compute-ego_median	0.16009040439830108
agent_compute-ego_min	0.15344068637261024
deviation-center-line_max	0.7986806623683785
deviation-center-line_mean	0.17971802946020424
deviation-center-line_min	0.025758639196128363
deviation-heading_max	6.052239721856253
deviation-heading_mean	1.732074367672169
deviation-heading_median	0.6758109176661168
deviation-heading_min	0.6012851139729924
driven_any_max	1.757078449678158
driven_any_mean	0.4538001271754034
driven_any_median	0.15632563756824455
driven_any_min	0.09527766237505804
driven_lanedir_consec_max	0.6156158615248244
driven_lanedir_consec_mean	0.16233288798354242
driven_lanedir_consec_min	0.04188700493005726
driven_lanedir_max	0.6156158615248244
driven_lanedir_mean	0.16233288798354242
driven_lanedir_median	0.06481553712617039
driven_lanedir_min	0.04188700493005726
in-drivable-lane_max	7.650000000000039
in-drivable-lane_mean	1.7166666666666734
in-drivable-lane_min	0.05000000000000005
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6595498753473366, "sim_physics": 0.16429112593332926, "survival_time": 14.950000000000076, "driven_lanedir": 0.5829868447427584, "sim_render-ego": 0.057361466884613035, "in-drivable-lane": 6.800000000000027, "agent_compute-ego": 0.1556210970878601, "deviation-heading": 6.052239721856253, "set_robot_commands": 0.08798375050226848, "deviation-center-line": 0.6996489108842836, "driven_lanedir_consec": 0.5829868447427584, "sim_compute_sim_state": 0.03631045023600261, "sim_compute_performance-ego": 0.06331748882929485, "sim_compute_robot_state-ego": 0.0684581724802653, "sim_compute_robot_state-npc0": 0.06453133742014568, "sim_compute_robot_state-npc1": 0.063465629418691, "sim_compute_robot_state-npc2": 0.06277633349100749, "sim_compute_robot_state-npc3": 0.0628265905380249}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.757078449678158, "sim_physics": 0.16125000397364295, "survival_time": 14.950000000000076, "driven_lanedir": 0.5118497433661302, "sim_render-ego": 0.06041930516560872, "in-drivable-lane": 7.650000000000039, "agent_compute-ego": 0.1607869855562846, "deviation-heading": 5.93210529647649, "set_robot_commands": 0.09188658714294434, "deviation-center-line": 0.7986806623683785, "driven_lanedir_consec": 0.5118497433661302, "sim_compute_sim_state": 0.0377777361869812, "sim_compute_performance-ego": 0.0678668737411499, "sim_compute_robot_state-ego": 0.0714549700419108, "sim_compute_robot_state-npc0": 0.06824642976125081, "sim_compute_robot_state-npc1": 0.06694263617197672, "sim_compute_robot_state-npc2": 0.06727129936218262, "sim_compute_robot_state-npc3": 0.0683403746287028}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09927131392417624, "sim_physics": 0.18745054801305136, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05817704532029033, "sim_render-ego": 0.05827202399571737, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15966572364171347, "deviation-heading": 0.6459851913949295, "set_robot_commands": 0.08133623003959656, "deviation-center-line": 0.09847253119841116, "driven_lanedir_consec": 0.05817704532029033, "sim_compute_sim_state": 0.03729638457298279, "sim_compute_performance-ego": 0.061439961194992065, "sim_compute_robot_state-ego": 0.07258235414822896, "sim_compute_robot_state-npc0": 0.05641176303227743, "sim_compute_robot_state-npc1": 0.06363168358802795, "sim_compute_robot_state-npc2": 0.063417782386144, "sim_compute_robot_state-npc3": 0.06420780221621196}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09527766237505804, "sim_physics": 0.20899818340937296, "survival_time": 1.2000000000000004, "driven_lanedir": 0.04739903502737919, "sim_render-ego": 0.06722187995910645, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18842445810635888, "deviation-heading": 0.6305895418735279, "set_robot_commands": 0.09510867794354756, "deviation-center-line": 0.08695938405747548, "driven_lanedir_consec": 0.04739903502737919, "sim_compute_sim_state": 0.03857185443242391, "sim_compute_performance-ego": 0.07031347354253133, "sim_compute_robot_state-ego": 0.08252933621406555, "sim_compute_robot_state-npc0": 0.10826231042544048, "sim_compute_robot_state-npc1": 0.06777151425679524, "sim_compute_robot_state-npc2": 0.06486206253369649, "sim_compute_robot_state-npc3": 0.0666106641292572}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15632563756824455, "sim_physics": 0.1584007740020752, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06013919488479624, "sim_render-ego": 0.06359090010325114, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1649387836456299, "deviation-heading": 0.7928984796735065, "set_robot_commands": 0.09008013407389324, "deviation-center-line": 0.04252712694956964, "driven_lanedir_consec": 0.06013919488479624, "sim_compute_sim_state": 0.03414951165517171, "sim_compute_performance-ego": 0.06653377215067545, "sim_compute_robot_state-ego": 0.0695821205774943, "sim_compute_robot_state-npc0": 0.07268795172373453, "sim_compute_robot_state-npc1": 0.06445353825887044, "sim_compute_robot_state-npc2": 0.06502546469370524, "sim_compute_robot_state-npc3": 0.06909305254618327}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.693640022206611, "sim_physics": 0.16750123262405395, "survival_time": 14.950000000000076, "driven_lanedir": 0.6156158615248244, "sim_render-ego": 0.05892645438512167, "in-drivable-lane": 6.850000000000033, "agent_compute-ego": 0.16424763917922974, "deviation-heading": 5.904144285652466, "set_robot_commands": 0.09224626302719116, "deviation-center-line": 0.4325592402773382, "driven_lanedir_consec": 0.6156158615248244, "sim_compute_sim_state": 0.03698911190032959, "sim_compute_performance-ego": 0.06665172417958577, "sim_compute_robot_state-ego": 0.07210466066996256, "sim_compute_robot_state-npc0": 0.06670098543167115, "sim_compute_robot_state-npc1": 0.06786844650904338, "sim_compute_robot_state-npc2": 0.0653201691309611, "sim_compute_robot_state-npc3": 0.06491451660792033}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11942613073422918, "sim_physics": 0.18210075451777533, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06481553712617039, "sim_render-ego": 0.05924355983734131, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15344068637261024, "deviation-heading": 0.6503807351360573, "set_robot_commands": 0.09508889455061692, "deviation-center-line": 0.07502324503973785, "driven_lanedir_consec": 0.06481553712617039, "sim_compute_sim_state": 0.037120929131141074, "sim_compute_performance-ego": 0.06584718594184288, "sim_compute_robot_state-ego": 0.07033398518195519, "sim_compute_robot_state-npc0": 0.06711895649249737, "sim_compute_robot_state-npc1": 0.0680236999805157, "sim_compute_robot_state-npc2": 0.06919794816237229, "sim_compute_robot_state-npc3": 0.06637866680438702}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.14995924614593897, "sim_physics": 0.2080952659729988, "survival_time": 1.5500000000000007, "driven_lanedir": 0.08509676720036063, "sim_render-ego": 0.07166978620713757, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.18929727615848663, "deviation-heading": 0.6258454103811075, "set_robot_commands": 0.0984033461539976, "deviation-center-line": 0.0839074818395644, "driven_lanedir_consec": 0.08509676720036063, "sim_compute_sim_state": 0.03733797227182696, "sim_compute_performance-ego": 0.07414014877811555, "sim_compute_robot_state-ego": 0.07684820698153588, "sim_compute_robot_state-npc0": 0.07384800141857516, "sim_compute_robot_state-npc1": 0.0738211908648091, "sim_compute_robot_state-npc2": 0.07362407253634545, "sim_compute_robot_state-npc3": 0.0715084768110706}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.18707780959653236, "sim_physics": 0.17578075383160566, "survival_time": 1.850000000000001, "driven_lanedir": 0.0732936044711896, "sim_render-ego": 0.06102698558085674, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15971587799690865, "deviation-heading": 0.6914397861499748, "set_robot_commands": 0.09369566633894635, "deviation-center-line": 0.0292885267833539, "driven_lanedir_consec": 0.0732936044711896, "sim_compute_sim_state": 0.03645200987119932, "sim_compute_performance-ego": 0.06627299978926375, "sim_compute_robot_state-ego": 0.07351957140742121, "sim_compute_robot_state-npc0": 0.0677844898120777, "sim_compute_robot_state-npc1": 0.0649556727022738, "sim_compute_robot_state-npc2": 0.06448165146080223, "sim_compute_robot_state-npc3": 0.06586719848014214}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1735994713764654, "sim_physics": 0.17584635229671702, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04742463041065603, "sim_render-ego": 0.06507856004378375, "in-drivable-lane": 0.7500000000000006, "agent_compute-ego": 0.16962327676660874, "deviation-heading": 0.6430169211583546, "set_robot_commands": 0.0937200153575224, "deviation-center-line": 0.026977474889226676, "driven_lanedir_consec": 0.04742463041065603, "sim_compute_sim_state": 0.036986645530251896, "sim_compute_performance-ego": 0.07344323747298297, "sim_compute_robot_state-ego": 0.07827916566063375, "sim_compute_robot_state-npc0": 0.07122137967277975, "sim_compute_robot_state-npc1": 0.07081244272344253, "sim_compute_robot_state-npc2": 0.06765982683967142, "sim_compute_robot_state-npc3": 0.06750111720141243}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15208197713548166, "sim_physics": 0.17977002263069153, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04188700493005726, "sim_render-ego": 0.06070402264595032, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.15376143902540207, "deviation-heading": 0.748046304025355, "set_robot_commands": 0.08966068178415298, "deviation-center-line": 0.025758639196128363, "driven_lanedir_consec": 0.04188700493005726, "sim_compute_sim_state": 0.03692294657230377, "sim_compute_performance-ego": 0.06671988219022751, "sim_compute_robot_state-ego": 0.06660931557416916, "sim_compute_robot_state-npc0": 0.06386034935712814, "sim_compute_robot_state-npc1": 0.06154506653547287, "sim_compute_robot_state-npc2": 0.06312277913093567, "sim_compute_robot_state-npc3": 0.06149169057607651}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09678849122717076, "sim_physics": 0.16304415464401245, "survival_time": 1.2000000000000004, "driven_lanedir": 0.047711499008281866, "sim_render-ego": 0.060817062854766846, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17243204514185587, "deviation-heading": 0.6012851139729924, "set_robot_commands": 0.09780473510424297, "deviation-center-line": 0.08053590386253318, "driven_lanedir_consec": 0.047711499008281866, "sim_compute_sim_state": 0.03821874658266703, "sim_compute_performance-ego": 0.06685907642046611, "sim_compute_robot_state-ego": 0.07253339886665344, "sim_compute_robot_state-npc0": 0.0696623722712199, "sim_compute_robot_state-npc1": 0.07015801469484965, "sim_compute_robot_state-npc2": 0.06594756245613098, "sim_compute_robot_state-npc3": 0.06452138225237529}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2038146161237436, "sim_physics": 0.16495829093747022, "survival_time": 2.0500000000000007, "driven_lanedir": 0.06648992496691108, "sim_render-ego": 0.057670587446631456, "in-drivable-lane": 0.8000000000000003, "agent_compute-ego": 0.15501721312360064, "deviation-heading": 0.7148369409772203, "set_robot_commands": 0.08602174898473228, "deviation-center-line": 0.06434703655678954, "driven_lanedir_consec": 0.06648992496691108, "sim_compute_sim_state": 0.03628352793251595, "sim_compute_performance-ego": 0.06219751660416766, "sim_compute_robot_state-ego": 0.06533288374179747, "sim_compute_robot_state-npc0": 0.06436554397024759, "sim_compute_robot_state-npc1": 0.06193810555993057, "sim_compute_robot_state-npc2": 0.06538067794427639, "sim_compute_robot_state-npc3": 0.06349419965976622}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.10142299287014674, "sim_physics": 0.17874651369841202, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05548765935886468, "sim_render-ego": 0.058134939359581986, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15950153184973676, "deviation-heading": 0.6724908686881838, "set_robot_commands": 0.08791869619618291, "deviation-center-line": 0.0830789755667409, "driven_lanedir_consec": 0.05548765935886468, "sim_compute_sim_state": 0.03738846986190132, "sim_compute_performance-ego": 0.06894000716831374, "sim_compute_robot_state-ego": 0.06981244294539742, "sim_compute_robot_state-npc0": 0.06597391418788744, "sim_compute_robot_state-npc1": 0.06148063618203868, "sim_compute_robot_state-npc2": 0.060370497081590736, "sim_compute_robot_state-npc3": 0.0638261256010636}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1616882113217577, "sim_physics": 0.16675789917216582, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07661896741446572, "sim_render-ego": 0.06011756728677189, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16009040439830108, "deviation-heading": 0.6758109176661168, "set_robot_commands": 0.09075436171363382, "deviation-center-line": 0.0680053024335324, "driven_lanedir_consec": 0.07661896741446572, "sim_compute_sim_state": 0.03646157769595876, "sim_compute_performance-ego": 0.06765529688666849, "sim_compute_robot_state-ego": 0.07033402779523064, "sim_compute_robot_state-npc0": 0.06554879160488353, "sim_compute_robot_state-npc1": 0.06768021864049575, "sim_compute_robot_state-npc2": 0.0776597962659948, "sim_compute_robot_state-npc3": 0.06729046737446505}}
set_robot_commands_max	0.0984033461539976
set_robot_commands_mean	0.09144731926089798
set_robot_commands_median	0.09188658714294434
set_robot_commands_min	0.08133623003959656
sim_compute_performance-ego_max	0.07414014877811555
sim_compute_performance-ego_mean	0.06721324299268519
sim_compute_performance-ego_median	0.06671988219022751
sim_compute_performance-ego_min	0.061439961194992065
sim_compute_robot_state-ego_max	0.08252933621406555
sim_compute_robot_state-ego_mean	0.0720209741524481
sim_compute_robot_state-ego_median	0.0714549700419108
sim_compute_robot_state-ego_min	0.06533288374179747
sim_compute_robot_state-npc0_max	0.10826231042544048
sim_compute_robot_state-npc0_mean	0.06974830510545445
sim_compute_robot_state-npc0_median	0.06711895649249737
sim_compute_robot_state-npc0_min	0.05641176303227743
sim_compute_robot_state-npc1_max	0.0738211908648091
sim_compute_robot_state-npc1_mean	0.06630323307248222
sim_compute_robot_state-npc1_median	0.06694263617197672
sim_compute_robot_state-npc1_min	0.06148063618203868
sim_compute_robot_state-npc2_max	0.0776597962659948
sim_compute_robot_state-npc2_mean	0.06640786156505446
sim_compute_robot_state-npc2_median	0.0653201691309611
sim_compute_robot_state-npc2_min	0.060370497081590736
sim_compute_robot_state-npc3_max	0.0715084768110706
sim_compute_robot_state-npc3_mean	0.06585815502847062
sim_compute_robot_state-npc3_median	0.06586719848014214
sim_compute_robot_state-npc3_min	0.06149169057607651
sim_compute_sim_state_max	0.03857185443242391
sim_compute_sim_state_mean	0.036951191628910536
sim_compute_sim_state_median	0.03698911190032959
sim_compute_sim_state_min	0.03414951165517171
sim_physics_max	0.20899818340937296
sim_physics_mean	0.1761994583771583
sim_physics_median	0.17578075383160566
sim_physics_min	0.1584007740020752
sim_render-ego_max	0.07166978620713757
sim_render-ego_mean	0.06135034011708269
sim_render-ego_median	0.06041930516560872
sim_render-ego_min	0.057361466884613035
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.190000000000016
survival_time_min	1.1500000000000004

No reset possible

20905

2960

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 14:56:39+00:00

2019-04-27 15:00:09+00:00

0:03:30

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2960/step1-simulation-ip-172-31-42-167-7357-job20905/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20860

3064

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 14:00:31+00:00

2019-04-27 14:56:11+00:00

0:55:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6523240082563025
survival_time_median	12.650000000000045
deviation-center-line_median	0.5953043214119251
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.26157378399465964
agent_compute-ego_mean	0.20814646252113456
agent_compute-ego_median	0.2106568916638692
agent_compute-ego_min	0.16425865809122722
deviation-center-line_max	1.2171177182330184
deviation-center-line_mean	0.6907259034506872
deviation-center-line_min	0.4045264267617618
deviation-heading_max	3.5560693107984767
deviation-heading_mean	1.7270421867244328
deviation-heading_median	1.7980735870244908
deviation-heading_min	0.16792099924859266
driven_any_max	1.219699516636652
driven_any_mean	0.8879355368571517
driven_any_median	0.9956764758809086
driven_any_min	0.271780030825251
driven_lanedir_consec_max	1.2170036305209848
driven_lanedir_consec_mean	0.7659108050549978
driven_lanedir_consec_min	0.26504279849886814
driven_lanedir_max	1.2170036305209848
driven_lanedir_mean	0.7659108050549978
driven_lanedir_median	0.6523240082563025
driven_lanedir_min	0.26504279849886814
in-drivable-lane_max	4.350000000000062
in-drivable-lane_mean	1.113333333333349
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0182088072267623, "sim_physics": 0.1396547283713273, "survival_time": 12.700000000000044, "driven_lanedir": 0.6638163524254224, "sim_render-ego": 0.07195449157023993, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.26157378399465964, "deviation-heading": 3.5560693107984767, "set_robot_commands": 0.11570402299325296, "deviation-center-line": 0.5485266957093649, "driven_lanedir_consec": 0.6638163524254224, "sim_compute_sim_state": 0.04591660799942617, "sim_compute_performance-ego": 0.08132659262559545, "sim_compute_robot_state-ego": 0.08697716082174947}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9993417829299396, "sim_physics": 0.1170262834057212, "survival_time": 12.800000000000049, "driven_lanedir": 0.8368606887654501, "sim_render-ego": 0.06137991324067116, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.2233696011826396, "deviation-heading": 2.7869759774508465, "set_robot_commands": 0.09760731551796198, "deviation-center-line": 0.8146350958289812, "driven_lanedir_consec": 0.8368606887654501, "sim_compute_sim_state": 0.03939247038215399, "sim_compute_performance-ego": 0.06894868053495884, "sim_compute_robot_state-ego": 0.07409333623945713}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.271780030825251, "sim_physics": 0.10517922607628076, "survival_time": 3.699999999999995, "driven_lanedir": 0.26504279849886814, "sim_render-ego": 0.05754020729580441, "in-drivable-lane": 0, "agent_compute-ego": 0.19839380238507243, "deviation-heading": 0.8179445990514, "set_robot_commands": 0.08908518907186147, "deviation-center-line": 0.4045264267617618, "driven_lanedir_consec": 0.26504279849886814, "sim_compute_sim_state": 0.03735714345364957, "sim_compute_performance-ego": 0.06460251034917058, "sim_compute_robot_state-ego": 0.06899631023406982}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4684384601869749, "sim_physics": 0.10502446387424942, "survival_time": 6.0499999999999865, "driven_lanedir": 0.4477531320405155, "sim_render-ego": 0.05852276628667658, "in-drivable-lane": 0, "agent_compute-ego": 0.2008962434185438, "deviation-heading": 1.7980735870244908, "set_robot_commands": 0.08639988820414898, "deviation-center-line": 0.44966413762168134, "driven_lanedir_consec": 0.4477531320405155, "sim_compute_sim_state": 0.035696096656736266, "sim_compute_performance-ego": 0.06808819455548751, "sim_compute_robot_state-ego": 0.06851027622695796}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2027844297639856, "sim_physics": 0.10803059260050456, "survival_time": 14.950000000000076, "driven_lanedir": 1.177837187361293, "sim_render-ego": 0.06242657820383707, "in-drivable-lane": 0, "agent_compute-ego": 0.2172111988067627, "deviation-heading": 1.8112094121737237, "set_robot_commands": 0.09331000407536824, "deviation-center-line": 0.7353624172432771, "driven_lanedir_consec": 1.177837187361293, "sim_compute_sim_state": 0.0390433939297994, "sim_compute_performance-ego": 0.06800866921742757, "sim_compute_robot_state-ego": 0.07359510024388631}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4810419481852173, "sim_physics": 0.10395874295915876, "survival_time": 6.299999999999986, "driven_lanedir": 0.4578426505439186, "sim_render-ego": 0.05609900800008622, "in-drivable-lane": 0, "agent_compute-ego": 0.19800470367310535, "deviation-heading": 1.9402531210310952, "set_robot_commands": 0.08482909770238967, "deviation-center-line": 0.4934138003227537, "driven_lanedir_consec": 0.4578426505439186, "sim_compute_sim_state": 0.035686137184264166, "sim_compute_performance-ego": 0.06905620060269795, "sim_compute_robot_state-ego": 0.0680582220592196}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9956764758809086, "sim_physics": 0.1026452972954912, "survival_time": 12.650000000000045, "driven_lanedir": 0.6161863728044286, "sim_render-ego": 0.06071881625963294, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.2131653124164687, "deviation-heading": 1.8595594269002296, "set_robot_commands": 0.09066810909467252, "deviation-center-line": 0.5010265689470553, "driven_lanedir_consec": 0.6161863728044286, "sim_compute_sim_state": 0.03869987382247985, "sim_compute_performance-ego": 0.06749280733553317, "sim_compute_robot_state-ego": 0.07230110413472172}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.28025312636431154, "sim_physics": 0.10193746904783613, "survival_time": 3.949999999999994, "driven_lanedir": 0.27249823287446695, "sim_render-ego": 0.05624683899215505, "in-drivable-lane": 0, "agent_compute-ego": 0.1909859814221346, "deviation-heading": 0.9209015091609934, "set_robot_commands": 0.08535062210469306, "deviation-center-line": 0.4220809791841777, "driven_lanedir_consec": 0.27249823287446695, "sim_compute_sim_state": 0.03780096392088299, "sim_compute_performance-ego": 0.06433557558663283, "sim_compute_robot_state-ego": 0.06886532336850709}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.205281109718533, "sim_physics": 0.11394601901372274, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028575181014998, "sim_render-ego": 0.0611337415377299, "in-drivable-lane": 0, "agent_compute-ego": 0.21416296084721884, "deviation-heading": 0.7095458329423281, "set_robot_commands": 0.0939766279856364, "deviation-center-line": 0.9600869493681972, "driven_lanedir_consec": 1.2028575181014998, "sim_compute_sim_state": 0.03886416912078858, "sim_compute_performance-ego": 0.06733304897944133, "sim_compute_robot_state-ego": 0.0733140206336975}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9932857153906, "sim_physics": 0.11293205618858336, "survival_time": 12.40000000000004, "driven_lanedir": 0.6467151093499586, "sim_render-ego": 0.05872334203412456, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.2015536379429602, "deviation-heading": 2.9544895475948003, "set_robot_commands": 0.08622871771935493, "deviation-center-line": 0.6708993268183443, "driven_lanedir_consec": 0.6467151093499586, "sim_compute_sim_state": 0.0385498462184783, "sim_compute_performance-ego": 0.0654356143166942, "sim_compute_robot_state-ego": 0.07039638296250374}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2062955102460646, "sim_physics": 0.08524036248524984, "survival_time": 14.950000000000076, "driven_lanedir": 1.1813825200561072, "sim_render-ego": 0.04886703650156657, "in-drivable-lane": 0, "agent_compute-ego": 0.16425865809122722, "deviation-heading": 1.2738045958514146, "set_robot_commands": 0.07012849966684977, "deviation-center-line": 1.0526894092074612, "driven_lanedir_consec": 1.1813825200561072, "sim_compute_sim_state": 0.030510245164235433, "sim_compute_performance-ego": 0.05075741688410441, "sim_compute_robot_state-ego": 0.05895324230194092}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9938254169584152, "sim_physics": 0.0945235759981217, "survival_time": 12.40000000000004, "driven_lanedir": 0.6523240082563025, "sim_render-ego": 0.05494209835606237, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.1850911234655688, "deviation-heading": 2.9060636747790514, "set_robot_commands": 0.08451469002231475, "deviation-center-line": 0.5953043214119251, "driven_lanedir_consec": 0.6523240082563025, "sim_compute_sim_state": 0.03527496514781829, "sim_compute_performance-ego": 0.06352757253954487, "sim_compute_robot_state-ego": 0.06416554027988065}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7835333983011468, "sim_physics": 0.1110816025853756, "survival_time": 9.950000000000006, "driven_lanedir": 0.6511025943751279, "sim_render-ego": 0.06248449200960859, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.23083465422817212, "deviation-heading": 1.7069568884599495, "set_robot_commands": 0.0959302995672178, "deviation-center-line": 0.49012224054366976, "driven_lanedir_consec": 0.6511025943751279, "sim_compute_sim_state": 0.039972573668513464, "sim_compute_performance-ego": 0.07093000651603967, "sim_compute_robot_state-ego": 0.07887132563183655}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.219699516636652, "sim_physics": 0.1056640068689982, "survival_time": 14.950000000000076, "driven_lanedir": 1.2170036305209848, "sim_render-ego": 0.060714329878489175, "in-drivable-lane": 0, "agent_compute-ego": 0.2106568916638692, "deviation-heading": 0.6958643183991009, "set_robot_commands": 0.09154264052708944, "deviation-center-line": 1.00543246455864, "driven_lanedir_consec": 1.2170036305209848, "sim_compute_sim_state": 0.038620492617289226, "sim_compute_performance-ego": 0.06643505732218424, "sim_compute_robot_state-ego": 0.07066634178161621}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.199587324242512, "sim_physics": 0.1038726274172465, "survival_time": 14.950000000000076, "driven_lanedir": 1.1994392798506217, "sim_render-ego": 0.05982819716135661, "in-drivable-lane": 0, "agent_compute-ego": 0.21203838427861532, "deviation-heading": 0.16792099924859266, "set_robot_commands": 0.08948752482732138, "deviation-center-line": 1.2171177182330184, "driven_lanedir_consec": 1.1994392798506217, "sim_compute_sim_state": 0.038060081799825035, "sim_compute_performance-ego": 0.06710414409637451, "sim_compute_robot_state-ego": 0.07232598622639974}}
set_robot_commands_max	0.11570402299325296
set_robot_commands_mean	0.09031754993867556
set_robot_commands_median	0.08948752482732138
set_robot_commands_min	0.07012849966684977
sim_compute_performance-ego_max	0.08132659262559545
sim_compute_performance-ego_mean	0.06689213943079247
sim_compute_performance-ego_median	0.06733304897944133
sim_compute_performance-ego_min	0.05075741688410441
sim_compute_robot_state-ego_max	0.08697716082174947
sim_compute_robot_state-ego_mean	0.07133931154309628
sim_compute_robot_state-ego_median	0.07066634178161621
sim_compute_robot_state-ego_min	0.05895324230194092
sim_compute_sim_state_max	0.04591660799942617
sim_compute_sim_state_mean	0.037963004072422715
sim_compute_sim_state_median	0.0385498462184783
sim_compute_sim_state_min	0.030510245164235433
sim_physics_max	0.1396547283713273
sim_physics_mean	0.1073811369458578
sim_physics_median	0.10517922607628076
sim_physics_min	0.08524036248524984
sim_render-ego_max	0.07195449157023993
sim_render-ego_mean	0.059438790488536064
sim_render-ego_median	0.05982819716135661
sim_render-ego_min	0.04886703650156657
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.176666666666703
survival_time_min	3.699999999999995

No reset possible

20828

3094

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 13:24:26+00:00

2019-04-27 14:00:10+00:00

0:35:44

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3094/step1-simulation-ip-172-31-42-167-7357-job20828/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20811

3097

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 13:01:19+00:00

2019-04-27 13:24:12+00:00

0:22:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.343427326836246
survival_time_median	9.349999999999998
deviation-center-line_median	0.5775715240337054
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.1483386978108615
agent_compute-ego_mean	0.1388748972797151
agent_compute-ego_median	0.13884421787430754
agent_compute-ego_min	0.12614043553670248
deviation-center-line_max	1.177032060148078
deviation-center-line_mean	0.6609065253271865
deviation-center-line_min	0.23312586433769497
deviation-heading_max	5.09896429028419
deviation-heading_mean	3.0711717934290963
deviation-heading_median	3.0875248732283667
deviation-heading_min	1.0206458230028264
driven_any_max	2.3490319134002453
driven_any_mean	1.500497848136467
driven_any_median	1.448931251397255
driven_any_min	0.5088497570011956
driven_lanedir_consec_max	2.1369788889663743
driven_lanedir_consec_mean	1.3177621750801296
driven_lanedir_consec_min	0.4778324842405466
driven_lanedir_max	2.1369788889663743
driven_lanedir_mean	1.3177621750801296
driven_lanedir_median	1.343427326836246
driven_lanedir_min	0.4778324842405466
in-drivable-lane_max	2.0999999999999925
in-drivable-lane_mean	0.4199999999999985
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8466654312004788, "sim_physics": 0.13175072079211209, "survival_time": 5.649999999999988, "driven_lanedir": 0.7682364779616835, "sim_render-ego": 0.07133742138347794, "in-drivable-lane": 0, "agent_compute-ego": 0.13884421787430754, "deviation-heading": 1.9456303953280456, "set_robot_commands": 0.10757107439294324, "deviation-center-line": 0.3803518767429933, "driven_lanedir_consec": 0.7682364779616835, "sim_compute_sim_state": 0.0420034227118028, "sim_compute_performance-ego": 0.07403644207304558, "sim_compute_robot_state-ego": 0.08146820448141183}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3490319134002453, "sim_physics": 0.12089053710301716, "survival_time": 14.950000000000076, "driven_lanedir": 1.8623356973957983, "sim_render-ego": 0.06533747831980387, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.12614043553670248, "deviation-heading": 4.203093585302054, "set_robot_commands": 0.10465420643488564, "deviation-center-line": 0.9364513013734608, "driven_lanedir_consec": 1.8623356973957983, "sim_compute_sim_state": 0.04061893383661906, "sim_compute_performance-ego": 0.07320932865142822, "sim_compute_robot_state-ego": 0.07920534133911133}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34901088768316, "sim_physics": 0.124845867951711, "survival_time": 14.950000000000076, "driven_lanedir": 2.1369788889663743, "sim_render-ego": 0.06808575789133707, "in-drivable-lane": 0, "agent_compute-ego": 0.14221592982610068, "deviation-heading": 5.09896429028419, "set_robot_commands": 0.10413959980010988, "deviation-center-line": 1.177032060148078, "driven_lanedir_consec": 2.1369788889663743, "sim_compute_sim_state": 0.042678682804107665, "sim_compute_performance-ego": 0.07505876382191976, "sim_compute_robot_state-ego": 0.0791965373357137}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5088497570011956, "sim_physics": 0.13344505514417376, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4778324842405466, "sim_render-ego": 0.0691370895930699, "in-drivable-lane": 0, "agent_compute-ego": 0.13883520535060337, "deviation-heading": 1.0206458230028264, "set_robot_commands": 0.11159477574484689, "deviation-center-line": 0.23312586433769497, "driven_lanedir_consec": 0.4778324842405466, "sim_compute_sim_state": 0.04307526520320347, "sim_compute_performance-ego": 0.07528556074414934, "sim_compute_robot_state-ego": 0.0877551691872733}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.448931251397255, "sim_physics": 0.13327209834746498, "survival_time": 9.349999999999998, "driven_lanedir": 1.343427326836246, "sim_render-ego": 0.06813389604741876, "in-drivable-lane": 0, "agent_compute-ego": 0.1483386978108615, "deviation-heading": 3.0875248732283667, "set_robot_commands": 0.1069069546174238, "deviation-center-line": 0.5775715240337054, "driven_lanedir_consec": 1.343427326836246, "sim_compute_sim_state": 0.04437337329680907, "sim_compute_performance-ego": 0.07481668849679876, "sim_compute_robot_state-ego": 0.08257427190076859}}
set_robot_commands_max	0.11159477574484689
set_robot_commands_mean	0.1069733221980419
set_robot_commands_median	0.1069069546174238
set_robot_commands_min	0.10413959980010988
sim_compute_performance-ego_max	0.07528556074414934
sim_compute_performance-ego_mean	0.07448135675746834
sim_compute_performance-ego_median	0.07481668849679876
sim_compute_performance-ego_min	0.07320932865142822
sim_compute_robot_state-ego_max	0.0877551691872733
sim_compute_robot_state-ego_mean	0.08203990484885575
sim_compute_robot_state-ego_median	0.08146820448141183
sim_compute_robot_state-ego_min	0.0791965373357137
sim_compute_sim_state_max	0.04437337329680907
sim_compute_sim_state_mean	0.042549935570508415
sim_compute_sim_state_median	0.042678682804107665
sim_compute_sim_state_min	0.04061893383661906
sim_physics_max	0.13344505514417376
sim_physics_mean	0.12884085586769584
sim_physics_median	0.13175072079211209
sim_physics_min	0.12089053710301716
sim_render-ego_max	0.07133742138347794
sim_render-ego_mean	0.06840632864702151
sim_render-ego_median	0.06813389604741876
sim_render-ego_min	0.06533747831980387
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.680000000000026
survival_time_min	3.4999999999999956

No reset possible

20780

2981

Julian Zilly

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 12:00:51+00:00

2019-04-27 13:00:05+00:00

0:59:14

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2981/step1-simulation-ip-172-31-42-167-7357-job20780/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20766

2970

Andrea Censi 🇨🇭

minimal_agent (Python 3)

step1-simulation

host-error