Evaluator 1588

ID	1588
evaluator	`ip-172-31-43-40-10497`
owner	I don't have one 😀
machine	ip-172-31-43-40
process	ip-172-31-43-40-10497
version	d-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard	2019-10-17 02:44:11+00:00
last heard	2019-11-08 10:54:22+00:00
status	inactive
# evaluating
# success	30 `24543`
# timeout
# failed	8 `24413`
# error	8 `24382`
# aborted
# host-error	5 `24348`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

25124

4391

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-07 14:24:09+00:00

2019-11-07 14:29:31+00:00

0:05:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.11667593935453972
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.025678829713301224
agent_compute-ego_mean	0.024223976461664243
agent_compute-ego_median	0.02392084833601831
agent_compute-ego_min	0.023092464605967204
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871985
deviation-heading_mean	0.4194004386292104
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829773
driven_any_max	0.9226822529128632
driven_any_mean	0.6324710235085376
driven_any_median	0.6091462024047467
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572033
driven_lanedir_consec_mean	0.4245071231796043
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572033
driven_lanedir_mean	0.4245071231796043
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.10972776547284194, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.013039024782852389, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.02392084833601831, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.009444136015126402, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0050524725040919346, "sim_compute_performance-ego": 0.007921732647318236, "sim_compute_robot_state-ego": 0.009462195382991308}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.11455992857615152, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.012713102499643962, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.023092464605967204, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.009717734654744466, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.0051361004511515295, "sim_compute_performance-ego": 0.007122854391733806, "sim_compute_robot_state-ego": 0.008997829755147298}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.13025086576288397, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.012995351444591177, "in-drivable-lane": 0, "agent_compute-ego": 0.025678829713301224, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.010756481777537952, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.005202087489041415, "sim_compute_performance-ego": 0.007299477403814142, "sim_compute_robot_state-ego": 0.010166168212890623}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.10727738837401073, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.014508311947186789, "in-drivable-lane": 0, "agent_compute-ego": 0.024555509289105732, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.00898370643456777, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.005211432774861653, "sim_compute_performance-ego": 0.007614612579345703, "sim_compute_robot_state-ego": 0.009511008858680723}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.1131454498871513, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.01268166562785273, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.023872230363928753, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.00964100982831872, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.004721268363620924, "sim_compute_performance-ego": 0.007059662238411282, "sim_compute_robot_state-ego": 0.009132950202278467}}
set_robot_commands_max	0.010756481777537952
set_robot_commands_mean	0.00970861374205906
set_robot_commands_median	0.00964100982831872
set_robot_commands_min	0.00898370643456777
sim_compute_performance-ego_max	0.007921732647318236
sim_compute_performance-ego_mean	0.007403667852124635
sim_compute_performance-ego_median	0.007299477403814142
sim_compute_performance-ego_min	0.007059662238411282
sim_compute_robot_state-ego_max	0.010166168212890623
sim_compute_robot_state-ego_mean	0.009454030482397685
sim_compute_robot_state-ego_median	0.009462195382991308
sim_compute_robot_state-ego_min	0.008997829755147298
sim_compute_sim_state_max	0.005211432774861653
sim_compute_sim_state_mean	0.005064672316553491
sim_compute_sim_state_median	0.0051361004511515295
sim_compute_sim_state_min	0.004721268363620924
sim_physics_max	0.13025086576288397
sim_physics_mean	0.1149922796146079
sim_physics_median	0.1131454498871513
sim_physics_min	0.10727738837401073
sim_render-ego_max	0.014508311947186789
sim_render-ego_mean	0.01318749126042541
sim_render-ego_median	0.012995351444591177
sim_render-ego_min	0.01268166562785273
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

25106

4383

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFV-sim-validation

step1-simulation

failed

ip-172-31-43-40-10497

2019-11-06 18:41:06+00:00

2019-11-06 18:45:57+00:00

0:04:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 81 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25088

4375

Frank (Chude) Qian 🇨🇦

Frank raw run 1

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-05 20:19:09+00:00

2019-11-05 20:27:18+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.32870355439955823
survival_time_median	4.899999999999991
deviation-center-line_median	0.38702284314232693
in-drivable-lane_median	1.0499999999999972

other stats

agent_compute-ego_max	0.017197109932123228
agent_compute-ego_mean	0.016581011137447192
agent_compute-ego_median	0.016407697995503744
agent_compute-ego_min	0.01605462286207411
deviation-center-line_max	0.9880789703788788
deviation-center-line_mean	0.5034155023615929
deviation-center-line_min	0.155020333881528
deviation-heading_max	10.088552450155104
deviation-heading_mean	4.665270325595186
deviation-heading_median	3.005070614137648
deviation-heading_min	0.966767730189758
driven_any_max	2.779706160052811
driven_any_mean	1.3415499694393358
driven_any_median	0.6580928928414701
driven_any_min	0.4711329088476454
driven_lanedir_consec_max	0.8332143525837425
driven_lanedir_consec_mean	0.42335620894735976
driven_lanedir_consec_min	0.10266488394332984
driven_lanedir_max	1.655745218871322
driven_lanedir_mean	0.7422195582689737
driven_lanedir_median	0.33663064624357464
driven_lanedir_min	0.2194750429326864
in-drivable-lane_max	2.050000000000008
in-drivable-lane_mean	1.2100000000000022
in-drivable-lane_min	0.6000000000000003
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.483533312735557, "sim_physics": 0.05577357425246128, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2194750429326864, "sim_render-ego": 0.007180297097494436, "in-drivable-lane": 0.6000000000000003, "agent_compute-ego": 0.017197109932123228, "deviation-heading": 0.966767730189758, "set_robot_commands": 0.004903837691905887, "deviation-center-line": 0.155020333881528, "driven_lanedir_consec": 0.1653130795047395, "sim_compute_sim_state": 0.0027620626050372456, "sim_compute_performance-ego": 0.004180492356766102, "sim_compute_robot_state-ego": 0.005027482675951581}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4711329088476454, "sim_physics": 0.05619765088913289, "survival_time": 4.699999999999991, "driven_lanedir": 0.23658873635320057, "sim_render-ego": 0.0071118917871028815, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.01686556542173345, "deviation-heading": 3.005070614137648, "set_robot_commands": 0.004994501458837631, "deviation-center-line": 0.3090317351515356, "driven_lanedir_consec": 0.10266488394332984, "sim_compute_sim_state": 0.0028976607829966443, "sim_compute_performance-ego": 0.003867524735471035, "sim_compute_robot_state-ego": 0.005236229998000125}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.779706160052811, "sim_physics": 0.0564067808787028, "survival_time": 14.950000000000076, "driven_lanedir": 1.655745218871322, "sim_render-ego": 0.006889675458272298, "in-drivable-lane": 1.5500000000000078, "agent_compute-ego": 0.016407697995503744, "deviation-heading": 10.088552450155104, "set_robot_commands": 0.004920221964518229, "deviation-center-line": 0.9880789703788788, "driven_lanedir_consec": 0.8332143525837425, "sim_compute_sim_state": 0.0028140807151794435, "sim_compute_performance-ego": 0.00390011469523112, "sim_compute_robot_state-ego": 0.005018161137898763}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6580928928414701, "sim_physics": 0.05685395124007245, "survival_time": 4.899999999999991, "driven_lanedir": 0.33663064624357464, "sim_render-ego": 0.0070753997685957925, "in-drivable-lane": 1.0499999999999972, "agent_compute-ego": 0.01638005947580143, "deviation-heading": 2.4552258864700796, "set_robot_commands": 0.004954248058552645, "deviation-center-line": 0.38702284314232693, "driven_lanedir_consec": 0.32870355439955823, "sim_compute_sim_state": 0.00288632937840053, "sim_compute_performance-ego": 0.00394425343494026, "sim_compute_robot_state-ego": 0.005065969058445522}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3152845727191953, "sim_physics": 0.0536083443959554, "survival_time": 11.250000000000025, "driven_lanedir": 1.262658146944085, "sim_render-ego": 0.0069435352749294705, "in-drivable-lane": 2.050000000000008, "agent_compute-ego": 0.01605462286207411, "deviation-heading": 6.810734947023341, "set_robot_commands": 0.0048940298292371965, "deviation-center-line": 0.6779236292536954, "driven_lanedir_consec": 0.6868851743054285, "sim_compute_sim_state": 0.0028449344635009767, "sim_compute_performance-ego": 0.003876752853393555, "sim_compute_robot_state-ego": 0.005049425760904948}}
set_robot_commands_max	0.004994501458837631
set_robot_commands_mean	0.004933367800610317
set_robot_commands_median	0.004920221964518229
set_robot_commands_min	0.0048940298292371965
sim_compute_performance-ego_max	0.004180492356766102
sim_compute_performance-ego_mean	0.003953827615160414
sim_compute_performance-ego_median	0.00390011469523112
sim_compute_performance-ego_min	0.003867524735471035
sim_compute_robot_state-ego_max	0.005236229998000125
sim_compute_robot_state-ego_mean	0.005079453726240188
sim_compute_robot_state-ego_median	0.005049425760904948
sim_compute_robot_state-ego_min	0.005018161137898763
sim_compute_sim_state_max	0.0028976607829966443
sim_compute_sim_state_mean	0.002841013589022968
sim_compute_sim_state_median	0.0028449344635009767
sim_compute_sim_state_min	0.0027620626050372456
sim_physics_max	0.05685395124007245
sim_physics_mean	0.055768060331264954
sim_physics_median	0.05619765088913289
sim_physics_min	0.0536083443959554
sim_render-ego_max	0.007180297097494436
sim_render-ego_mean	0.007040159877278976
sim_render-ego_median	0.0070753997685957925
sim_render-ego_min	0.006889675458272298
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.590000000000018
survival_time_min	2.1500000000000004

No reset possible

25068

4367

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-05 15:16:00+00:00

2019-11-05 15:23:58+00:00

0:07:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2623125455925446
survival_time_median	2.1500000000000004
deviation-center-line_median	0.08477724899866905
in-drivable-lane_median	0.95

other stats

agent_compute-ego_max	0.03671194314956665
agent_compute-ego_mean	0.0298730657249812
agent_compute-ego_median	0.02855842568901148
agent_compute-ego_min	0.026715612993007752
deviation-center-line_max	0.1975607630693531
deviation-center-line_mean	0.11847046034914296
deviation-center-line_min	0.06954716842796588
deviation-heading_max	1.7178892768468728
deviation-heading_mean	0.8422335539890714
deviation-heading_median	0.6440455161706796
deviation-heading_min	0.32140325056360697
driven_any_max	1.1410509648939424
driven_any_mean	0.663938097983312
driven_any_median	0.6184271460234713
driven_any_min	0.19067166163480295
driven_lanedir_consec_max	0.40693341882362777
driven_lanedir_consec_mean	0.2718926797268647
driven_lanedir_consec_min	0.10381866916913962
driven_lanedir_max	0.40693341882362777
driven_lanedir_mean	0.2718926797268647
driven_lanedir_median	0.2623125455925446
driven_lanedir_min	0.10381866916913962
in-drivable-lane_max	2.2999999999999945
in-drivable-lane_mean	1.0399999999999978
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19067166163480295, "sim_physics": 0.14492034912109375, "survival_time": 1.0000000000000002, "driven_lanedir": 0.10381866916913962, "sim_render-ego": 0.01500985622406006, "in-drivable-lane": 0, "agent_compute-ego": 0.03671194314956665, "deviation-heading": 0.6440455161706796, "set_robot_commands": 0.010018658638000487, "deviation-center-line": 0.06954716842796588, "driven_lanedir_consec": 0.10381866916913962, "sim_compute_sim_state": 0.006098449230194092, "sim_compute_performance-ego": 0.008582663536071778, "sim_compute_robot_state-ego": 0.011358153820037842}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0545702328408335, "sim_physics": 0.09815385865002144, "survival_time": 4.099999999999993, "driven_lanedir": 0.3272719467869505, "sim_render-ego": 0.011992006767086866, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.026715612993007752, "deviation-heading": 0.9248662957260966, "set_robot_commands": 0.008980175343955435, "deviation-center-line": 0.16640659946818992, "driven_lanedir_consec": 0.3272719467869505, "sim_compute_sim_state": 0.004847003192436404, "sim_compute_performance-ego": 0.006968306332099728, "sim_compute_robot_state-ego": 0.009122932829507968}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1410509648939424, "sim_physics": 0.10983295119210576, "survival_time": 4.449999999999992, "driven_lanedir": 0.40693341882362777, "sim_render-ego": 0.012601865811294384, "in-drivable-lane": 1.9499999999999944, "agent_compute-ego": 0.02855842568901148, "deviation-heading": 1.7178892768468728, "set_robot_commands": 0.010272869903050113, "deviation-center-line": 0.1975607630693531, "driven_lanedir_consec": 0.40693341882362777, "sim_compute_sim_state": 0.0053264050001508734, "sim_compute_performance-ego": 0.007699636930830024, "sim_compute_robot_state-ego": 0.009237021542667005}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3149704845235099, "sim_physics": 0.11193537712097168, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2623125455925446, "sim_render-ego": 0.013170039212262188, "in-drivable-lane": 0, "agent_compute-ego": 0.02909896108839247, "deviation-heading": 0.602963430638101, "set_robot_commands": 0.010292715496487088, "deviation-center-line": 0.0740605217815369, "driven_lanedir_consec": 0.2623125455925446, "sim_compute_sim_state": 0.004973270274974682, "sim_compute_performance-ego": 0.006936285230848525, "sim_compute_robot_state-ego": 0.008629843040748878}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6184271460234713, "sim_physics": 0.11210197626158248, "survival_time": 2.1500000000000004, "driven_lanedir": 0.25912681826206097, "sim_render-ego": 0.011759813441786657, "in-drivable-lane": 0.95, "agent_compute-ego": 0.028280385704927663, "deviation-heading": 0.32140325056360697, "set_robot_commands": 0.010177434876907704, "deviation-center-line": 0.08477724899866905, "driven_lanedir_consec": 0.25912681826206097, "sim_compute_sim_state": 0.0049153649529745415, "sim_compute_performance-ego": 0.006876008455143418, "sim_compute_robot_state-ego": 0.009106658225835756}}
set_robot_commands_max	0.010292715496487088
set_robot_commands_mean	0.009948370851680164
set_robot_commands_median	0.010177434876907704
set_robot_commands_min	0.008980175343955435
sim_compute_performance-ego_max	0.008582663536071778
sim_compute_performance-ego_mean	0.007412580096998694
sim_compute_performance-ego_median	0.006968306332099728
sim_compute_performance-ego_min	0.006876008455143418
sim_compute_robot_state-ego_max	0.011358153820037842
sim_compute_robot_state-ego_mean	0.009490921891759489
sim_compute_robot_state-ego_median	0.009122932829507968
sim_compute_robot_state-ego_min	0.008629843040748878
sim_compute_sim_state_max	0.006098449230194092
sim_compute_sim_state_mean	0.005232098530146118
sim_compute_sim_state_median	0.004973270274974682
sim_compute_sim_state_min	0.004847003192436404
sim_physics_max	0.14492034912109375
sim_physics_mean	0.11538890246915504
sim_physics_median	0.11193537712097168
sim_physics_min	0.09815385865002144
sim_render-ego_max	0.01500985622406006
sim_render-ego_mean	0.01290671629129803
sim_render-ego_median	0.012601865811294384
sim_render-ego_min	0.011759813441786657
simulation-passed	1
survival_time_max	4.449999999999992
survival_time_mean	2.6099999999999977
survival_time_min	1.0000000000000002

No reset possible

25014

4358

Soroush Saryazdi 🇨🇦

bluejay

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-43-40-10497

2019-11-04 15:16:56+00:00

2019-11-04 15:20:49+00:00

0:03:53

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25011

4350

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 14:18:16+00:00

2019-11-04 14:24:59+00:00

0:06:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.1969101316481181
survival_time_median	2.1000000000000005
deviation-center-line_median	0.07209192933104135
in-drivable-lane_median	1.0500000000000005

other stats

agent_compute-ego_max	0.018270140602475123
agent_compute-ego_mean	0.016435991451417133
agent_compute-ego_median	0.015979390877943773
agent_compute-ego_min	0.015820998411912184
deviation-center-line_max	0.2657142033326661
deviation-center-line_mean	0.1102189014518372
deviation-center-line_min	0.06943812104692093
deviation-heading_max	1.899247733059469
deviation-heading_mean	0.7576869200145884
deviation-heading_median	0.5104155507396807
deviation-heading_min	0.3410642294633384
driven_any_max	1.6493960859703245
driven_any_mean	0.772979906054481
driven_any_median	0.6030372131518966
driven_any_min	0.26689870901410606
driven_lanedir_consec_max	0.46948992784209054
driven_lanedir_consec_mean	0.25344061506860405
driven_lanedir_consec_min	0.18150258853029425
driven_lanedir_max	0.46948992784209054
driven_lanedir_mean	0.25344061506860405
driven_lanedir_median	0.1969101316481181
driven_lanedir_min	0.18150258853029425
in-drivable-lane_max	6.400000000000008
in-drivable-lane_mean	2.0600000000000005
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26689870901410606, "sim_physics": 0.06534937449863978, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1969101316481181, "sim_render-ego": 0.007218497140066964, "in-drivable-lane": 0, "agent_compute-ego": 0.018270140602475123, "deviation-heading": 0.5104155507396807, "set_robot_commands": 0.004981926509312221, "deviation-center-line": 0.07209192933104135, "driven_lanedir_consec": 0.1969101316481181, "sim_compute_sim_state": 0.003513813018798828, "sim_compute_performance-ego": 0.004208144687470936, "sim_compute_robot_state-ego": 0.005245628811064221}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6030372131518966, "sim_physics": 0.05673344362349737, "survival_time": 2.1000000000000005, "driven_lanedir": 0.18150258853029425, "sim_render-ego": 0.0070087966464814685, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.016149736586071196, "deviation-heading": 0.43851894901349303, "set_robot_commands": 0.004680014791942778, "deviation-center-line": 0.06989091979267197, "driven_lanedir_consec": 0.18150258853029425, "sim_compute_sim_state": 0.0028190896624610538, "sim_compute_performance-ego": 0.0038005908330281577, "sim_compute_robot_state-ego": 0.005099813143412272}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6493960859703245, "sim_physics": 0.05483134954403608, "survival_time": 9.750000000000004, "driven_lanedir": 0.46948992784209054, "sim_render-ego": 0.00774377064827161, "in-drivable-lane": 6.400000000000008, "agent_compute-ego": 0.015959690778683394, "deviation-heading": 1.899247733059469, "set_robot_commands": 0.004964848053761017, "deviation-center-line": 0.2657142033326661, "driven_lanedir_consec": 0.46948992784209054, "sim_compute_sim_state": 0.002872328880505684, "sim_compute_performance-ego": 0.003869203420785757, "sim_compute_robot_state-ego": 0.005073344401824169}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2898542042605603, "sim_physics": 0.058625221252441406, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2344184462786556, "sim_render-ego": 0.00707852840423584, "in-drivable-lane": 0, "agent_compute-ego": 0.015979390877943773, "deviation-heading": 0.5991881377969615, "set_robot_commands": 0.0048468571442824146, "deviation-center-line": 0.06943812104692093, "driven_lanedir_consec": 0.2344184462786556, "sim_compute_sim_state": 0.0027988232099092924, "sim_compute_performance-ego": 0.003847140532273513, "sim_compute_robot_state-ego": 0.004935264587402344}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0557133178755176, "sim_physics": 0.05678432110028389, "survival_time": 3.899999999999994, "driven_lanedir": 0.18488198104386155, "sim_render-ego": 0.0070496002833048505, "in-drivable-lane": 2.849999999999994, "agent_compute-ego": 0.015820998411912184, "deviation-heading": 0.3410642294633384, "set_robot_commands": 0.004897762567569048, "deviation-center-line": 0.07395933375588565, "driven_lanedir_consec": 0.18488198104386155, "sim_compute_sim_state": 0.00288859391823793, "sim_compute_performance-ego": 0.0039012951728625176, "sim_compute_robot_state-ego": 0.005067372933412209}}
set_robot_commands_max	0.004981926509312221
set_robot_commands_mean	0.004874281813373496
set_robot_commands_median	0.004897762567569048
set_robot_commands_min	0.004680014791942778
sim_compute_performance-ego_max	0.004208144687470936
sim_compute_performance-ego_mean	0.003925274929284176
sim_compute_performance-ego_median	0.003869203420785757
sim_compute_performance-ego_min	0.0038005908330281577
sim_compute_robot_state-ego_max	0.005245628811064221
sim_compute_robot_state-ego_mean	0.005084284775423043
sim_compute_robot_state-ego_median	0.005073344401824169
sim_compute_robot_state-ego_min	0.004935264587402344
sim_compute_sim_state_max	0.003513813018798828
sim_compute_sim_state_mean	0.0029785297379825576
sim_compute_sim_state_median	0.002872328880505684
sim_compute_sim_state_min	0.0027988232099092924
sim_physics_max	0.06534937449863978
sim_physics_mean	0.05846474200377971
sim_physics_median	0.05678432110028389
sim_physics_min	0.05483134954403608
sim_render-ego_max	0.00774377064827161
sim_render-ego_mean	0.007219838624472147
sim_render-ego_median	0.00707852840423584
sim_render-ego_min	0.0070087966464814685
simulation-passed	1
survival_time_max	9.750000000000004
survival_time_mean	3.62
survival_time_min	1.0500000000000005

No reset possible

24999

4130

Andrea Censi 🇨🇭

rotation

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 09:22:03+00:00

2019-11-04 09:47:36+00:00

0:25:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00030504467687686443
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891046565937845
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.10972649812698364
agent_compute-ego_mean	0.10346655321121216
agent_compute-ego_median	0.1041413156191508
agent_compute-ego_min	0.0971078117688497
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.4225460275157091
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.830135897709591
deviation-heading_mean	5.6845705507076865
deviation-heading_median	5.657649106857696
deviation-heading_min	5.53666299685486
driven_any_max	0.026478672834052443
driven_any_mean	0.02486423959225232
driven_any_median	0.02593019554120905
driven_any_min	0.022165452661382787
driven_lanedir_consec_max	0.002162616049345756
driven_lanedir_consec_mean	-0.0004886462276807446
driven_lanedir_consec_min	-0.0036402347654349576
driven_lanedir_max	0.002162616049345756
driven_lanedir_mean	-0.0004886462276807446
driven_lanedir_median	0.00030504467687686443
driven_lanedir_min	-0.0036402347654349576
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.026478672834052443, "sim_physics": 0.21079895416895547, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.012093083063761391, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.10972649812698364, "deviation-heading": 5.657649106857696, "set_robot_commands": 0.00960371176401774, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.0048437023162841795, "sim_compute_performance-ego": 0.007080291906992595, "sim_compute_robot_state-ego": 0.009297152360280355, "sim_compute_robot_state-npc0": 0.00853258768717448, "sim_compute_robot_state-npc1": 0.008225487073262533, "sim_compute_robot_state-npc2": 0.008221087455749511, "sim_compute_robot_state-npc3": 0.008159074783325195}, "udem1-1-0": {"driven_any": 0.02593019554120905, "sim_physics": 0.2041803781191508, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.012466131051381429, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.1047770365079244, "deviation-heading": 5.79531637039674, "set_robot_commands": 0.00896718422571818, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.004816021124521891, "sim_compute_performance-ego": 0.007216511567433675, "sim_compute_robot_state-ego": 0.00912014087041219, "sim_compute_robot_state-npc0": 0.008366614977518717, "sim_compute_robot_state-npc1": 0.008042253653208415, "sim_compute_robot_state-npc2": 0.007893434365590413, "sim_compute_robot_state-npc3": 0.007994429270426432}, "udem1-2-0": {"driven_any": 0.023804404672430148, "sim_physics": 0.18390398979187011, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.011784377892812094, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.0971078117688497, "deviation-heading": 5.603088381719548, "set_robot_commands": 0.00873327096303304, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.004716710249582926, "sim_compute_performance-ego": 0.00689264456431071, "sim_compute_robot_state-ego": 0.00868055502573649, "sim_compute_robot_state-npc0": 0.008397108713785807, "sim_compute_robot_state-npc1": 0.007995945612589518, "sim_compute_robot_state-npc2": 0.007938221295674642, "sim_compute_robot_state-npc3": 0.008151284058888753}, "udem1-3-0": {"driven_any": 0.022165452661382787, "sim_physics": 0.19273566961288452, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202352883, "sim_render-ego": 0.012209705511728924, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.10158010403315226, "deviation-heading": 5.53666299685486, "set_robot_commands": 0.008880317211151123, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202352883, "sim_compute_sim_state": 0.004923582871754964, "sim_compute_performance-ego": 0.007020694414774577, "sim_compute_robot_state-ego": 0.008921069304148356, "sim_compute_robot_state-npc0": 0.008301783402760823, "sim_compute_robot_state-npc1": 0.007939418156941732, "sim_compute_robot_state-npc2": 0.008211150964101155, "sim_compute_robot_state-npc3": 0.00792188008626302}, "udem1-4-0": {"driven_any": 0.02594247225218716, "sim_physics": 0.19690927187601728, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030504467687686443, "sim_render-ego": 0.012082810401916505, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.1041413156191508, "deviation-heading": 5.830135897709591, "set_robot_commands": 0.009207029342651368, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.00030504467687686443, "sim_compute_sim_state": 0.004766434033711751, "sim_compute_performance-ego": 0.007204973697662353, "sim_compute_robot_state-ego": 0.009275492032368975, "sim_compute_robot_state-npc0": 0.008629123369852701, "sim_compute_robot_state-npc1": 0.007946009635925294, "sim_compute_robot_state-npc2": 0.00832835594813029, "sim_compute_robot_state-npc3": 0.008283977508544921}}
set_robot_commands_max	0.00960371176401774
set_robot_commands_mean	0.009078302701314291
set_robot_commands_median	0.00896718422571818
set_robot_commands_min	0.00873327096303304
sim_compute_performance-ego_max	0.007216511567433675
sim_compute_performance-ego_mean	0.007083023230234782
sim_compute_performance-ego_median	0.007080291906992595
sim_compute_performance-ego_min	0.00689264456431071
sim_compute_robot_state-ego_max	0.009297152360280355
sim_compute_robot_state-ego_mean	0.009058881918589275
sim_compute_robot_state-ego_median	0.00912014087041219
sim_compute_robot_state-ego_min	0.00868055502573649
sim_compute_robot_state-npc0_max	0.008629123369852701
sim_compute_robot_state-npc0_mean	0.008445443630218506
sim_compute_robot_state-npc0_median	0.008397108713785807
sim_compute_robot_state-npc0_min	0.008301783402760823
sim_compute_robot_state-npc1_max	0.008225487073262533
sim_compute_robot_state-npc1_mean	0.008029822826385499
sim_compute_robot_state-npc1_median	0.007995945612589518
sim_compute_robot_state-npc1_min	0.007939418156941732
sim_compute_robot_state-npc2_max	0.00832835594813029
sim_compute_robot_state-npc2_mean	0.008118450005849202
sim_compute_robot_state-npc2_median	0.008211150964101155
sim_compute_robot_state-npc2_min	0.007893434365590413
sim_compute_robot_state-npc3_max	0.008283977508544921
sim_compute_robot_state-npc3_mean	0.008102129141489663
sim_compute_robot_state-npc3_median	0.008151284058888753
sim_compute_robot_state-npc3_min	0.00792188008626302
sim_compute_sim_state_max	0.004923582871754964
sim_compute_sim_state_mean	0.004813290119171142
sim_compute_sim_state_median	0.004816021124521891
sim_compute_sim_state_min	0.004716710249582926
sim_physics_max	0.21079895416895547
sim_physics_mean	0.19770565271377563
sim_physics_median	0.19690927187601728
sim_physics_min	0.18390398979187011
sim_render-ego_max	0.012466131051381429
sim_render-ego_mean	0.012127221584320069
sim_render-ego_median	0.012093083063761391
sim_render-ego_min	0.011784377892812094
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24980

4147

Andrea Censi 🇨🇭

rotation

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 09:00:37+00:00

2019-11-04 09:21:48+00:00

0:21:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00031446221011421915
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891048530415207
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.023348434766133627
agent_compute-ego_mean	0.023123521486918132
agent_compute-ego_median	0.023215421040852863
agent_compute-ego_min	0.022684406439463296
deviation-center-line_max	0.6113242374220981
deviation-center-line_mean	0.422546032853888
deviation-center-line_min	0.020737127615471695
deviation-heading_max	5.830135897709593
deviation-heading_mean	5.6845705507076865
deviation-heading_median	5.657649106857694
deviation-heading_min	5.536662996854859
driven_any_max	0.026478672834058543
driven_any_mean	0.02486423959225546
driven_any_median	0.025930195541210208
driven_any_min	0.022165452661382513
driven_lanedir_consec_max	0.0021599934447711355
driven_lanedir_consec_mean	-0.0004859282560538025
driven_lanedir_consec_min	-0.003645956811333395
driven_lanedir_max	0.0021599934447711355
driven_lanedir_mean	-0.0004859282560538025
driven_lanedir_median	0.00031446221011421915
driven_lanedir_min	-0.003645956811333395
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.17194139321645102, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.01176123301188151, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.022684406439463296, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.009030199845631918, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.00478857437769572, "sim_compute_performance-ego": 0.007101129690806071, "sim_compute_robot_state-ego": 0.008853089809417725, "sim_compute_robot_state-npc0": 0.008316683769226074, "sim_compute_robot_state-npc1": 0.00826751152674357, "sim_compute_robot_state-npc2": 0.008071575959523519, "sim_compute_robot_state-npc3": 0.0081298828125}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541210208, "sim_physics": 0.1657458313306173, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.011842475732167564, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.023215421040852863, "deviation-heading": 5.795316370396739, "set_robot_commands": 0.009241146246592204, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.005036711692810059, "sim_compute_performance-ego": 0.006998186111450195, "sim_compute_robot_state-ego": 0.008981651465098063, "sim_compute_robot_state-npc0": 0.008363644282023111, "sim_compute_robot_state-npc1": 0.008073453108469646, "sim_compute_robot_state-npc2": 0.008217043876647949, "sim_compute_robot_state-npc3": 0.008137076695760092}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672443435, "sim_physics": 0.1695910104115804, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.01184308926264445, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.023313995202382407, "deviation-heading": 5.603088381719547, "set_robot_commands": 0.00921096960703532, "deviation-center-line": 0.4891048530415207, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.0048963419596354165, "sim_compute_performance-ego": 0.007336664994557699, "sim_compute_robot_state-ego": 0.009351510206858316, "sim_compute_robot_state-npc0": 0.008530179659525553, "sim_compute_robot_state-npc1": 0.008228734334309895, "sim_compute_robot_state-npc2": 0.008255914052327474, "sim_compute_robot_state-npc3": 0.008265785376230876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382513, "sim_physics": 0.17635317802429198, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988329, "sim_render-ego": 0.012081202665964762, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.023055349985758464, "deviation-heading": 5.536662996854859, "set_robot_commands": 0.009078567028045654, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988329, "sim_compute_sim_state": 0.0049904092152913415, "sim_compute_performance-ego": 0.0071756092707316085, "sim_compute_robot_state-ego": 0.009155337810516357, "sim_compute_robot_state-npc0": 0.008619569142659505, "sim_compute_robot_state-npc1": 0.008307371139526367, "sim_compute_robot_state-npc2": 0.008175764878590902, "sim_compute_robot_state-npc3": 0.008237024943033855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218261, "sim_physics": 0.17449032068252562, "survival_time": 14.950000000000076, "driven_lanedir": 0.00031446221011421915, "sim_render-ego": 0.012046010494232175, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.023348434766133627, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.009473114013671876, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.00031446221011421915, "sim_compute_sim_state": 0.005063545703887939, "sim_compute_performance-ego": 0.007196509838104248, "sim_compute_robot_state-ego": 0.009334884484608967, "sim_compute_robot_state-npc0": 0.008462461630503336, "sim_compute_robot_state-npc1": 0.008287619749704997, "sim_compute_robot_state-npc2": 0.008234654267628988, "sim_compute_robot_state-npc3": 0.00808666467666626}}
set_robot_commands_max	0.009473114013671876
set_robot_commands_mean	0.009206799348195394
set_robot_commands_median	0.00921096960703532
set_robot_commands_min	0.009030199845631918
sim_compute_performance-ego_max	0.007336664994557699
sim_compute_performance-ego_mean	0.007161619981129965
sim_compute_performance-ego_median	0.0071756092707316085
sim_compute_performance-ego_min	0.006998186111450195
sim_compute_robot_state-ego_max	0.009351510206858316
sim_compute_robot_state-ego_mean	0.009135294755299884
sim_compute_robot_state-ego_median	0.009155337810516357
sim_compute_robot_state-ego_min	0.008853089809417725
sim_compute_robot_state-npc0_max	0.008619569142659505
sim_compute_robot_state-npc0_mean	0.008458507696787515
sim_compute_robot_state-npc0_median	0.008462461630503336
sim_compute_robot_state-npc0_min	0.008316683769226074
sim_compute_robot_state-npc1_max	0.008307371139526367
sim_compute_robot_state-npc1_mean	0.008232937971750894
sim_compute_robot_state-npc1_median	0.00826751152674357
sim_compute_robot_state-npc1_min	0.008073453108469646
sim_compute_robot_state-npc2_max	0.008255914052327474
sim_compute_robot_state-npc2_mean	0.008190990606943767
sim_compute_robot_state-npc2_median	0.008217043876647949
sim_compute_robot_state-npc2_min	0.008071575959523519
sim_compute_robot_state-npc3_max	0.008265785376230876
sim_compute_robot_state-npc3_mean	0.008171286900838216
sim_compute_robot_state-npc3_median	0.008137076695760092
sim_compute_robot_state-npc3_min	0.00808666467666626
sim_compute_sim_state_max	0.005063545703887939
sim_compute_sim_state_mean	0.004955116589864096
sim_compute_sim_state_median	0.0049904092152913415
sim_compute_sim_state_min	0.00478857437769572
sim_physics_max	0.17635317802429198
sim_physics_mean	0.17162434673309326
sim_physics_median	0.17194139321645102
sim_physics_min	0.1657458313306173
sim_render-ego_max	0.012081202665964762
sim_render-ego_mean	0.011914802233378092
sim_render-ego_median	0.01184308926264445
sim_render-ego_min	0.01176123301188151
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24974

4167

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-43-40-10497

2019-11-04 08:57:09+00:00

2019-11-04 09:00:29+00:00

0:03:20

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24950

4192

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 08:50:14+00:00

2019-11-04 08:56:55+00:00

0:06:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4702323960536803
survival_time_median	2.849999999999998
deviation-center-line_median	0.13623952041905
in-drivable-lane_median	0.7999999999999976

other stats

agent_compute-ego_max	0.029139000436534057
agent_compute-ego_mean	0.0248833925904228
agent_compute-ego_median	0.024507413830673487
agent_compute-ego_min	0.019793599484914756
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.16546426353561405
deviation-center-line_min	0.07144385614371519
deviation-heading_max	1.2111022380750738
deviation-heading_mean	0.8262001110734373
deviation-heading_median	0.7978002362162196
deviation-heading_min	0.39989969254594865
driven_any_max	1.093753441791868
driven_any_mean	0.7182169120135662
driven_any_median	0.8072381933001381
driven_any_min	0.29795781475632777
driven_lanedir_consec_max	0.6735785385729686
driven_lanedir_consec_mean	0.4271077107010905
driven_lanedir_consec_min	0.2312609677194346
driven_lanedir_max	0.6758329617605024
driven_lanedir_mean	0.4275585953385973
driven_lanedir_median	0.4702323960536803
driven_lanedir_min	0.2312609677194346
in-drivable-lane_max	1.6499999999999957
in-drivable-lane_mean	0.7199999999999979
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791868, "sim_physics": 0.1474447279091341, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.009597982268735587, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.019793599484914756, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.006953064217624894, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.003887012780430805, "sim_compute_performance-ego": 0.005327767636402544, "sim_compute_robot_state-ego": 0.0066885344953422085, "sim_compute_robot_state-npc0": 0.006939011884022908, "sim_compute_robot_state-npc1": 0.006118828991809523, "sim_compute_robot_state-npc2": 0.006158136459718268, "sim_compute_robot_state-npc3": 0.006288993789489011}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.1901940239800347, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.011769718594021268, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.028731734664351853, "deviation-heading": 0.6953408166028195, "set_robot_commands": 0.0102486080593533, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.005715493802671079, "sim_compute_performance-ego": 0.006934112972683377, "sim_compute_robot_state-ego": 0.008960873992354781, "sim_compute_robot_state-npc0": 0.008401058338306568, "sim_compute_robot_state-npc1": 0.00796144096939652, "sim_compute_robot_state-npc2": 0.008217670299388745, "sim_compute_robot_state-npc3": 0.009156924706918222}, "udem1-2-0": {"driven_any": 1.0809477890804953, "sim_physics": 0.1655603616665571, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.01001900281661596, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.022245214535639837, "deviation-heading": 1.0268575719271245, "set_robot_commands": 0.007390544964716985, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.0038856726426344658, "sim_compute_performance-ego": 0.005610469060066419, "sim_compute_robot_state-ego": 0.0072504190298227165, "sim_compute_robot_state-npc0": 0.006563159135671763, "sim_compute_robot_state-npc1": 0.006435947540478828, "sim_compute_robot_state-npc2": 0.006376339839054988, "sim_compute_robot_state-npc3": 0.006402076819004157}, "udem1-3-0": {"driven_any": 0.8072381933001381, "sim_physics": 0.18256500729343347, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.011383621316207085, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.024507413830673487, "deviation-heading": 0.7978002362162196, "set_robot_commands": 0.009002551697848136, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.004249413808186849, "sim_compute_performance-ego": 0.0065114790933173995, "sim_compute_robot_state-ego": 0.008783771280656782, "sim_compute_robot_state-npc0": 0.007865684074268006, "sim_compute_robot_state-npc1": 0.007506859929938065, "sim_compute_robot_state-npc2": 0.007313602849056846, "sim_compute_robot_state-npc3": 0.007234652837117513}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.49365958960159967, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.0226885754129161, "in-drivable-lane": 0, "agent_compute-ego": 0.029139000436534057, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.011619412380716076, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.006393256394759468, "sim_compute_performance-ego": 0.007553131684013035, "sim_compute_robot_state-ego": 0.010516322177389391, "sim_compute_robot_state-npc0": 0.010662514230479364, "sim_compute_robot_state-npc1": 0.00959176602570907, "sim_compute_robot_state-npc2": 0.011404752731323242, "sim_compute_robot_state-npc3": 0.010178773299507471}}
set_robot_commands_max	0.011619412380716076
set_robot_commands_mean	0.00904283626405188
set_robot_commands_median	0.009002551697848136
set_robot_commands_min	0.006953064217624894
sim_compute_performance-ego_max	0.007553131684013035
sim_compute_performance-ego_mean	0.006387392089296555
sim_compute_performance-ego_median	0.0065114790933173995
sim_compute_performance-ego_min	0.005327767636402544
sim_compute_robot_state-ego_max	0.010516322177389391
sim_compute_robot_state-ego_mean	0.008439984195113177
sim_compute_robot_state-ego_median	0.008783771280656782
sim_compute_robot_state-ego_min	0.0066885344953422085
sim_compute_robot_state-npc0_max	0.010662514230479364
sim_compute_robot_state-npc0_mean	0.008086285532549722
sim_compute_robot_state-npc0_median	0.007865684074268006
sim_compute_robot_state-npc0_min	0.006563159135671763
sim_compute_robot_state-npc1_max	0.00959176602570907
sim_compute_robot_state-npc1_mean	0.007522968691466401
sim_compute_robot_state-npc1_median	0.007506859929938065
sim_compute_robot_state-npc1_min	0.006118828991809523
sim_compute_robot_state-npc2_max	0.011404752731323242
sim_compute_robot_state-npc2_mean	0.007894100435708418
sim_compute_robot_state-npc2_median	0.007313602849056846
sim_compute_robot_state-npc2_min	0.006158136459718268
sim_compute_robot_state-npc3_max	0.010178773299507471
sim_compute_robot_state-npc3_mean	0.007852284290407274
sim_compute_robot_state-npc3_median	0.007234652837117513
sim_compute_robot_state-npc3_min	0.006288993789489011
sim_compute_sim_state_max	0.006393256394759468
sim_compute_sim_state_mean	0.004826169885736533
sim_compute_sim_state_median	0.004249413808186849
sim_compute_sim_state_min	0.0038856726426344658
sim_physics_max	0.49365958960159967
sim_physics_mean	0.2358847420901518
sim_physics_median	0.18256500729343347
sim_physics_min	0.1474447279091341
sim_render-ego_max	0.0226885754129161
sim_render-ego_mean	0.0130917800816992
sim_render-ego_median	0.011383621316207085
sim_render-ego_min	0.009597982268735587
simulation-passed	1
survival_time_max	4.149999999999993
survival_time_mean	2.679999999999997
survival_time_min	1.1500000000000004

No reset possible

24940

4207

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-43-40-10497

2019-11-04 08:45:49+00:00

2019-11-04 08:49:52+00:00

0:04:03

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24936

4214

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LF-sim-testing

step1-simulation

failed

ip-172-31-43-40-10497

2019-11-04 08:44:32+00:00

2019-11-04 08:45:42+00:00

0:01:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24927

4223

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-43-40-10497

2019-11-04 08:43:10+00:00

2019-11-04 08:44:10+00:00

0:01:00

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24922

4227

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-testing

step1-simulation

failed

ip-172-31-43-40-10497

2019-11-04 08:41:00+00:00

2019-11-04 08:42:50+00:00

0:01:50

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24904

4245

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 08:15:45+00:00

2019-11-04 08:40:38+00:00

0:24:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.03441753442590478
survival_time_median	14.950000000000076
deviation-center-line_median	0.8945337646409234
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.09989978790283204
agent_compute-ego_mean	0.09072546482086184
agent_compute-ego_median	0.09070368766784669
agent_compute-ego_min	0.07727437257766724
deviation-center-line_max	1.1089105598132276
deviation-center-line_mean	0.8009145954897001
deviation-center-line_min	0.13096441622170696
deviation-heading_max	5.243646634348893
deviation-heading_mean	2.5494160429849706
deviation-heading_median	1.5681205954929416
deviation-heading_min	0.8456316081991447
driven_any_max	0.03474154027971543
driven_any_mean	0.034651044113437855
driven_any_median	0.034665207579427704
driven_any_min	0.034487058725390624
driven_lanedir_consec_max	0.03460928336695979
driven_lanedir_consec_mean	0.033886815622739076
driven_lanedir_consec_min	0.032530449465213884
driven_lanedir_max	0.03460928336695979
driven_lanedir_mean	0.033886815622739076
driven_lanedir_median	0.03441753442590478
driven_lanedir_min	0.032530449465213884
in-drivable-lane_max	0
in-drivable-lane_mean	0
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.03474154027971543, "sim_physics": 0.1667950391769409, "survival_time": 14.950000000000076, "driven_lanedir": 0.03454891843419383, "sim_render-ego": 0.010747938950856527, "in-drivable-lane": 0, "agent_compute-ego": 0.07727437257766724, "deviation-heading": 1.5681205954929416, "set_robot_commands": 0.008504362901051839, "deviation-center-line": 1.1089105598132276, "driven_lanedir_consec": 0.03454891843419383, "sim_compute_sim_state": 0.004548992315928141, "sim_compute_performance-ego": 0.006304403146107991, "sim_compute_robot_state-ego": 0.00790834903717041, "sim_compute_robot_state-npc0": 0.0076438514391581214, "sim_compute_robot_state-npc1": 0.0074784485499064125, "sim_compute_robot_state-npc2": 0.007179574171702067, "sim_compute_robot_state-npc3": 0.007098344167073568}, "udem1-1-0": {"driven_any": 0.03463647387558879, "sim_physics": 0.2515654921531677, "survival_time": 14.950000000000076, "driven_lanedir": 0.032530449465213884, "sim_render-ego": 0.012799296379089355, "in-drivable-lane": 0, "agent_compute-ego": 0.09989978790283204, "deviation-heading": 5.243646634348893, "set_robot_commands": 0.010278918743133546, "deviation-center-line": 1.0551709782887615, "driven_lanedir_consec": 0.032530449465213884, "sim_compute_sim_state": 0.005080788135528564, "sim_compute_performance-ego": 0.007431050141652425, "sim_compute_robot_state-ego": 0.009488446712493897, "sim_compute_robot_state-npc0": 0.008924521605173747, "sim_compute_robot_state-npc1": 0.00854714552561442, "sim_compute_robot_state-npc2": 0.008398059209187826, "sim_compute_robot_state-npc3": 0.00850593090057373}, "udem1-2-0": {"driven_any": 0.034487058725390624, "sim_physics": 0.20872347036997477, "survival_time": 14.950000000000076, "driven_lanedir": 0.03441753442590478, "sim_render-ego": 0.012015395164489746, "in-drivable-lane": 0, "agent_compute-ego": 0.09800087451934816, "deviation-heading": 0.8456316081991447, "set_robot_commands": 0.009610803127288818, "deviation-center-line": 0.8945337646409234, "driven_lanedir_consec": 0.03441753442590478, "sim_compute_sim_state": 0.004912277062733968, "sim_compute_performance-ego": 0.0068942411740620935, "sim_compute_robot_state-ego": 0.009038139184316, "sim_compute_robot_state-npc0": 0.008307380676269531, "sim_compute_robot_state-npc1": 0.008149791558583577, "sim_compute_robot_state-npc2": 0.008100058237711589, "sim_compute_robot_state-npc3": 0.008189413547515869}, "udem1-3-0": {"driven_any": 0.034665207579427704, "sim_physics": 0.20163651943206787, "survival_time": 14.950000000000076, "driven_lanedir": 0.03460928336695979, "sim_render-ego": 0.012241711616516111, "in-drivable-lane": 0, "agent_compute-ego": 0.08774860143661499, "deviation-heading": 0.8513506488354827, "set_robot_commands": 0.00944560686747233, "deviation-center-line": 0.8149932584838815, "driven_lanedir_consec": 0.03460928336695979, "sim_compute_sim_state": 0.004735978444417318, "sim_compute_performance-ego": 0.006997195879618326, "sim_compute_robot_state-ego": 0.009188973903656006, "sim_compute_robot_state-npc0": 0.008324282964070638, "sim_compute_robot_state-npc1": 0.007921537558237712, "sim_compute_robot_state-npc2": 0.008052000999450684, "sim_compute_robot_state-npc3": 0.00792548100153605}, "udem1-4-0": {"driven_any": 0.03472494010706674, "sim_physics": 0.18425867954889932, "survival_time": 14.950000000000076, "driven_lanedir": 0.03332789242142309, "sim_render-ego": 0.012264466285705568, "in-drivable-lane": 0, "agent_compute-ego": 0.09070368766784669, "deviation-heading": 4.23833072804839, "set_robot_commands": 0.010119544665018717, "deviation-center-line": 0.13096441622170696, "driven_lanedir_consec": 0.03332789242142309, "sim_compute_sim_state": 0.005092677275339763, "sim_compute_performance-ego": 0.007033545176188151, "sim_compute_robot_state-ego": 0.009163906574249267, "sim_compute_robot_state-npc0": 0.009125899473826093, "sim_compute_robot_state-npc1": 0.008445561726888021, "sim_compute_robot_state-npc2": 0.008443092505137126, "sim_compute_robot_state-npc3": 0.008737095991770426}}
set_robot_commands_max	0.010278918743133546
set_robot_commands_mean	0.009591847260793053
set_robot_commands_median	0.009610803127288818
set_robot_commands_min	0.008504362901051839
sim_compute_performance-ego_max	0.007431050141652425
sim_compute_performance-ego_mean	0.006932087103525797
sim_compute_performance-ego_median	0.006997195879618326
sim_compute_performance-ego_min	0.006304403146107991
sim_compute_robot_state-ego_max	0.009488446712493897
sim_compute_robot_state-ego_mean	0.008957563082377116
sim_compute_robot_state-ego_median	0.009163906574249267
sim_compute_robot_state-ego_min	0.00790834903717041
sim_compute_robot_state-npc0_max	0.009125899473826093
sim_compute_robot_state-npc0_mean	0.008465187231699626
sim_compute_robot_state-npc0_median	0.008324282964070638
sim_compute_robot_state-npc0_min	0.0076438514391581214
sim_compute_robot_state-npc1_max	0.00854714552561442
sim_compute_robot_state-npc1_mean	0.008108496983846029
sim_compute_robot_state-npc1_median	0.008149791558583577
sim_compute_robot_state-npc1_min	0.0074784485499064125
sim_compute_robot_state-npc2_max	0.008443092505137126
sim_compute_robot_state-npc2_mean	0.008034557024637859
sim_compute_robot_state-npc2_median	0.008100058237711589
sim_compute_robot_state-npc2_min	0.007179574171702067
sim_compute_robot_state-npc3_max	0.008737095991770426
sim_compute_robot_state-npc3_mean	0.008091253121693929
sim_compute_robot_state-npc3_median	0.008189413547515869
sim_compute_robot_state-npc3_min	0.007098344167073568
sim_compute_sim_state_max	0.005092677275339763
sim_compute_sim_state_mean	0.0048741426467895504
sim_compute_sim_state_median	0.004912277062733968
sim_compute_sim_state_min	0.004548992315928141
sim_physics_max	0.2515654921531677
sim_physics_mean	0.2025958401362101
sim_physics_median	0.20163651943206787
sim_physics_min	0.1667950391769409
sim_render-ego_max	0.012799296379089355
sim_render-ego_mean	0.01201376167933146
sim_render-ego_median	0.012241711616516111
sim_render-ego_min	0.010747938950856527
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24903

4247

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-43-40-10497

2019-11-04 08:14:08+00:00

2019-11-04 08:15:16+00:00

0:01:08

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 42, in on_received_get_commands
               ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
               ||   File "<string>", line 4, in __init__
               ||   File "/usr/local/lib/python3.7/dist-packages/aido_schemas/schemas.py", line 41, in __post_init__
               ||     raise ValueError(msg)
               || ValueError: Expected values to be between -1 and 1. Obtained 1.016830325126648, -0.19885946810245514
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24888

4256

Manfred Diaz

Baseline solution using reinforcement learning

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 08:00:49+00:00

2019-11-04 08:13:52+00:00

0:13:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.462082756288114
survival_time_median	14.950000000000076
deviation-center-line_median	0.4847576811308859
in-drivable-lane_median	6.950000000000042

other stats

agent_compute-ego_max	0.035576769510904944
agent_compute-ego_mean	0.0320646322844685
agent_compute-ego_median	0.03238247235616048
agent_compute-ego_min	0.02737573955370032
deviation-center-line_max	0.6890833461926236
deviation-center-line_mean	0.3828578393870001
deviation-center-line_min	0.06052279149268016
deviation-heading_max	6.0789567997065586
deviation-heading_mean	4.48138218832557
deviation-heading_median	5.82065750636341
deviation-heading_min	0.5226619616074745
driven_any_max	1.562814586012004
driven_any_mean	1.1684888304161782
driven_any_median	1.3863015270060697
driven_any_min	0.08587037013382659
driven_lanedir_consec_max	0.5946214846374516
driven_lanedir_consec_mean	0.3694608275684502
driven_lanedir_consec_min	0.031039092174315996
driven_lanedir_max	0.5946214846374516
driven_lanedir_mean	0.3694608275684502
driven_lanedir_median	0.462082756288114
driven_lanedir_min	0.031039092174315996
in-drivable-lane_max	10.05000000000008
in-drivable-lane_mean	6.260000000000039
in-drivable-lane_min	0.3500000000000002
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.562814586012004, "sim_physics": 0.11377189954121908, "survival_time": 14.950000000000076, "driven_lanedir": 0.5946214846374516, "sim_render-ego": 0.01163821538289388, "in-drivable-lane": 6.950000000000042, "agent_compute-ego": 0.03238247235616048, "deviation-heading": 5.86287938333772, "set_robot_commands": 0.009534231026967366, "deviation-center-line": 0.6890833461926236, "driven_lanedir_consec": 0.5946214846374516, "sim_compute_sim_state": 0.005026979446411133, "sim_compute_performance-ego": 0.007207426230112711, "sim_compute_robot_state-ego": 0.008914438088734945}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4236984094446186, "sim_physics": 0.10771199226379397, "survival_time": 14.950000000000076, "driven_lanedir": 0.49335326674598934, "sim_render-ego": 0.012266772588094076, "in-drivable-lane": 6.900000000000037, "agent_compute-ego": 0.03462745507558187, "deviation-heading": 6.0789567997065586, "set_robot_commands": 0.009310012658437092, "deviation-center-line": 0.1488907255634941, "driven_lanedir_consec": 0.49335326674598934, "sim_compute_sim_state": 0.005229175090789795, "sim_compute_performance-ego": 0.007114881674448649, "sim_compute_robot_state-ego": 0.00942338784535726}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08587037013382659, "sim_physics": 0.1022818192191746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.031039092174315996, "sim_render-ego": 0.01203750527423361, "in-drivable-lane": 0.3500000000000002, "agent_compute-ego": 0.02737573955370032, "deviation-heading": 0.5226619616074745, "set_robot_commands": 0.008942904679671577, "deviation-center-line": 0.06052279149268016, "driven_lanedir_consec": 0.031039092174315996, "sim_compute_sim_state": 0.004785485889600671, "sim_compute_performance-ego": 0.006685122199680494, "sim_compute_robot_state-ego": 0.008589775665946629}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3863015270060697, "sim_physics": 0.0956186564763387, "survival_time": 14.950000000000076, "driven_lanedir": 0.2662075379963804, "sim_render-ego": 0.011019218762715655, "in-drivable-lane": 10.05000000000008, "agent_compute-ego": 0.035576769510904944, "deviation-heading": 4.121755290612689, "set_robot_commands": 0.008834378719329834, "deviation-center-line": 0.5310346525553168, "driven_lanedir_consec": 0.2662075379963804, "sim_compute_sim_state": 0.004813102881113688, "sim_compute_performance-ego": 0.006850290298461914, "sim_compute_robot_state-ego": 0.008359756469726563}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3837592594843728, "sim_physics": 0.09384672164916992, "survival_time": 14.950000000000076, "driven_lanedir": 0.462082756288114, "sim_render-ego": 0.01108719269434611, "in-drivable-lane": 7.050000000000038, "agent_compute-ego": 0.030360724925994873, "deviation-heading": 5.82065750636341, "set_robot_commands": 0.008634175459543864, "deviation-center-line": 0.4847576811308859, "driven_lanedir_consec": 0.462082756288114, "sim_compute_sim_state": 0.004594009717305501, "sim_compute_performance-ego": 0.006404523849487305, "sim_compute_robot_state-ego": 0.008202660083770751}}
set_robot_commands_max	0.009534231026967366
set_robot_commands_mean	0.009051140508789949
set_robot_commands_median	0.008942904679671577
set_robot_commands_min	0.008634175459543864
sim_compute_performance-ego_max	0.007207426230112711
sim_compute_performance-ego_mean	0.006852448850438214
sim_compute_performance-ego_median	0.006850290298461914
sim_compute_performance-ego_min	0.006404523849487305
sim_compute_robot_state-ego_max	0.00942338784535726
sim_compute_robot_state-ego_mean	0.008698003630707229
sim_compute_robot_state-ego_median	0.008589775665946629
sim_compute_robot_state-ego_min	0.008202660083770751
sim_compute_sim_state_max	0.005229175090789795
sim_compute_sim_state_mean	0.004889750605044157
sim_compute_sim_state_median	0.004813102881113688
sim_compute_sim_state_min	0.004594009717305501
sim_physics_max	0.11377189954121908
sim_physics_mean	0.10264621782993924
sim_physics_median	0.1022818192191746
sim_physics_min	0.09384672164916992
sim_render-ego_max	0.012266772588094076
sim_render-ego_mean	0.011609780940456668
sim_render-ego_median	0.01163821538289388
sim_render-ego_min	0.011019218762715655
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.19000000000006
survival_time_min	1.1500000000000004

No reset possible

24885

4264

Gianmarco Bernasconi

challenge-aido_LF-baseline-duckietown

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-43-40-10497

2019-11-04 07:58:55+00:00

2019-11-04 08:00:29+00:00

0:01:34

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24874

4274

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-43-40-10497

2019-11-04 07:56:10+00:00

2019-11-04 07:58:40+00:00

0:02:30

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24859

4296

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFV-sim-testing

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 07:40:42+00:00

2019-11-04 07:55:36+00:00

0:14:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.02472675930369984
agent_compute-ego_mean	0.021560709343450637
agent_compute-ego_median	0.022256903648376465
agent_compute-ego_min	0.013577972139630998
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1112205456826628
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.37150980594423094
deviation-heading_median	0.34774352178293905
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589055
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.13645129733615452, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.011798002101756909, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.021714188434459544, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.009791462509720414, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004448767061586733, "sim_compute_performance-ego": 0.006991616001835576, "sim_compute_robot_state-ego": 0.008694035035592539, "sim_compute_robot_state-npc0": 0.008263972070482042, "sim_compute_robot_state-npc1": 0.0076861028318051935, "sim_compute_robot_state-npc2": 0.007733141934430158, "sim_compute_robot_state-npc3": 0.007722669177585178}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.23204593658447265, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.012969131469726563, "in-drivable-lane": 0, "agent_compute-ego": 0.023028755187988283, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.010923824310302734, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.0047918415069580075, "sim_compute_performance-ego": 0.007280035018920899, "sim_compute_robot_state-ego": 0.009491796493530274, "sim_compute_robot_state-npc0": 0.009368400573730468, "sim_compute_robot_state-npc1": 0.00876077651977539, "sim_compute_robot_state-npc2": 0.008263893127441406, "sim_compute_robot_state-npc3": 0.007905759811401368}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18048686102816933, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.011733412742614746, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02273735247160259, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.009373363695646586, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.004934069357420269, "sim_compute_performance-ego": 0.006737442393051951, "sim_compute_robot_state-ego": 0.008706425365648772, "sim_compute_robot_state-npc0": 0.008501589298248291, "sim_compute_robot_state-npc1": 0.00766695173163163, "sim_compute_robot_state-npc2": 0.007947159440893876, "sim_compute_robot_state-npc3": 0.008017919565501967}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.16778754282601271, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.011885597736020633, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0211117961738683, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.008902996401243571, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0043902940387967266, "sim_compute_performance-ego": 0.006986669347256045, "sim_compute_robot_state-ego": 0.0082378236553337, "sim_compute_robot_state-npc0": 0.007848163194294218, "sim_compute_robot_state-npc1": 0.00749253321297561, "sim_compute_robot_state-npc2": 0.007451993000658253, "sim_compute_robot_state-npc3": 0.0072911781600759}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.09222935778754096, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.007117526871817452, "in-drivable-lane": 0, "agent_compute-ego": 0.013577972139630998, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.004800694329398019, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.002738331045423235, "sim_compute_performance-ego": 0.0038632324763706754, "sim_compute_robot_state-ego": 0.004984208515712193, "sim_compute_robot_state-npc0": 0.004778112683977399, "sim_compute_robot_state-npc1": 0.0044964296477181575, "sim_compute_robot_state-npc2": 0.004471387181963239, "sim_compute_robot_state-npc3": 0.004456758499145508}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.13971801157350894, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.01070352836891457, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.023392672891970032, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.00729085780956127, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.0040237197169551145, "sim_compute_performance-ego": 0.005891610074926306, "sim_compute_robot_state-ego": 0.007156146897210015, "sim_compute_robot_state-npc0": 0.012324995464748807, "sim_compute_robot_state-npc1": 0.007765708146271882, "sim_compute_robot_state-npc2": 0.01121110827834518, "sim_compute_robot_state-npc3": 0.006992265030189797}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0456729849899615, "sim_physics": 0.10589263615784822, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.00898364296665898, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.016885232042383264, "deviation-heading": 0.3927366768210136, "set_robot_commands": 0.00702631915057147, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.0033992705521760165, "sim_compute_performance-ego": 0.0050794901671233, "sim_compute_robot_state-ego": 0.006509145100911458, "sim_compute_robot_state-npc0": 0.006121661927964952, "sim_compute_robot_state-npc1": 0.005975233183966743, "sim_compute_robot_state-npc2": 0.006038992493240921, "sim_compute_robot_state-npc3": 0.005845771895514594}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8772562288570896, "sim_physics": 0.21517740885416667, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.011944844987657336, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.020992533365885416, "deviation-heading": 0.3844740406851849, "set_robot_commands": 0.008654159969753689, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.004492976930406359, "sim_compute_performance-ego": 0.0070372210608588325, "sim_compute_robot_state-ego": 0.008399004406399197, "sim_compute_robot_state-npc0": 0.008270968331231011, "sim_compute_robot_state-npc1": 0.007561604181925456, "sim_compute_robot_state-npc2": 0.007663393020629883, "sim_compute_robot_state-npc3": 0.007352929645114475}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.843301097417158, "sim_physics": 0.1441990499911101, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.011797070503234863, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.020834352659142536, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.008705973625183105, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.004293928975644319, "sim_compute_performance-ego": 0.0066958821338155994, "sim_compute_robot_state-ego": 0.008590045182601265, "sim_compute_robot_state-npc0": 0.007865496303724207, "sim_compute_robot_state-npc1": 0.007214883099431577, "sim_compute_robot_state-npc2": 0.007267884586168372, "sim_compute_robot_state-npc3": 0.007125610890595809}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.24558348655700685, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.01319786548614502, "in-drivable-lane": 0, "agent_compute-ego": 0.023944997787475587, "deviation-heading": 0.34774352178293905, "set_robot_commands": 0.01026155471801758, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.0052850341796875, "sim_compute_performance-ego": 0.007955026626586915, "sim_compute_robot_state-ego": 0.010317583084106446, "sim_compute_robot_state-npc0": 0.009505305290222168, "sim_compute_robot_state-npc1": 0.00930570125579834, "sim_compute_robot_state-npc2": 0.008634538650512695, "sim_compute_robot_state-npc3": 0.009030380249023438}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.20674113035202027, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.011023736000061036, "in-drivable-lane": 0, "agent_compute-ego": 0.020799088478088375, "deviation-heading": 0.3801610449156702, "set_robot_commands": 0.008408427238464355, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.004797160625457764, "sim_compute_performance-ego": 0.0069686293601989744, "sim_compute_robot_state-ego": 0.008476555347442627, "sim_compute_robot_state-npc0": 0.007882964611053467, "sim_compute_robot_state-npc1": 0.007334208488464356, "sim_compute_robot_state-npc2": 0.006737244129180908, "sim_compute_robot_state-npc3": 0.007282567024230957}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.15787808518660695, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0117863981347335, "in-drivable-lane": 0, "agent_compute-ego": 0.02407160558198628, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.010622727243523849, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.004845368234734786, "sim_compute_performance-ego": 0.006988211681968288, "sim_compute_robot_state-ego": 0.008648019087942023, "sim_compute_robot_state-npc0": 0.009023415414910568, "sim_compute_robot_state-npc1": 0.00864519571003161, "sim_compute_robot_state-npc2": 0.009009838104248049, "sim_compute_robot_state-npc3": 0.00870044607865183}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700496, "sim_physics": 0.1629698419570923, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.012129712104797364, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.022256903648376465, "deviation-heading": 0.2263485117662672, "set_robot_commands": 0.00923189640045166, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.004506220817565918, "sim_compute_performance-ego": 0.007205243110656738, "sim_compute_robot_state-ego": 0.009028453826904296, "sim_compute_robot_state-npc0": 0.008369374275207519, "sim_compute_robot_state-npc1": 0.007999558448791504, "sim_compute_robot_state-npc2": 0.008614373207092286, "sim_compute_robot_state-npc3": 0.007899298667907714}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3514429441281624, "sim_physics": 0.25851966034282337, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.013860561630942604, "in-drivable-lane": 0, "agent_compute-ego": 0.02472675930369984, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.010642311789772728, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.004655014384876598, "sim_compute_performance-ego": 0.007712515917691318, "sim_compute_robot_state-ego": 0.00991336865858598, "sim_compute_robot_state-npc0": 0.009231838313016024, "sim_compute_robot_state-npc1": 0.008266232230446556, "sim_compute_robot_state-npc2": 0.008752649480646307, "sim_compute_robot_state-npc3": 0.008650660514831543}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.20651891766762248, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.011962092652612805, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.02333642998520209, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.009865765668907943, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.004942246845790318, "sim_compute_performance-ego": 0.007345729944657306, "sim_compute_robot_state-ego": 0.009234856586067043, "sim_compute_robot_state-npc0": 0.008190719448790258, "sim_compute_robot_state-npc1": 0.008042457152386101, "sim_compute_robot_state-npc2": 0.007786162045537209, "sim_compute_robot_state-npc3": 0.007739315227586396}}
set_robot_commands_max	0.010923824310302734
set_robot_commands_mean	0.008966822324034599
set_robot_commands_median	0.00923189640045166
set_robot_commands_min	0.004800694329398019
sim_compute_performance-ego_max	0.007955026626586915
sim_compute_performance-ego_mean	0.006715903687727913
sim_compute_performance-ego_median	0.006988211681968288
sim_compute_performance-ego_min	0.0038632324763706754
sim_compute_robot_state-ego_max	0.010317583084106446
sim_compute_robot_state-ego_mean	0.00842583114959919
sim_compute_robot_state-ego_median	0.008648019087942023
sim_compute_robot_state-ego_min	0.004984208515712193
sim_compute_robot_state-npc0_max	0.012324995464748807
sim_compute_robot_state-npc0_mean	0.008369798480106761
sim_compute_robot_state-npc0_median	0.008270968331231011
sim_compute_robot_state-npc0_min	0.004778112683977399
sim_compute_robot_state-npc1_max	0.00930570125579834
sim_compute_robot_state-npc1_mean	0.007614238389428008
sim_compute_robot_state-npc1_median	0.0076861028318051935
sim_compute_robot_state-npc1_min	0.0044964296477181575
sim_compute_robot_state-npc2_max	0.01121110827834518
sim_compute_robot_state-npc2_mean	0.007838917245399249
sim_compute_robot_state-npc2_median	0.007786162045537209
sim_compute_robot_state-npc2_min	0.004471387181963239
sim_compute_robot_state-npc3_max	0.009030380249023438
sim_compute_robot_state-npc3_mean	0.007467568695823764
sim_compute_robot_state-npc3_median	0.007722669177585178
sim_compute_robot_state-npc3_min	0.004456758499145508
sim_compute_sim_state_max	0.0052850341796875
sim_compute_sim_state_mean	0.004436282951565311
sim_compute_sim_state_median	0.004506220817565918
sim_compute_sim_state_min	0.002738331045423235
sim_physics_max	0.25851966034282337
sim_physics_mean	0.1768132816134771
sim_physics_median	0.16778754282601271
sim_physics_min	0.09222935778754096
sim_render-ego_max	0.013860561630942604
sim_render-ego_mean	0.011526208250512955
sim_render-ego_median	0.011798002101756909
sim_render-ego_min	0.007117526871817452
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

24838

4338

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-43-40-10497

2019-11-04 07:01:09+00:00

2019-11-04 07:40:11+00:00

0:39:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0520501683957786
survival_time_median	12.100000000000035
deviation-center-line_median	0.6841719944714622
in-drivable-lane_median	0.7000000000000055

other stats

agent_compute-ego_max	0.0940667254584176
agent_compute-ego_mean	0.05742172053259877
agent_compute-ego_median	0.054723736668421216
agent_compute-ego_min	0.04906146287918091
deviation-center-line_max	1.3521227658859043
deviation-center-line_mean	0.6879210221474633
deviation-center-line_min	0.2232235212970944
deviation-heading_max	5.667548866948652
deviation-heading_mean	2.906118515984672
deviation-heading_median	2.855479752808102
deviation-heading_min	0.6743275789240026
driven_any_max	2.349143967441482
driven_any_mean	1.6648315693607632
driven_any_median	1.8830555773426645
driven_any_min	0.4525974089759238
driven_lanedir_consec_max	2.3241555663832667
driven_lanedir_consec_mean	1.1457385805209086
driven_lanedir_consec_min	0.42679157621525254
driven_lanedir_max	2.3241555663832667
driven_lanedir_mean	1.2912138407727178
driven_lanedir_median	1.0922673063805366
driven_lanedir_min	0.42679157621525254
in-drivable-lane_max	5.250000000000037
in-drivable-lane_mean	1.4966666666666744
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8830555773426645, "sim_physics": 0.1272181843923143, "survival_time": 12.100000000000035, "driven_lanedir": 1.008930632620949, "sim_render-ego": 0.012867066485822693, "in-drivable-lane": 4.050000000000008, "agent_compute-ego": 0.054723736668421216, "deviation-heading": 3.796528087291126, "set_robot_commands": 0.010660906468541167, "deviation-center-line": 0.5085998736437355, "driven_lanedir_consec": 0.8835801125941274, "sim_compute_sim_state": 0.005568068874768974, "sim_compute_performance-ego": 0.007674527562354222, "sim_compute_robot_state-ego": 0.009940975953724758}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348719509959389, "sim_physics": 0.12071322997411092, "survival_time": 14.950000000000076, "driven_lanedir": 1.435561250648267, "sim_render-ego": 0.013551694552103678, "in-drivable-lane": 4.300000000000027, "agent_compute-ego": 0.05433804909388224, "deviation-heading": 4.603882945692033, "set_robot_commands": 0.011277746359507243, "deviation-center-line": 1.0310606218511926, "driven_lanedir_consec": 1.247963297941797, "sim_compute_sim_state": 0.005548855463663737, "sim_compute_performance-ego": 0.008006024360656738, "sim_compute_robot_state-ego": 0.010230848789215088}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3487928254831756, "sim_physics": 0.13411715904871624, "survival_time": 14.950000000000076, "driven_lanedir": 1.9381457425436577, "sim_render-ego": 0.013787864049275716, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.05651894013086955, "deviation-heading": 5.667548866948652, "set_robot_commands": 0.0112502121925354, "deviation-center-line": 0.6841719944714622, "driven_lanedir_consec": 1.2102332382738223, "sim_compute_sim_state": 0.005481082598368327, "sim_compute_performance-ego": 0.007994694709777832, "sim_compute_robot_state-ego": 0.01043501377105713}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.340609972468538, "sim_physics": 0.12445994271528, "survival_time": 14.900000000000077, "driven_lanedir": 1.2376479919257155, "sim_render-ego": 0.013178058118628176, "in-drivable-lane": 5.250000000000037, "agent_compute-ego": 0.05266588966318425, "deviation-heading": 4.520392543084717, "set_robot_commands": 0.01049179038745445, "deviation-center-line": 0.7043473109537003, "driven_lanedir_consec": 0.6796963357458226, "sim_compute_sim_state": 0.00551087584271527, "sim_compute_performance-ego": 0.007914673562017863, "sim_compute_robot_state-ego": 0.010118234877618369}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1998262526121437, "sim_physics": 0.10957930332575087, "survival_time": 7.79999999999998, "driven_lanedir": 1.0520501683957786, "sim_render-ego": 0.012644304678990291, "in-drivable-lane": 0, "agent_compute-ego": 0.05228945994988466, "deviation-heading": 3.0111641325372607, "set_robot_commands": 0.009793532200348684, "deviation-center-line": 0.4112543717280408, "driven_lanedir_consec": 1.0520501683957786, "sim_compute_sim_state": 0.0052972863882015915, "sim_compute_performance-ego": 0.007755727340013553, "sim_compute_robot_state-ego": 0.009575556486080857}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.349029164836203, "sim_physics": 0.1214501945177714, "survival_time": 14.950000000000076, "driven_lanedir": 1.955218190273133, "sim_render-ego": 0.013063193957010904, "in-drivable-lane": 1.600000000000005, "agent_compute-ego": 0.05311467568079631, "deviation-heading": 3.65555831300537, "set_robot_commands": 0.010478366216023762, "deviation-center-line": 0.993611158559236, "driven_lanedir_consec": 1.955218190273133, "sim_compute_sim_state": 0.005418024857838949, "sim_compute_performance-ego": 0.007929508686065673, "sim_compute_robot_state-ego": 0.010248393217722574}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.4525974089759238, "sim_physics": 0.1275386923835391, "survival_time": 3.149999999999997, "driven_lanedir": 0.42679157621525254, "sim_render-ego": 0.01346572997078063, "in-drivable-lane": 0, "agent_compute-ego": 0.057440095477634005, "deviation-heading": 0.6743275789240026, "set_robot_commands": 0.010121228202940926, "deviation-center-line": 0.2385585323748525, "driven_lanedir_consec": 0.42679157621525254, "sim_compute_sim_state": 0.005590646985977415, "sim_compute_performance-ego": 0.007726131923614986, "sim_compute_robot_state-ego": 0.009463329163808673}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.3605190188971144, "sim_physics": 0.13930428976362402, "survival_time": 8.79999999999999, "driven_lanedir": 1.0922673063805366, "sim_render-ego": 0.01334571973844008, "in-drivable-lane": 0.7000000000000055, "agent_compute-ego": 0.05721029503778978, "deviation-heading": 2.855479752808102, "set_robot_commands": 0.0105198472738266, "deviation-center-line": 0.6925325518163298, "driven_lanedir_consec": 1.0922673063805366, "sim_compute_sim_state": 0.005372371185909618, "sim_compute_performance-ego": 0.007910530675541271, "sim_compute_robot_state-ego": 0.010083833878690546}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3491184860623164, "sim_physics": 0.11456292708714803, "survival_time": 14.950000000000076, "driven_lanedir": 2.305815527923116, "sim_render-ego": 0.01305559476216634, "in-drivable-lane": 0, "agent_compute-ego": 0.050869675477345784, "deviation-heading": 2.491641431556656, "set_robot_commands": 0.010139647324879965, "deviation-center-line": 1.0310486589511716, "driven_lanedir_consec": 2.305815527923116, "sim_compute_sim_state": 0.0054411101341247554, "sim_compute_performance-ego": 0.007672746976216634, "sim_compute_robot_state-ego": 0.009665770530700684}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5088138996159906, "sim_physics": 0.136336122240339, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45494882759654853, "sim_render-ego": 0.01426410675048828, "in-drivable-lane": 0, "agent_compute-ego": 0.0940667254584176, "deviation-heading": 0.9784104600590644, "set_robot_commands": 0.01064183371407645, "deviation-center-line": 0.2232235212970944, "driven_lanedir_consec": 0.45494882759654853, "sim_compute_sim_state": 0.005538153648376465, "sim_compute_performance-ego": 0.008310314587184361, "sim_compute_robot_state-ego": 0.010694905689784458}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0472498641036172, "sim_physics": 0.13491850351765208, "survival_time": 6.849999999999984, "driven_lanedir": 1.0113472733754805, "sim_render-ego": 0.014550840767630696, "in-drivable-lane": 0, "agent_compute-ego": 0.06152522650948406, "deviation-heading": 1.1982073650227898, "set_robot_commands": 0.01062997588275993, "deviation-center-line": 0.6357471604105381, "driven_lanedir_consec": 1.0113472733754805, "sim_compute_sim_state": 0.006011473871495602, "sim_compute_performance-ego": 0.008354448053958642, "sim_compute_robot_state-ego": 0.010376162772631124}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4686656841799314, "sim_physics": 0.12876565272991475, "survival_time": 3.2499999999999964, "driven_lanedir": 0.4417782771649004, "sim_render-ego": 0.013438826340895433, "in-drivable-lane": 0, "agent_compute-ego": 0.060928667508638824, "deviation-heading": 0.6995351100888234, "set_robot_commands": 0.011135446108304536, "deviation-center-line": 0.225543764249676, "driven_lanedir_consec": 0.4417782771649004, "sim_compute_sim_state": 0.0055948367485633265, "sim_compute_performance-ego": 0.008019828796386718, "sim_compute_robot_state-ego": 0.010313668617835413}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.6175797930927531, "sim_physics": 0.11751226622324724, "survival_time": 10.400000000000013, "driven_lanedir": 0.9022553988303886, "sim_render-ego": 0.01358545285004836, "in-drivable-lane": 3.699999999999992, "agent_compute-ego": 0.0563954241000689, "deviation-heading": 2.5063728215668353, "set_robot_commands": 0.01085347395676833, "deviation-center-line": 0.3744014044301639, "driven_lanedir_consec": 0.6153364572044177, "sim_compute_sim_state": 0.005492053352869474, "sim_compute_performance-ego": 0.007772431923792913, "sim_compute_robot_state-ego": 0.009907995279018696}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.349143967441482, "sim_physics": 0.11501645803451538, "survival_time": 14.950000000000076, "driven_lanedir": 2.3241555663832667, "sim_render-ego": 0.012918511231740317, "in-drivable-lane": 0, "agent_compute-ego": 0.05017748435338338, "deviation-heading": 1.8751596452906156, "set_robot_commands": 0.009954888820648194, "deviation-center-line": 1.3521227658859043, "driven_lanedir_consec": 2.3241555663832667, "sim_compute_sim_state": 0.00510062297185262, "sim_compute_performance-ego": 0.007786992390950521, "sim_compute_robot_state-ego": 0.009778256416320802}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348752115340203, "sim_physics": 0.11216233491897584, "survival_time": 14.950000000000076, "driven_lanedir": 1.7812938813137773, "sim_render-ego": 0.012439903418223064, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.04906146287918091, "deviation-heading": 5.057568685894039, "set_robot_commands": 0.009469429651896158, "deviation-center-line": 1.2125916415888514, "driven_lanedir_consec": 1.484896552345628, "sim_compute_sim_state": 0.004822711944580078, "sim_compute_performance-ego": 0.007269115447998047, "sim_compute_robot_state-ego": 0.009120047092437744}}
set_robot_commands_max	0.011277746359507243
set_robot_commands_mean	0.010494554984034118
set_robot_commands_median	0.0105198472738266
set_robot_commands_min	0.009469429651896158
sim_compute_performance-ego_max	0.008354448053958642
sim_compute_performance-ego_mean	0.007873179799768665
sim_compute_performance-ego_median	0.007910530675541271
sim_compute_performance-ego_min	0.007269115447998047
sim_compute_robot_state-ego_max	0.010694905689784458
sim_compute_robot_state-ego_mean	0.009996866169109794
sim_compute_robot_state-ego_median	0.010083833878690546
sim_compute_robot_state-ego_min	0.009120047092437744
sim_compute_sim_state_max	0.006011473871495602
sim_compute_sim_state_mean	0.005452544991287081
sim_compute_sim_state_median	0.005492053352869474
sim_compute_sim_state_min	0.004822711944580078
sim_physics_max	0.13930428976362402
sim_physics_mean	0.12424368405819328
sim_physics_median	0.12445994271528
sim_physics_min	0.10957930332575087
sim_render-ego_max	0.014550840767630696
sim_render-ego_mean	0.013343791178149643
sim_render-ego_median	0.01334571973844008
sim_render-ego_min	0.012439903418223064
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.696666666666705
survival_time_min	3.149999999999997

No reset possible

24823

4326

Gianmarco Bernasconi

baseline-IL-sim-tensorflow

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-43-40-10497

2019-11-04 06:55:37+00:00

2019-11-04 07:00:20+00:00

0:04:43

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24806

4342

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-02 17:34:15+00:00

2019-11-02 17:56:33+00:00

0:22:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.029193058651504
survival_time_median	14.950000000000076
deviation-center-line_median	0.6896813609377953
in-drivable-lane_median	2.399999999999995

other stats

agent_compute-ego_max	0.05982444206873576
agent_compute-ego_mean	0.050943324761653655
agent_compute-ego_median	0.05207483212153117
agent_compute-ego_min	0.03843372079390514
deviation-center-line_max	1.1795591270124717
deviation-center-line_mean	0.7028869743673422
deviation-center-line_min	0.17380398157607782
deviation-heading_max	6.432956593750075
deviation-heading_mean	4.097141873815478
deviation-heading_median	5.516726961166688
deviation-heading_min	1.0055084037284945
driven_any_max	2.3486189433525033
driven_any_mean	1.7429508600141723
driven_any_median	2.3485655963732093
driven_any_min	0.5735036257570075
driven_lanedir_consec_max	1.4722271036379193
driven_lanedir_consec_mean	0.9906204737820796
driven_lanedir_consec_min	0.44450132869143166
driven_lanedir_max	1.665906267602465
driven_lanedir_mean	1.196817796610417
driven_lanedir_median	1.3396120176286987
driven_lanedir_min	0.44450132869143166
in-drivable-lane_max	4.0000000000000435
in-drivable-lane_mean	1.950000000000007
in-drivable-lane_min	0.2499999999999991
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5735036257570075, "sim_physics": 0.1999178415612329, "survival_time": 3.949999999999994, "driven_lanedir": 0.44450132869143166, "sim_render-ego": 0.013993383962896806, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.03843372079390514, "deviation-heading": 1.49183262828991, "set_robot_commands": 0.01179802266857292, "deviation-center-line": 0.17380398157607782, "driven_lanedir_consec": 0.44450132869143166, "sim_compute_sim_state": 0.005685401868216599, "sim_compute_performance-ego": 0.007810399502138549, "sim_compute_robot_state-ego": 0.011112155793588372, "sim_compute_robot_state-npc0": 0.009869859188417844, "sim_compute_robot_state-npc1": 0.009655720070947576, "sim_compute_robot_state-npc2": 0.00917022137702266, "sim_compute_robot_state-npc3": 0.010080660445780694}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3485783633884996, "sim_physics": 0.18378583510716756, "survival_time": 14.950000000000076, "driven_lanedir": 1.3396120176286987, "sim_render-ego": 0.01338210105895996, "in-drivable-lane": 4.0000000000000435, "agent_compute-ego": 0.05207483212153117, "deviation-heading": 6.038684782142221, "set_robot_commands": 0.010517934958140056, "deviation-center-line": 1.1795591270124717, "driven_lanedir_consec": 0.8283791825162519, "sim_compute_sim_state": 0.005281679630279541, "sim_compute_performance-ego": 0.007688164710998535, "sim_compute_robot_state-ego": 0.01038174072901408, "sim_compute_robot_state-npc0": 0.009514404932657875, "sim_compute_robot_state-npc1": 0.009373579025268556, "sim_compute_robot_state-npc2": 0.009111607869466146, "sim_compute_robot_state-npc3": 0.0089483904838562}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0954877711996418, "sim_physics": 0.18879296896340964, "survival_time": 7.149999999999983, "driven_lanedir": 1.029193058651504, "sim_render-ego": 0.014266600975623498, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.05900424843901521, "deviation-heading": 1.0055084037284945, "set_robot_commands": 0.010016703105473018, "deviation-center-line": 0.5607831276108267, "driven_lanedir_consec": 1.029193058651504, "sim_compute_sim_state": 0.005765119632640919, "sim_compute_performance-ego": 0.008268519714995698, "sim_compute_robot_state-ego": 0.010285994389674046, "sim_compute_robot_state-npc0": 0.009581692568905705, "sim_compute_robot_state-npc1": 0.009822850460772747, "sim_compute_robot_state-npc2": 0.00954734362088717, "sim_compute_robot_state-npc3": 0.009678612222204674}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3486189433525033, "sim_physics": 0.19532393296559653, "survival_time": 14.950000000000076, "driven_lanedir": 1.504876310477985, "sim_render-ego": 0.013868306477864583, "in-drivable-lane": 2.849999999999998, "agent_compute-ego": 0.05982444206873576, "deviation-heading": 6.432956593750075, "set_robot_commands": 0.01048364798227946, "deviation-center-line": 0.9106072746995392, "driven_lanedir_consec": 1.1788016954132914, "sim_compute_sim_state": 0.00573632796605428, "sim_compute_performance-ego": 0.00812314748764038, "sim_compute_robot_state-ego": 0.010649918715159098, "sim_compute_robot_state-npc0": 0.009552593231201173, "sim_compute_robot_state-npc1": 0.009409396648406985, "sim_compute_robot_state-npc2": 0.009435663223266602, "sim_compute_robot_state-npc3": 0.009637128512064616}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3485655963732093, "sim_physics": 0.13372646093368531, "survival_time": 14.950000000000076, "driven_lanedir": 1.665906267602465, "sim_render-ego": 0.010248960653940835, "in-drivable-lane": 2.399999999999995, "agent_compute-ego": 0.04537938038508097, "deviation-heading": 5.516726961166688, "set_robot_commands": 0.0073381002744038895, "deviation-center-line": 0.6896813609377953, "driven_lanedir_consec": 1.4722271036379193, "sim_compute_sim_state": 0.0041158326466878255, "sim_compute_performance-ego": 0.005662740866343181, "sim_compute_robot_state-ego": 0.00746409257253011, "sim_compute_robot_state-npc0": 0.007041420936584473, "sim_compute_robot_state-npc1": 0.006819592316945394, "sim_compute_robot_state-npc2": 0.006809256076812744, "sim_compute_robot_state-npc3": 0.006786170800526937}}
set_robot_commands_max	0.01179802266857292
set_robot_commands_mean	0.010030881797773868
set_robot_commands_median	0.01048364798227946
set_robot_commands_min	0.0073381002744038895
sim_compute_performance-ego_max	0.008268519714995698
sim_compute_performance-ego_mean	0.007510594456423267
sim_compute_performance-ego_median	0.007810399502138549
sim_compute_performance-ego_min	0.005662740866343181
sim_compute_robot_state-ego_max	0.011112155793588372
sim_compute_robot_state-ego_mean	0.009978780439993142
sim_compute_robot_state-ego_median	0.01038174072901408
sim_compute_robot_state-ego_min	0.00746409257253011
sim_compute_robot_state-npc0_max	0.009869859188417844
sim_compute_robot_state-npc0_mean	0.009111994171553414
sim_compute_robot_state-npc0_median	0.009552593231201173
sim_compute_robot_state-npc0_min	0.007041420936584473
sim_compute_robot_state-npc1_max	0.009822850460772747
sim_compute_robot_state-npc1_mean	0.009016227704468253
sim_compute_robot_state-npc1_median	0.009409396648406985
sim_compute_robot_state-npc1_min	0.006819592316945394
sim_compute_robot_state-npc2_max	0.00954734362088717
sim_compute_robot_state-npc2_mean	0.008814818433491065
sim_compute_robot_state-npc2_median	0.00917022137702266
sim_compute_robot_state-npc2_min	0.006809256076812744
sim_compute_robot_state-npc3_max	0.010080660445780694
sim_compute_robot_state-npc3_mean	0.009026192492886624
sim_compute_robot_state-npc3_median	0.009637128512064616
sim_compute_robot_state-npc3_min	0.006786170800526937
sim_compute_sim_state_max	0.005765119632640919
sim_compute_sim_state_mean	0.005316872348775833
sim_compute_sim_state_median	0.005685401868216599
sim_compute_sim_state_min	0.0041158326466878255
sim_physics_max	0.1999178415612329
sim_physics_mean	0.1803094079062184
sim_physics_median	0.18879296896340964
sim_physics_min	0.13372646093368531
sim_render-ego_max	0.014266600975623498
sim_render-ego_mean	0.013151870625857136
sim_render-ego_median	0.013868306477864583
sim_render-ego_min	0.010248960653940835
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.19000000000004
survival_time_min	3.949999999999994

No reset possible

24789

4335

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-11-02 16:25:11+00:00

2019-11-02 16:33:21+00:00

0:08:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.02433468118498597
agent_compute-ego_mean	0.022773341390615633
agent_compute-ego_median	0.02298322319984436
agent_compute-ego_min	0.021276017994556612
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1978040164030051, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.013147040258480024, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02433468118498597, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.00911723511128486, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.00517783587491965, "sim_compute_performance-ego": 0.007088217554213126, "sim_compute_robot_state-ego": 0.009723144241526156, "sim_compute_robot_state-npc0": 0.008429186253608027, "sim_compute_robot_state-npc1": 0.00822805452950393, "sim_compute_robot_state-npc2": 0.008393357071695449, "sim_compute_robot_state-npc3": 0.008466895622543142}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.1779037288257054, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.01242915221623012, "in-drivable-lane": 0, "agent_compute-ego": 0.023562593119485036, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.009336812155587333, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.004941471985408238, "sim_compute_performance-ego": 0.006853997707366943, "sim_compute_robot_state-ego": 0.00850825650351388, "sim_compute_robot_state-npc0": 0.008341176169259208, "sim_compute_robot_state-npc1": 0.007945188454219274, "sim_compute_robot_state-npc2": 0.007635108062199184, "sim_compute_robot_state-npc3": 0.008181784834180559}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.16126384318453593, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.011716240818060716, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.021276017994556612, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.007890636481127693, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.0046712217979060795, "sim_compute_performance-ego": 0.00670947380436277, "sim_compute_robot_state-ego": 0.008327690143029667, "sim_compute_robot_state-npc0": 0.007441136443499223, "sim_compute_robot_state-npc1": 0.007719132506731645, "sim_compute_robot_state-npc2": 0.007738291638568767, "sim_compute_robot_state-npc3": 0.007471913272894702}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.16779939830303192, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.01231891413529714, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.02298322319984436, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.0082559734582901, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.004885961612065633, "sim_compute_performance-ego": 0.006520102421442668, "sim_compute_robot_state-ego": 0.008406420548756918, "sim_compute_robot_state-npc0": 0.008211438854535421, "sim_compute_robot_state-npc1": 0.007709816098213196, "sim_compute_robot_state-npc2": 0.007288883129755656, "sim_compute_robot_state-npc3": 0.00721760094165802}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.166473422731672, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.011736688159760974, "in-drivable-lane": 0, "agent_compute-ego": 0.021710191454206194, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.008090655008951822, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.004067432312738328, "sim_compute_performance-ego": 0.00607118152436756, "sim_compute_robot_state-ego": 0.008527744384039016, "sim_compute_robot_state-npc0": 0.007645425342378162, "sim_compute_robot_state-npc1": 0.007147720881870815, "sim_compute_robot_state-npc2": 0.007033495675949823, "sim_compute_robot_state-npc3": 0.0075152601514543805}}
set_robot_commands_max	0.009336812155587333
set_robot_commands_mean	0.008538262443048361
set_robot_commands_median	0.0082559734582901
set_robot_commands_min	0.007890636481127693
sim_compute_performance-ego_max	0.007088217554213126
sim_compute_performance-ego_mean	0.006648594602350613
sim_compute_performance-ego_median	0.00670947380436277
sim_compute_performance-ego_min	0.00607118152436756
sim_compute_robot_state-ego_max	0.009723144241526156
sim_compute_robot_state-ego_mean	0.008698651164173126
sim_compute_robot_state-ego_median	0.00850825650351388
sim_compute_robot_state-ego_min	0.008327690143029667
sim_compute_robot_state-npc0_max	0.008429186253608027
sim_compute_robot_state-npc0_mean	0.008013672612656009
sim_compute_robot_state-npc0_median	0.008211438854535421
sim_compute_robot_state-npc0_min	0.007441136443499223
sim_compute_robot_state-npc1_max	0.00822805452950393
sim_compute_robot_state-npc1_mean	0.007749982494107773
sim_compute_robot_state-npc1_median	0.007719132506731645
sim_compute_robot_state-npc1_min	0.007147720881870815
sim_compute_robot_state-npc2_max	0.008393357071695449
sim_compute_robot_state-npc2_mean	0.007617827115633776
sim_compute_robot_state-npc2_median	0.007635108062199184
sim_compute_robot_state-npc2_min	0.007033495675949823
sim_compute_robot_state-npc3_max	0.008466895622543142
sim_compute_robot_state-npc3_mean	0.00777069096454616
sim_compute_robot_state-npc3_median	0.0075152601514543805
sim_compute_robot_state-npc3_min	0.00721760094165802
sim_compute_sim_state_max	0.00517783587491965
sim_compute_sim_state_mean	0.004748784716607586
sim_compute_sim_state_median	0.004885961612065633
sim_compute_sim_state_min	0.004067432312738328
sim_physics_max	0.1978040164030051
sim_physics_mean	0.17424888188959006
sim_physics_median	0.16779939830303192
sim_physics_min	0.16126384318453593
sim_render-ego_max	0.013147040258480024
sim_render-ego_mean	0.012269607117565796
sim_render-ego_median	0.01231891413529714
sim_render-ego_min	0.011716240818060716
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24770

4317

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFV-sim-testing

step1-simulation

host-error

ip-172-31-43-40-10497

2019-11-02 06:49:18+00:00

2019-11-02 06:51:36+00:00

0:02:18

Error while running [...]


stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling simulator      ... done
stderr | 
stderr | ERROR: for solution  Cannot overwrite digest sha256:ac0b8e530d8161f169d6b2605c3747d7bf1b2daf22c90609277fa161ab4951f3
stderr | Cannot overwrite digest sha256:ac0b8e530d8161f169d6b2605c3747d7bf1b2daf22c90609277fa161ab4951f3
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24742

4305

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LFV-sim-validation

step1-simulation

success

ip-172-31-43-40-10497

2019-10-31 14:05:25+00:00

2019-10-31 14:12:03+00:00

0:06:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6856800730956207
survival_time_median	2.000000000000001
deviation-center-line_median	0.08877415228107144
in-drivable-lane_median	0.4500000000000002

other stats

agent_compute-ego_max	0.02899047136306763
agent_compute-ego_mean	0.027490267825849124
agent_compute-ego_median	0.028665022416548298
agent_compute-ego_min	0.025463271141052245
deviation-center-line_max	0.11803708647411268
deviation-center-line_mean	0.09185657022323757
deviation-center-line_min	0.06073337098493198
deviation-heading_max	0.3681646786246837
deviation-heading_mean	0.3023908956024058
deviation-heading_median	0.28606528190679475
deviation-heading_min	0.2638670899443274
driven_any_max	1.59965468873004
driven_any_mean	1.0121135123884497
driven_any_median	0.9996632207705848
driven_any_min	0.4010834948810249
driven_lanedir_consec_max	1.2187176370157662
driven_lanedir_consec_mean	0.7889876883841616
driven_lanedir_consec_min	0.3872027169265986
driven_lanedir_max	1.2187176370157662
driven_lanedir_mean	0.7889876883841616
driven_lanedir_median	0.6856800730956207
driven_lanedir_min	0.3872027169265986
in-drivable-lane_max	0.5999999999999979
in-drivable-lane_mean	0.3299999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.17085506319999694, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.012908482551574708, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.02899047136306763, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.010078299045562743, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.004750257730484009, "sim_compute_performance-ego": 0.007172238826751709, "sim_compute_robot_state-ego": 0.009918797016143798, "sim_compute_robot_state-npc0": 0.00881131887435913, "sim_compute_robot_state-npc1": 0.008397644758224488, "sim_compute_robot_state-npc2": 0.00917918086051941, "sim_compute_robot_state-npc3": 0.008144903182983398}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4605114688305785, "sim_physics": 0.18446129018610177, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.012147827581925823, "in-drivable-lane": 0, "agent_compute-ego": 0.028665022416548298, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.009284387935291636, "deviation-center-line": 0.0772648215662309, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.0047772147438742895, "sim_compute_performance-ego": 0.0068957263773137874, "sim_compute_robot_state-ego": 0.008704998276450417, "sim_compute_robot_state-npc0": 0.00846232067454945, "sim_compute_robot_state-npc1": 0.008050604300065474, "sim_compute_robot_state-npc2": 0.00806062871759588, "sim_compute_robot_state-npc3": 0.00789532878182151}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.1496167540550232, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.011924417813618976, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02564398845036825, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.00821066697438558, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.005179508527119955, "sim_compute_performance-ego": 0.006254462401072184, "sim_compute_robot_state-ego": 0.008395508925120036, "sim_compute_robot_state-npc0": 0.008262209097544352, "sim_compute_robot_state-npc1": 0.007939787705739339, "sim_compute_robot_state-npc2": 0.007785224914550781, "sim_compute_robot_state-npc3": 0.007534817854563395}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59965468873004, "sim_physics": 0.17767757574717205, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2187176370157662, "sim_render-ego": 0.01308917999267578, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.028688585758209227, "deviation-heading": 0.2793068494541745, "set_robot_commands": 0.009314974149068195, "deviation-center-line": 0.11447341980984076, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.005152976512908936, "sim_compute_performance-ego": 0.006817356745402018, "sim_compute_robot_state-ego": 0.0105263352394104, "sim_compute_robot_state-npc0": 0.009450908501942952, "sim_compute_robot_state-npc1": 0.008654022216796875, "sim_compute_robot_state-npc2": 0.00818259318669637, "sim_compute_robot_state-npc3": 0.008403905232747396}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810249, "sim_physics": 0.13269877433776855, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3872027169265986, "sim_render-ego": 0.012584555149078368, "in-drivable-lane": 0, "agent_compute-ego": 0.025463271141052245, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.007755303382873535, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3872027169265986, "sim_compute_sim_state": 0.004928302764892578, "sim_compute_performance-ego": 0.006284868717193604, "sim_compute_robot_state-ego": 0.008777749538421632, "sim_compute_robot_state-npc0": 0.008169567584991455, "sim_compute_robot_state-npc1": 0.007118213176727295, "sim_compute_robot_state-npc2": 0.007411301136016846, "sim_compute_robot_state-npc3": 0.007947683334350586}}
set_robot_commands_max	0.010078299045562743
set_robot_commands_mean	0.008928726297436339
set_robot_commands_median	0.009284387935291636
set_robot_commands_min	0.007755303382873535
sim_compute_performance-ego_max	0.007172238826751709
sim_compute_performance-ego_mean	0.006684930613546661
sim_compute_performance-ego_median	0.006817356745402018
sim_compute_performance-ego_min	0.006254462401072184
sim_compute_robot_state-ego_max	0.0105263352394104
sim_compute_robot_state-ego_mean	0.009264677799109255
sim_compute_robot_state-ego_median	0.008777749538421632
sim_compute_robot_state-ego_min	0.008395508925120036
sim_compute_robot_state-npc0_max	0.009450908501942952
sim_compute_robot_state-npc0_mean	0.008631264946677469
sim_compute_robot_state-npc0_median	0.00846232067454945
sim_compute_robot_state-npc0_min	0.008169567584991455
sim_compute_robot_state-npc1_max	0.008654022216796875
sim_compute_robot_state-npc1_mean	0.008032054431510696
sim_compute_robot_state-npc1_median	0.008050604300065474
sim_compute_robot_state-npc1_min	0.007118213176727295
sim_compute_robot_state-npc2_max	0.00917918086051941
sim_compute_robot_state-npc2_mean	0.008123785763075857
sim_compute_robot_state-npc2_median	0.00806062871759588
sim_compute_robot_state-npc2_min	0.007411301136016846
sim_compute_robot_state-npc3_max	0.008403905232747396
sim_compute_robot_state-npc3_mean	0.007985327677293257
sim_compute_robot_state-npc3_median	0.007947683334350586
sim_compute_robot_state-npc3_min	0.007534817854563395
sim_compute_sim_state_max	0.005179508527119955
sim_compute_sim_state_mean	0.0049576520558559534
sim_compute_sim_state_median	0.004928302764892578
sim_compute_sim_state_min	0.004750257730484009
sim_physics_max	0.18446129018610177
sim_physics_mean	0.1630618915052125
sim_physics_median	0.17085506319999694
sim_physics_min	0.13269877433776855
sim_render-ego_max	0.01308917999267578
sim_render-ego_mean	0.012530892617774732
sim_render-ego_median	0.012584555149078368
sim_render-ego_min	0.011924417813618976
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	2.019999999999999
survival_time_min	1.0000000000000002

No reset possible

24723

2687

Artem Ioselevskii

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 14:04:14+00:00

2019-10-31 14:04:48+00:00

0:00:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10657938161524334
error_L2	0.017479438947069367

No reset possible

24715

2870

Jieming Ji 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 14:03:46+00:00

2019-10-31 14:04:06+00:00

0:00:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12177991907817531
error_L2	0.022353151417139328

No reset possible

24713

2888

Diego Charrez 🇵🇪

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 14:03:22+00:00

2019-10-31 14:03:37+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12064200298224378
error_L2	0.0242131972049235

No reset possible

24701

3151

Eric Lu

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 14:02:49+00:00

2019-10-31 14:03:04+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12051399046566023
error_L2	0.02225809829947152

No reset possible

24688

3171

Chao-Chun Hsu 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 14:02:18+00:00

2019-10-31 14:02:34+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12070128404083429
error_L2	0.022013877124906597

No reset possible

24679

3264

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-43-40-10497

2019-10-31 14:01:58+00:00

2019-10-31 14:02:02+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24674

3265

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-43-40-10497

2019-10-31 14:01:39+00:00

2019-10-31 14:01:43+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24667

3257

Liu Sam 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-43-40-10497

2019-10-31 14:01:14+00:00

2019-10-31 14:01:18+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24652

3250

Kuan-Lin Chen 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 14:00:06+00:00

2019-10-31 14:01:06+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10589060681968748
error_L2	0.01812082114533664

No reset possible

24642

3279

Tony Hsiao

PredictorRandom

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:59:24+00:00

2019-10-31 13:59:46+00:00

0:00:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.328925745065973
error_L2	0.16082957960629837

No reset possible

24634

3592

Victor Adolfo Romero Cano 🇨🇴

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:58:51+00:00

2019-10-31 13:59:09+00:00

0:00:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11586366709517187
error_L2	0.02031082183013061

No reset possible

24626

3592

Victor Adolfo Romero Cano 🇨🇴

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:58:28+00:00

2019-10-31 13:58:43+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10494014993541546
error_L2	0.01757891842865123

No reset possible

24612

3837

Kenechukwu Nnodu 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:57:18+00:00

2019-10-31 13:57:41+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1088231252765711
error_L2	0.01903675738601076

No reset possible

24604

4031

Frank (Chude) Qian 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:56:24+00:00

2019-10-31 13:56:48+00:00

0:00:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10028301959576236
error_L2	0.01486610368729627

No reset possible

24598

4059

Zoltán L?rincz

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:55:51+00:00

2019-10-31 13:56:08+00:00

0:00:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10112774271903004
error_L2	0.017097458829955784

No reset possible

24586

4073

Linus Lingg 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:54:51+00:00

2019-10-31 13:55:26+00:00

0:00:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12293173574877556
error_L2	0.026052681145017333

No reset possible

24575

4091

Matthias Wieland 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:53:24+00:00

2019-10-31 13:54:31+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10902641186258294
error_L2	0.017560098828020714

No reset possible

24564

4098

Shengjie Hu 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:52:07+00:00

2019-10-31 13:52:54+00:00

0:00:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.13473650597347023
error_L2	0.02854181532211728

No reset possible

24543

4253

Nicky Humblet

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-43-40-10497

2019-10-31 13:50:36+00:00

2019-10-31 13:51:38+00:00

0:01:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.09965989529567776
error_L2	0.015034948784216549

No reset possible

24451

4239

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-43-40-10497

2019-10-24 23:57:09+00:00

2019-10-25 00:00:47+00:00

0:03:38

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24432

4233

Andrea Censi 🇨🇭

challenge-aido_LF-template-pytorch

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-43-40-10497

2019-10-24 17:13:56+00:00

2019-10-24 17:17:57+00:00

0:04:01

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 150, in _write
    self.fpin.write(j)
BrokenPipeError: [Errno 32] Broken pipe

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 77, in main
    agent_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 61, in _get_node_protocol
    self._write(j)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 162, in _write
    raise RemoteNodeAborted(msg) from e
zuper_nodes.structures.RemoteNodeAborted: While attempting to write to node "agent", I reckon that the pipe is closed and the node exited.

I could not read any aborted message: The remote node "agent" aborted with the following error:

error in agent |Unexpected error:
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 214, in loop
               ||     node_name=node_name, tout=tout)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 39, in __init__
               ||     self.pc = LanguageChecker(protocol.interaction)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes/language_recognize.py", line 123, in __init__
               ||     self.g.node[n]['label'] = 'start'
               || AttributeError: 'MultiDiGraph' object has no attribute 'node'
               ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24415

4223

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-43-40-10497

2019-10-24 06:36:30+00:00

2019-10-24 06:37:18+00:00

0:00:48

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24413

4219

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-testing

step1-simulation

failed

ip-172-31-43-40-10497

2019-10-24 06:27:32+00:00

2019-10-24 06:31:18+00:00

0:03:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24382

4191

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-43-40-10497

2019-10-23 19:51:24+00:00

2019-10-23 20:00:22+00:00

0:08:58

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24348

4162

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

host-error

ip-172-31-43-40-10497

2019-10-21 14:47:31+00:00

2019-10-21 14:49:47+00:00

0:02:16

Error while running [...]


stderr | Pulling evaluator      ... 
stderr | Pulling simulator      ... done
stderr | 
stderr | ERROR: for scenario_maker  error pulling image configuration: Get https://docker-images-prod.s3.amazonaws.com/registry-v2/docker/registry/v2/blobs/sha256/14/144b2b41f0f3aba8d57d616c2285b894d166df2311cc64da75759e0b4db0b5b2/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIA2KUBRXV6FO5M5DC7%2F20191021%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20191021T144733Z&X-Amz-Expires=1200&X-Amz-Security-Token=AgoJb3JpZ2luX2VjEN3%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJHMEUCIGZt9aD94sybO%2FHq881ekp1Fw%2FrGpnqMA3dPoP9OnYjJAiEAtdX%2BfDyHfSeGD%2BSbk9JwSyAtCouMaiJlTFsPwaSfUBwq4wMI1v%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAAGgw3MTAwMTUwNDA4OTIiDLzFjuHnjsYo7cZLaiq3A0Z%2BjKCFIh60x1X3nW8bHHNfWLwloGopz1ukjEIfEptkJRr1PtsGs8Fsz8qVFuD07zh%2BmSyXr8Cq2A2KHqau8v%2B1O%2Fh%2BF3lVWAHjG8DHpRvqrX%2B3EpLig0lih1M%2FLGVVpMcn2TlN2Sxf8JoXRqLwCxmp1GUuRpYS1hY70zaWkcAD0k%2FxZzwsD1xNaFNJjUZTA6T5g9xjMYhhs%2BYpNMAZrW82QQDd8u53nHD5UDlZWpOlGQihTA3no4zZG43dEoAulIxuIN2uGvoMKMidDudrVhPruN%2FqY4DC%2FrlM07W47F%2Bdpv7XVEmhS55t0pKmHGvHLkgoKcfanUzDsHWEZUlrMXGiIe7aYnCq%2BjBKpjuQaqg6veAh%2BAPr0b5uhGPHnnSlEZbDvFjZjBwVPNN78vZSMB0NEOnSlPFtczHK3GAENNgdlTsOiJeK6bzAzWavo8RI1gJ%2BAIXkZNibWtquOVMZ4NKtHzm0qDzRwK%2FdJZql%2FEVNTxgYJXK8oiSrrb4GhZ0Tiev6bQfRD%2Fn%2BCQZ%2F471sRzx60J0J7PIUEwWZkOGaOIt1sfO0pVEt%2FReanEhW9LkmWFMKF%2ByisTYwr8e27QU6tAGP8TbSskpYf6xTj4WD4LpB436UhYFULzK6RY8Mz3FUDUNN71B7xv4SrK5XvHDa%2BpwyJt7BceFkMZbgB7URv0oAI6tcXEPuk6Ck8qF3EscqPOVf2QbtXzun%2FUoGiB9hgjJMDUCcp1eIhtCgynRNInOA2fK4RfAu5I%2BxeyOvESAzzFCH%2Br%2ByAOfIbH1QOYyKOqood3lM7wj%2BOMERrzzIwbpSWgmtDvH0IC3GM6jrFwY3twzkSPE%3D&X-Amz-SignedHeaders=host&X-Amz-Signature=53268660f637f998d41581a96973a73bb716d862ba70a273e9021f551721c5c0: net/http: TLS handshake timeout
stderr | 
stderr | ERROR: for solution  error pulling image configuration: Get https://docker-images-prod.s3.amazonaws.com/registry-v2/docker/registry/v2/blobs/sha256/ea/eae121449c927e05f391120a9747f0942ae4ac69d91ebc973a8348eb73cfad34/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIA2KUBRXV6AWMDO2VW%2F20191021%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20191021T144733Z&X-Amz-Expires=1200&X-Amz-Security-Token=AgoJb3JpZ2luX2VjENv%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJGMEQCIG%2BGB6GwZqsPeBfDEMDDn4lMxQuLP4%2FaSI4gqC8Vu%2BsoAiB1N%2BkH9q4F30kVasvFdD4m6r1U0wXJnsYUmKJl2G9IACrjAwjU%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F8BEAAaDDcxMDAxNTA0MDg5MiIM5F789wPOu1Z9V6WGKrcDNqZyOEcivKXxck%2FADeeLmBylDndWDTNhldxGwRm%2FtMpEV4dLTqOd%2BwFWwhuTdayHKERnKC51jZyYqs5TqGFH1koxqp%2FDzUVD1xWUVC%2FzvjWPuShv%2BDeeEB5jnLjN00Sorr1600vKsVr7AqyjL0WPQGtq%2BzgOEMrvYWEaOBg1pKudFVcAQpCNkPgmbMWmUU7XJX4Nrf1uBAOxSi8EL1CYMAZl%2BKNF7znw6Yp%2FjyymZEmlgBsdNshls4cQQYyYq5vvs69oEo8s2yC0c7IfbWMt3NZRn8MZ2%2FlTecq6OYhRHgrteVH%2BBqmxHKiVoUwJ18sn2rU9%2Bn9%2BPu3Xwv4ieDIRH8MbHmT33U2piT0dA71N4lEEfR0mMgdvf328F2F1EzNAjqM%2FACWirzrlk6AMAyf0wHeftyduV40yWqwNoFcbKk2R7njXw9Iqq%2B3gfd3avjxOf1ku%2F6qMgxrCYbIxzJM2Zm8Uehaj10QBABMLVIux%2BeCDWXzBAblDREZFMMmtkmGKD6QUgTAbGguXezaV8JwCTDQPwjeY3RK0HLVl4JY09K3%2Flg7HONy8WLwf34V1mns47nqcgcjWiTCVkbbtBTq1AZr9WZDoAMa4beH6DkSa5kSq8uTIBPYieivt0jpNvxjeQeT9aM%2Bd3kXf6GRhiOHuYjRy9wxLye87RTegTCfK99q3q%2F4UtNP0nhxO0bIQjq5GdDH04vVhHwButqwd4tAgsrF4L1Fscs8dtODDfLJB4V%2F44r43Or1bKFWTrk0%2B4P54KwCNaNhtB2sdK0gqlUKTg%2FO10ukLEb5Oi1klIiUy624zKcq46%2FbnqHlLRiOmbbk6UZyBii0%3D&X-Amz-SignedHeaders=host&X-Amz-Signature=f9162a42b736469ffc598921ef421b694fd57dba46fb029dcde72a4df1385373: net/http: TLS handshake timeout
stderr | error pulling image configuration: Get https://docker-images-prod.s3.amazonaws.com/registry-v2/docker/registry/v2/blobs/sha256/ea/eae121449c927e05f391120a9747f0942ae4ac69d91ebc973a8348eb73cfad34/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIA2KUBRXV6AWMDO2VW%2F20191021%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20191021T144733Z&X-Amz-Expires=1200&X-Amz-Security-Token=AgoJb3JpZ2luX2VjENv%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJGMEQCIG%2BGB6GwZqsPeBfDEMDDn4lMxQuLP4%2FaSI4gqC8Vu%2BsoAiB1N%2BkH9q4F30kVasvFdD4m6r1U0wXJnsYUmKJl2G9IACrjAwjU%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F8BEAAaDDcxMDAxNTA0MDg5MiIM5F789wPOu1Z9V6WGKrcDNqZyOEcivKXxck%2FADeeLmBylDndWDTNhldxGwRm%2FtMpEV4dLTqOd%2BwFWwhuTdayHKERnKC51jZyYqs5TqGFH1koxqp%2FDzUVD1xWUVC%2FzvjWPuShv%2BDeeEB5jnLjN00Sorr1600vKsVr7AqyjL0WPQGtq%2BzgOEMrvYWEaOBg1pKudFVcAQpCNkPgmbMWmUU7XJX4Nrf1uBAOxSi8EL1CYMAZl%2BKNF7znw6Yp%2FjyymZEmlgBsdNshls4cQQYyYq5vvs69oEo8s2yC0c7IfbWMt3NZRn8MZ2%2FlTecq6OYhRHgrteVH%2BBqmxHKiVoUwJ18sn2rU9%2Bn9%2BPu3Xwv4ieDIRH8MbHmT33U2piT0dA71N4lEEfR0mMgdvf328F2F1EzNAjqM%2FACWirzrlk6AMAyf0wHeftyduV40yWqwNoFcbKk2R7njXw9Iqq%2B3gfd3avjxOf1ku%2F6qMgxrCYbIxzJM2Zm8Uehaj10QBABMLVIux%2BeCDWXzBAblDREZFMMmtkmGKD6QUgTAbGguXezaV8JwCTDQPwjeY3RK0HLVl4JY09K3%2Flg7HONy8WLwf34V1mns47nqcgcjWiTCVkbbtBTq1AZr9WZDoAMa4beH6DkSa5kSq8uTIBPYieivt0jpNvxjeQeT9aM%2Bd3kXf6GRhiOHuYjRy9wxLye87RTegTCfK99q3q%2F4UtNP0nhxO0bIQjq5GdDH04vVhHwButqwd4tAgsrF4L1Fscs8dtODDfLJB4V%2F44r43Or1bKFWTrk0%2B4P54KwCNaNhtB2sdK0gqlUKTg%2FO10ukLEb5Oi1klIiUy624zKcq46%2FbnqHlLRiOmbbk6UZyBii0%3D&X-Amz-SignedHeaders=host&X-Amz-Signature=f9162a42b736469ffc598921ef421b694fd57dba46fb029dcde72a4df1385373: net/http: TLS handshake timeout
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible