Evaluator 1585

ID	1585
evaluator	`ip-172-31-45-34-10500`
owner	I don't have one 😀
machine	ip-172-31-45-34
process	ip-172-31-45-34-10500
version	d-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard	2019-10-17 02:44:09+00:00
last heard	2019-11-08 10:53:56+00:00
status	inactive
# evaluating
# success	26 `24438`
# timeout
# failed	8 `24359`
# error	18 `24349`
# aborted
# host-error	5 `24387`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

25122

4391

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-11-07 14:23:54+00:00

2019-11-07 14:29:09+00:00

0:05:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.3999999999999995
deviation-center-line_median	0.11667593935453972
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.02209842708748831
agent_compute-ego_mean	0.019076877101935338
agent_compute-ego_median	0.01858176968314431
agent_compute-ego_min	0.01594323416550954
deviation-center-line_max	0.16987818035809085
deviation-center-line_mean	0.13199870851217008
deviation-center-line_min	0.1011892720306074
deviation-heading_max	0.5809378480871985
deviation-heading_mean	0.4194004386292104
deviation-heading_median	0.34882560565471876
deviation-heading_min	0.2596285487829773
driven_any_max	0.9226822529128632
driven_any_mean	0.6324710235085376
driven_any_median	0.6091462024047467
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.6632135184572033
driven_lanedir_consec_mean	0.4245071231796043
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.6632135184572033
driven_lanedir_mean	0.4245071231796043
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.6299999999999986
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.09198508128313952, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.011344748483577244, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.02209842708748831, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.008407485317176496, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.00433649479503363, "sim_compute_performance-ego": 0.00600702661863515, "sim_compute_robot_state-ego": 0.00793910026550293}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.0950522780418396, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.010697368780771892, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.020502849419911703, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.008469855785369873, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.00445183515548706, "sim_compute_performance-ego": 0.006104493141174316, "sim_compute_robot_state-ego": 0.007614274819691976}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.07307579300620339, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.008793180639093573, "in-drivable-lane": 0, "agent_compute-ego": 0.01858176968314431, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.006220297379927201, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.0035130219026045365, "sim_compute_performance-ego": 0.005182244560935281, "sim_compute_robot_state-ego": 0.006121104413812811}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.07160901526610057, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.007675930857658386, "in-drivable-lane": 0, "agent_compute-ego": 0.01594323416550954, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.005755657951037089, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.0032783796389897666, "sim_compute_performance-ego": 0.004310717185338338, "sim_compute_robot_state-ego": 0.005539556344350179}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.0744980055352916, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.009713737860969875, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.018258105153622833, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.006817584452421769, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0039330254430356235, "sim_compute_performance-ego": 0.005727031956548276, "sim_compute_robot_state-ego": 0.006839886955592943}}
set_robot_commands_max	0.008469855785369873
set_robot_commands_mean	0.007134176177186487
set_robot_commands_median	0.006817584452421769
set_robot_commands_min	0.005755657951037089
sim_compute_performance-ego_max	0.006104493141174316
sim_compute_performance-ego_mean	0.005466302692526272
sim_compute_performance-ego_median	0.005727031956548276
sim_compute_performance-ego_min	0.004310717185338338
sim_compute_robot_state-ego_max	0.00793910026550293
sim_compute_robot_state-ego_mean	0.006810784559790168
sim_compute_robot_state-ego_median	0.006839886955592943
sim_compute_robot_state-ego_min	0.005539556344350179
sim_compute_sim_state_max	0.00445183515548706
sim_compute_sim_state_mean	0.003902551387030123
sim_compute_sim_state_median	0.0039330254430356235
sim_compute_sim_state_min	0.0032783796389897666
sim_physics_max	0.0950522780418396
sim_physics_mean	0.08124403462651493
sim_physics_median	0.0744980055352916
sim_physics_min	0.07160901526610057
sim_render-ego_max	0.011344748483577244
sim_render-ego_mean	0.009644993324414194
sim_render-ego_median	0.009713737860969875
sim_render-ego_min	0.007675930857658386
simulation-passed	1
survival_time_max	3.5499999999999954
survival_time_mean	2.469999999999999
survival_time_min	1.1000000000000003

No reset possible

25103

4383

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFV-sim-validation

step1-simulation

failed

ip-172-31-45-34-10500

2019-11-06 18:40:39+00:00

2019-11-06 18:46:15+00:00

0:05:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 76 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25069

4367

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-11-05 15:16:04+00:00

2019-11-05 15:24:41+00:00

0:08:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5907001796604163
survival_time_median	3.5499999999999954
deviation-center-line_median	0.2311995649288452
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.03594863982427688
agent_compute-ego_mean	0.027851794226399613
agent_compute-ego_median	0.02610907084505323
agent_compute-ego_min	0.0233504056930542
deviation-center-line_max	0.4195375132450672
deviation-center-line_mean	0.21380489711234343
deviation-center-line_min	0.07064777691940713
deviation-heading_max	2.6298915540147885
deviation-heading_mean	1.3246958734853456
deviation-heading_median	1.1755203190064254
deviation-heading_min	0.5588376302700682
driven_any_max	2.0682947195446757
driven_any_mean	0.9533814118134116
driven_any_median	0.7828926629343664
driven_any_min	0.2426350049252093
driven_lanedir_consec_max	0.908144879336332
driven_lanedir_consec_mean	0.5241218159520844
driven_lanedir_consec_min	0.16521979915462426
driven_lanedir_max	0.908144879336332
driven_lanedir_mean	0.5241218159520844
driven_lanedir_median	0.5907001796604163
driven_lanedir_min	0.16521979915462426
in-drivable-lane_max	4.549999999999988
in-drivable-lane_mean	1.4599999999999955
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2426350049252093, "sim_physics": 0.14329332397097633, "survival_time": 1.0500000000000005, "driven_lanedir": 0.16521979915462426, "sim_render-ego": 0.014839058830624537, "in-drivable-lane": 0, "agent_compute-ego": 0.03594863982427688, "deviation-heading": 0.5588376302700682, "set_robot_commands": 0.011047340574718656, "deviation-center-line": 0.07064777691940713, "driven_lanedir_consec": 0.16521979915462426, "sim_compute_sim_state": 0.005170243127005441, "sim_compute_performance-ego": 0.008294116883050828, "sim_compute_robot_state-ego": 0.01026054791041783}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0682947195446757, "sim_physics": 0.10052907466888428, "survival_time": 8.899999999999991, "driven_lanedir": 0.908144879336332, "sim_render-ego": 0.011901665269658806, "in-drivable-lane": 4.549999999999988, "agent_compute-ego": 0.025924209798319955, "deviation-heading": 2.6298915540147885, "set_robot_commands": 0.00888253329844957, "deviation-center-line": 0.4195375132450672, "driven_lanedir_consec": 0.908144879336332, "sim_compute_sim_state": 0.00489546207899458, "sim_compute_performance-ego": 0.007016767276806778, "sim_compute_robot_state-ego": 0.008834189243530959}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3122765833293697, "sim_physics": 0.12242661368462349, "survival_time": 6.199999999999986, "driven_lanedir": 0.5907001796604163, "sim_render-ego": 0.012071107664415914, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.02792664497129379, "deviation-heading": 1.6940216894485487, "set_robot_commands": 0.009944300497731855, "deviation-center-line": 0.25724492149413924, "driven_lanedir_consec": 0.5907001796604163, "sim_compute_sim_state": 0.004952209611092845, "sim_compute_performance-ego": 0.007172192296674175, "sim_compute_robot_state-ego": 0.00926439800570088}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3608080883334374, "sim_physics": 0.09692703088124592, "survival_time": 1.5000000000000009, "driven_lanedir": 0.320934087489539, "sim_render-ego": 0.011145702997843425, "in-drivable-lane": 0, "agent_compute-ego": 0.0233504056930542, "deviation-heading": 0.565208174686897, "set_robot_commands": 0.00884840488433838, "deviation-center-line": 0.0903947089742584, "driven_lanedir_consec": 0.320934087489539, "sim_compute_sim_state": 0.004285542170206705, "sim_compute_performance-ego": 0.006286319096883138, "sim_compute_robot_state-ego": 0.007865532239278158}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7828926629343664, "sim_physics": 0.0998046532483168, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6356101341195108, "sim_render-ego": 0.011811387371009504, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02610907084505323, "deviation-heading": 1.1755203190064254, "set_robot_commands": 0.008795365481309488, "deviation-center-line": 0.2311995649288452, "driven_lanedir_consec": 0.6356101341195108, "sim_compute_sim_state": 0.004495657665628782, "sim_compute_performance-ego": 0.0067253045632805625, "sim_compute_robot_state-ego": 0.00819269704147124}}
set_robot_commands_max	0.011047340574718656
set_robot_commands_mean	0.00950358894730959
set_robot_commands_median	0.00888253329844957
set_robot_commands_min	0.008795365481309488
sim_compute_performance-ego_max	0.008294116883050828
sim_compute_performance-ego_mean	0.007098940023339097
sim_compute_performance-ego_median	0.007016767276806778
sim_compute_performance-ego_min	0.006286319096883138
sim_compute_robot_state-ego_max	0.01026054791041783
sim_compute_robot_state-ego_mean	0.008883472888079813
sim_compute_robot_state-ego_median	0.008834189243530959
sim_compute_robot_state-ego_min	0.007865532239278158
sim_compute_sim_state_max	0.005170243127005441
sim_compute_sim_state_mean	0.0047598229305856705
sim_compute_sim_state_median	0.00489546207899458
sim_compute_sim_state_min	0.004285542170206705
sim_physics_max	0.14329332397097633
sim_physics_mean	0.11259613929080936
sim_physics_median	0.10052907466888428
sim_physics_min	0.09692703088124592
sim_render-ego_max	0.014839058830624537
sim_render-ego_mean	0.012353784426710436
sim_render-ego_median	0.011901665269658806
sim_render-ego_min	0.011145702997843425
simulation-passed	1
survival_time_max	8.899999999999991
survival_time_mean	4.239999999999995
survival_time_min	1.0500000000000005

No reset possible

25018

4361

Soroush Saryazdi 🇨🇦

bluejay

aido3-LFV-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 15:17:11+00:00

2019-11-04 15:20:43+00:00

0:03:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25006

4349

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 14:17:54+00:00

2019-11-04 14:29:02+00:00

0:11:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.25164532788877514
survival_time_median	1.1000000000000003
deviation-center-line_median	0.07591534084554702
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.031838937239213425
agent_compute-ego_mean	0.020525576292802543
agent_compute-ego_median	0.016453411844041612
agent_compute-ego_min	0.015324878692626952
deviation-center-line_max	0.3563808898690555
deviation-center-line_mean	0.11467827423535
deviation-center-line_min	0.039561393993242246
deviation-heading_max	1.646038389736098
deviation-heading_mean	0.6139238529014542
deviation-heading_median	0.46931987904770806
deviation-heading_min	0.29638821181406566
driven_any_max	1.5131820667983638
driven_any_mean	0.4425181764820377
driven_any_median	0.3119613644277001
driven_any_min	0.12493811275335764
driven_lanedir_consec_max	0.9859740475237552
driven_lanedir_consec_mean	0.30573549014624757
driven_lanedir_consec_min	0.08115893201378421
driven_lanedir_max	1.0058444698661044
driven_lanedir_mean	0.30706018496907084
driven_lanedir_median	0.25164532788877514
driven_lanedir_min	0.08115893201378421
in-drivable-lane_max	1.7499999999999964
in-drivable-lane_mean	0.3199999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3130897344484569, "sim_physics": 0.11664314703507855, "survival_time": 1.1000000000000003, "driven_lanedir": 0.25164532788877514, "sim_render-ego": 0.013262477788058197, "in-drivable-lane": 0, "agent_compute-ego": 0.031838937239213425, "deviation-heading": 0.46931987904770806, "set_robot_commands": 0.010264992713928224, "deviation-center-line": 0.07591534084554702, "driven_lanedir_consec": 0.25164532788877514, "sim_compute_sim_state": 0.005070090293884277, "sim_compute_performance-ego": 0.007258859547701749, "sim_compute_robot_state-ego": 0.009501413865522904}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7884897905856996, "sim_physics": 0.0854699579003739, "survival_time": 3.649999999999995, "driven_lanedir": 0.36112346689440966, "sim_render-ego": 0.010936727262523076, "in-drivable-lane": 1.649999999999996, "agent_compute-ego": 0.024088464371145587, "deviation-heading": 0.863277108212295, "set_robot_commands": 0.008081720299916724, "deviation-center-line": 0.2174109405276076, "driven_lanedir_consec": 0.36112346689440966, "sim_compute_sim_state": 0.004426368295329891, "sim_compute_performance-ego": 0.006505035374262561, "sim_compute_robot_state-ego": 0.008061118321876004}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.904738248554274, "sim_physics": 0.1174724688896766, "survival_time": 3.2499999999999964, "driven_lanedir": 0.44377388153707287, "sim_render-ego": 0.012922195287851186, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.027109219477726865, "deviation-heading": 1.016740221901125, "set_robot_commands": 0.008983531365027794, "deviation-center-line": 0.18809969883507827, "driven_lanedir_consec": 0.44377388153707287, "sim_compute_sim_state": 0.006128751314603365, "sim_compute_performance-ego": 0.007385143866905799, "sim_compute_robot_state-ego": 0.00910036380474384}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3119613644277001, "sim_physics": 0.13160908222198486, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25375393369086074, "sim_render-ego": 0.011802480770991398, "in-drivable-lane": 0, "agent_compute-ego": 0.027106899481553298, "deviation-heading": 0.5843150560721362, "set_robot_commands": 0.008932764713580791, "deviation-center-line": 0.06815705343362316, "driven_lanedir_consec": 0.25375393369086074, "sim_compute_sim_state": 0.0046685567268958455, "sim_compute_performance-ego": 0.006866656816922701, "sim_compute_robot_state-ego": 0.008827457061180701}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5135607762772361, "sim_physics": 0.0981863124950512, "survival_time": 1.850000000000001, "driven_lanedir": 0.4824988403073771, "sim_render-ego": 0.01140153085863268, "in-drivable-lane": 0, "agent_compute-ego": 0.025058739894145244, "deviation-heading": 0.3906103304272903, "set_robot_commands": 0.008520976917163746, "deviation-center-line": 0.09052378874552676, "driven_lanedir_consec": 0.4824988403073771, "sim_compute_sim_state": 0.004391116064948005, "sim_compute_performance-ego": 0.006929223601882522, "sim_compute_robot_state-ego": 0.008316143138988598}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.6990223207182851, "sim_physics": 0.10710192593661222, "survival_time": 2.7499999999999982, "driven_lanedir": 0.6097037189190333, "sim_render-ego": 0.012131539258089932, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.027188595858487215, "deviation-heading": 0.8908836260179576, "set_robot_commands": 0.009835052490234374, "deviation-center-line": 0.20447943267408417, "driven_lanedir_consec": 0.6097037189190333, "sim_compute_sim_state": 0.005059112202037464, "sim_compute_performance-ego": 0.006799494136463512, "sim_compute_robot_state-ego": 0.008623292229392312}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.5131820667983638, "sim_physics": 0.0657349916604849, "survival_time": 5.849999999999987, "driven_lanedir": 1.0058444698661044, "sim_render-ego": 0.00889538699745113, "in-drivable-lane": 1.7499999999999964, "agent_compute-ego": 0.019111335786998786, "deviation-heading": 1.646038389736098, "set_robot_commands": 0.0064805674756694045, "deviation-center-line": 0.3563808898690555, "driven_lanedir_consec": 0.9859740475237552, "sim_compute_sim_state": 0.0034347925430689105, "sim_compute_performance-ego": 0.0051154275225777915, "sim_compute_robot_state-ego": 0.006256026080530933}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12493811275335764, "sim_physics": 0.06114230155944824, "survival_time": 0.7500000000000001, "driven_lanedir": 0.08327580964995152, "sim_render-ego": 0.007292493184407552, "in-drivable-lane": 0, "agent_compute-ego": 0.015324878692626952, "deviation-heading": 0.4228244459737176, "set_robot_commands": 0.005163335800170898, "deviation-center-line": 0.06475781842788146, "driven_lanedir_consec": 0.08327580964995152, "sim_compute_sim_state": 0.0028416315714518228, "sim_compute_performance-ego": 0.004008626937866211, "sim_compute_robot_state-ego": 0.005094099044799805}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14505672368788997, "sim_physics": 0.05765256881713867, "survival_time": 1.0000000000000002, "driven_lanedir": 0.08115893201378421, "sim_render-ego": 0.0071171045303344725, "in-drivable-lane": 0, "agent_compute-ego": 0.015400183200836182, "deviation-heading": 0.6187956457066438, "set_robot_commands": 0.004888343811035156, "deviation-center-line": 0.039561393993242246, "driven_lanedir_consec": 0.08115893201378421, "sim_compute_sim_state": 0.0027908921241760255, "sim_compute_performance-ego": 0.00391690731048584, "sim_compute_robot_state-ego": 0.004923486709594726}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.19792321063674875, "sim_physics": 0.061391472816467285, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1658586338235497, "sim_render-ego": 0.007152187824249268, "in-drivable-lane": 0, "agent_compute-ego": 0.016248130798339845, "deviation-heading": 0.3817375251500799, "set_robot_commands": 0.004883015155792236, "deviation-center-line": 0.0757826867765671, "driven_lanedir_consec": 0.1658586338235497, "sim_compute_sim_state": 0.0028068065643310548, "sim_compute_performance-ego": 0.003987061977386475, "sim_compute_robot_state-ego": 0.005035316944122315}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.22930680837260045, "sim_physics": 0.0607759952545166, "survival_time": 1.0500000000000005, "driven_lanedir": 0.18774517861058185, "sim_render-ego": 0.007218213308425177, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01595569792247954, "deviation-heading": 0.29638821181406566, "set_robot_commands": 0.004898718425205776, "deviation-center-line": 0.08654731355624119, "driven_lanedir_consec": 0.18774517861058185, "sim_compute_sim_state": 0.0027949923560732885, "sim_compute_performance-ego": 0.003999290012177967, "sim_compute_robot_state-ego": 0.0049833570207868305}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.20931576468586716, "sim_physics": 0.060816539658440485, "survival_time": 0.9000000000000002, "driven_lanedir": 0.15371221034387297, "sim_render-ego": 0.007252825631035699, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.016453411844041612, "deviation-heading": 0.35038612800724467, "set_robot_commands": 0.005147112740410699, "deviation-center-line": 0.05238754151824169, "driven_lanedir_consec": 0.15371221034387297, "sim_compute_sim_state": 0.002854294247097439, "sim_compute_performance-ego": 0.004000835948520237, "sim_compute_robot_state-ego": 0.004996856053670247}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.33767289156828517, "sim_physics": 0.057754802703857425, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2651906943568808, "sim_render-ego": 0.006990423202514648, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.015482397079467773, "deviation-heading": 0.4545818341946498, "set_robot_commands": 0.004811058044433594, "deviation-center-line": 0.06084212043530041, "driven_lanedir_consec": 0.2651906943568808, "sim_compute_sim_state": 0.0027787208557128905, "sim_compute_performance-ego": 0.003916158676147461, "sim_compute_robot_state-ego": 0.004914312362670898}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.17685862026997587, "sim_physics": 0.06136145089801989, "survival_time": 0.9500000000000004, "driven_lanedir": 0.12820763061395857, "sim_render-ego": 0.007185747748927066, "in-drivable-lane": 0, "agent_compute-ego": 0.01558551035429302, "deviation-heading": 0.5244467930606573, "set_robot_commands": 0.005020003569753547, "deviation-center-line": 0.04741998430676203, "driven_lanedir_consec": 0.12820763061395857, "sim_compute_sim_state": 0.002921405591462788, "sim_compute_performance-ego": 0.0039699203089663855, "sim_compute_robot_state-ego": 0.005100752177991365}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1726562134458252, "sim_physics": 0.05762856885006553, "survival_time": 0.9500000000000004, "driven_lanedir": 0.13241004601984985, "sim_render-ego": 0.007040663769370631, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01593124239068282, "deviation-heading": 0.29851259820014536, "set_robot_commands": 0.004839821865684108, "deviation-center-line": 0.09190810958549114, "driven_lanedir_consec": 0.13241004601984985, "sim_compute_sim_state": 0.0028384233775891757, "sim_compute_performance-ego": 0.003934885326184724, "sim_compute_robot_state-ego": 0.005040909114636873}}
set_robot_commands_max	0.010264992713928224
set_robot_commands_mean	0.006716734359200469
set_robot_commands_median	0.005163335800170898
set_robot_commands_min	0.004811058044433594
sim_compute_performance-ego_max	0.007385143866905799
sim_compute_performance-ego_mean	0.005239568490963463
sim_compute_performance-ego_median	0.004008626937866211
sim_compute_performance-ego_min	0.003916158676147461
sim_compute_robot_state-ego_max	0.009501413865522904
sim_compute_robot_state-ego_mean	0.0065849935953672225
sim_compute_robot_state-ego_median	0.005100752177991365
sim_compute_robot_state-ego_min	0.004914312362670898
sim_compute_sim_state_max	0.006128751314603365
sim_compute_sim_state_mean	0.0037203969419108167
sim_compute_sim_state_median	0.002921405591462788
sim_compute_sim_state_min	0.0027787208557128905
sim_physics_max	0.13160908222198486
sim_physics_mean	0.08004943911314776
sim_physics_median	0.061391472816467285
sim_physics_min	0.05762856885006553
sim_render-ego_max	0.013262477788058197
sim_render-ego_mean	0.00924013316152414
sim_render-ego_median	0.007292493184407552
sim_render-ego_min	0.006990423202514648
simulation-passed	1
survival_time_max	5.849999999999987
survival_time_mean	1.8399999999999983
survival_time_min	0.7500000000000001

No reset possible

24996

4137

Andrea Censi 🇨🇭

rotation

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 09:14:05+00:00

2019-11-04 10:00:53+00:00

0:46:48

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24983

4153

Andrea Censi 🇨🇭

minimal_agent_python2 (Python 2)

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 09:00:40+00:00

2019-11-04 09:13:56+00:00

0:13:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6560989890090594
survival_time_median	3.649999999999995
deviation-center-line_median	0.14678748740599404
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.011740968034074113
agent_compute-ego_mean	0.009814913049246842
agent_compute-ego_median	0.009515703540958771
agent_compute-ego_min	0.007586454090319182
deviation-center-line_max	0.4005818627784723
deviation-center-line_mean	0.19535396696552737
deviation-center-line_min	0.12422801598242109
deviation-heading_max	1.0645521116851462
deviation-heading_mean	0.5821209778469638
deviation-heading_median	0.5423458590238992
deviation-heading_min	0.29987290367335917
driven_any_max	2.1648273185719797
driven_any_mean	0.9348502469008624
driven_any_median	0.9948273195001768
driven_any_min	0.2750262368649079
driven_lanedir_consec_max	2.0050790504729665
driven_lanedir_consec_mean	0.738495147174259
driven_lanedir_consec_min	0.2671322113623069
driven_lanedir_max	2.0050790504729665
driven_lanedir_mean	0.738495147174259
driven_lanedir_median	0.6560989890090594
driven_lanedir_min	0.2671322113623069
in-drivable-lane_max	1.5499999999999945
in-drivable-lane_mean	0.5433333333333313
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.10527458909439714, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.0126935651857559, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.009515703540958771, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.00890557733300614, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.00514145746623, "sim_compute_performance-ego": 0.008362913784915453, "sim_compute_robot_state-ego": 0.00909597253146237}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.009827319290899, "sim_physics": 0.1268533113840464, "survival_time": 3.699999999999995, "driven_lanedir": 0.8760331754635476, "sim_render-ego": 0.012150654921660552, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.010602226128449311, "deviation-heading": 1.047774623333474, "set_robot_commands": 0.010624798568519386, "deviation-center-line": 0.29642020115014733, "driven_lanedir_consec": 0.8760331754635476, "sim_compute_sim_state": 0.005090024020220782, "sim_compute_performance-ego": 0.007044363666225124, "sim_compute_robot_state-ego": 0.009722129718677416}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2750262368649079, "sim_physics": 0.1186551570892334, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2671322113623069, "sim_render-ego": 0.012688627243041992, "in-drivable-lane": 0, "agent_compute-ego": 0.01095500946044922, "deviation-heading": 0.3001803644882976, "set_robot_commands": 0.01009389877319336, "deviation-center-line": 0.12422801598242109, "driven_lanedir_consec": 0.2671322113623069, "sim_compute_sim_state": 0.005925350189208985, "sim_compute_performance-ego": 0.007322225570678711, "sim_compute_robot_state-ego": 0.0095737361907959}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4548365617710419, "sim_physics": 0.12645229133399755, "survival_time": 1.850000000000001, "driven_lanedir": 0.4333629680464388, "sim_render-ego": 0.011848597913175015, "in-drivable-lane": 0, "agent_compute-ego": 0.011740968034074113, "deviation-heading": 0.5707543029776994, "set_robot_commands": 0.010944778854782516, "deviation-center-line": 0.12501321046442526, "driven_lanedir_consec": 0.4333629680464388, "sim_compute_sim_state": 0.005274914406441353, "sim_compute_performance-ego": 0.007104557913702888, "sim_compute_robot_state-ego": 0.008786452783120645}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.11001508363655636, "survival_time": 5.599999999999988, "driven_lanedir": 1.1257539445961453, "sim_render-ego": 0.01249546664101737, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.010254091450146266, "deviation-heading": 0.31699480744097813, "set_robot_commands": 0.00955124625137874, "deviation-center-line": 0.4005818627784723, "driven_lanedir_consec": 1.1257539445961453, "sim_compute_sim_state": 0.005155356866972787, "sim_compute_performance-ego": 0.007401645183563232, "sim_compute_robot_state-ego": 0.009393164089747838}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.454836561771035, "sim_physics": 0.12422496563679464, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.013000056550309464, "in-drivable-lane": 0, "agent_compute-ego": 0.009366344761204076, "deviation-heading": 0.6191860504142409, "set_robot_commands": 0.00984128745826515, "deviation-center-line": 0.13177329190693754, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.005401250478383657, "sim_compute_performance-ego": 0.007391130602037585, "sim_compute_robot_state-ego": 0.010216145902066615}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0248273191286392, "sim_physics": 0.08934260368347167, "survival_time": 3.7499999999999942, "driven_lanedir": 0.5418367454355217, "sim_render-ego": 0.011382067998250324, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.008949317932128907, "deviation-heading": 0.5423458590238992, "set_robot_commands": 0.00851960817972819, "deviation-center-line": 0.14678748740599404, "driven_lanedir_consec": 0.5418367454355217, "sim_compute_sim_state": 0.004687741597493489, "sim_compute_performance-ego": 0.006783275604248047, "sim_compute_robot_state-ego": 0.008048302332560221}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3049465552081734, "sim_physics": 0.1304503017001682, "survival_time": 1.3500000000000003, "driven_lanedir": 0.29745564201515107, "sim_render-ego": 0.013824648327297635, "in-drivable-lane": 0, "agent_compute-ego": 0.010915235236839013, "deviation-heading": 0.29987290367335917, "set_robot_commands": 0.010224669067947952, "deviation-center-line": 0.1306820468362013, "driven_lanedir_consec": 0.29745564201515107, "sim_compute_sim_state": 0.005711034492210105, "sim_compute_performance-ego": 0.008588534814340097, "sim_compute_robot_state-ego": 0.010645424878155745}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7098274382089755, "sim_physics": 0.09823008819862648, "survival_time": 2.6999999999999984, "driven_lanedir": 0.7032085791835883, "sim_render-ego": 0.011723054779900445, "in-drivable-lane": 0, "agent_compute-ego": 0.009900653803790058, "deviation-heading": 0.36899467884091897, "set_robot_commands": 0.008972273932562934, "deviation-center-line": 0.18371297048277177, "driven_lanedir_consec": 0.7032085791835883, "sim_compute_sim_state": 0.0050370825661553275, "sim_compute_performance-ego": 0.007456889858952275, "sim_compute_robot_state-ego": 0.008463581403096518}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9948273195001768, "sim_physics": 0.09476974239088085, "survival_time": 3.649999999999995, "driven_lanedir": 0.6560989890090594, "sim_render-ego": 0.010753856946344243, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.008499847699518073, "deviation-heading": 0.6658599650846626, "set_robot_commands": 0.008282563457750294, "deviation-center-line": 0.1561741058626541, "driven_lanedir_consec": 0.6560989890090594, "sim_compute_sim_state": 0.0049715205414654455, "sim_compute_performance-ego": 0.006408720800321396, "sim_compute_robot_state-ego": 0.0076679889469930575}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5798273185720009, "sim_physics": 0.1206147904906954, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014600726933682, "sim_render-ego": 0.012992735419954571, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.010688705103737968, "deviation-heading": 0.5156620482368139, "set_robot_commands": 0.0098146881375994, "deviation-center-line": 0.20858216306835017, "driven_lanedir_consec": 1.2014600726933682, "sim_compute_sim_state": 0.005338468721934727, "sim_compute_performance-ego": 0.007468979273523603, "sim_compute_robot_state-ego": 0.009405453290258136}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0098273192909009, "sim_physics": 0.09989340240890916, "survival_time": 3.699999999999995, "driven_lanedir": 0.6405535448452878, "sim_render-ego": 0.01167906297219766, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.009444120767954232, "deviation-heading": 1.0645521116851462, "set_robot_commands": 0.00893516798277159, "deviation-center-line": 0.2228681204106694, "driven_lanedir_consec": 0.6405535448452878, "sim_compute_sim_state": 0.004710816048287056, "sim_compute_performance-ego": 0.007341929384180017, "sim_compute_robot_state-ego": 0.008479231112712139}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9948273195001752, "sim_physics": 0.10048276104339182, "survival_time": 3.649999999999995, "driven_lanedir": 0.7695653387571403, "sim_render-ego": 0.01267895959827998, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.00942073456228596, "deviation-heading": 0.4813700122068389, "set_robot_commands": 0.008477243658614485, "deviation-center-line": 0.1442443284046606, "driven_lanedir_consec": 0.7695653387571403, "sim_compute_sim_state": 0.004846213615103944, "sim_compute_performance-ego": 0.007206459567971425, "sim_compute_robot_state-ego": 0.009170630206800487}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4698344777618675, "sim_physics": 0.07396238728573448, "survival_time": 1.900000000000001, "driven_lanedir": 0.4595449996397094, "sim_render-ego": 0.00934747018312153, "in-drivable-lane": 0, "agent_compute-ego": 0.007586454090319182, "deviation-heading": 0.398367781186276, "set_robot_commands": 0.006939392340810676, "deviation-center-line": 0.1252701007981349, "driven_lanedir_consec": 0.4595449996397094, "sim_compute_sim_state": 0.0037888100272730776, "sim_compute_performance-ego": 0.005426425682870965, "sim_compute_robot_state-ego": 0.0068234393471165704}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1648273185719797, "sim_physics": 0.0911627621050702, "survival_time": 7.549999999999981, "driven_lanedir": 2.0050790504729665, "sim_render-ego": 0.011576330424934032, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.009384283166847482, "deviation-heading": 0.9808458191188588, "set_robot_commands": 0.008689725635856982, "deviation-center-line": 0.3896160126120228, "driven_lanedir_consec": 2.0050790504729665, "sim_compute_sim_state": 0.004638501350453358, "sim_compute_performance-ego": 0.0068553204568016606, "sim_compute_robot_state-ego": 0.008167689999207755}}
set_robot_commands_max	0.010944778854782516
set_robot_commands_mean	0.00925446130885252
set_robot_commands_median	0.008972273932562934
set_robot_commands_min	0.006939392340810676
sim_compute_performance-ego_max	0.008588534814340097
sim_compute_performance-ego_mean	0.007210891477622165
sim_compute_performance-ego_median	0.007322225570678711
sim_compute_performance-ego_min	0.005426425682870965
sim_compute_robot_state-ego_max	0.010645424878155745
sim_compute_robot_state-ego_mean	0.008910622848851425
sim_compute_robot_state-ego_median	0.00909597253146237
sim_compute_robot_state-ego_min	0.0068234393471165704
sim_compute_sim_state_max	0.005925350189208985
sim_compute_sim_state_mean	0.005047902825855607
sim_compute_sim_state_median	0.005090024020220782
sim_compute_sim_state_min	0.0037888100272730776
sim_physics_max	0.1304503017001682
sim_physics_mean	0.10735894916546491
sim_physics_median	0.10527458909439714
sim_physics_min	0.07396238728573448
sim_render-ego_max	0.013824648327297635
sim_render-ego_mean	0.012055677007016048
sim_render-ego_median	0.012150654921660552
sim_render-ego_min	0.00934747018312153
simulation-passed	1
survival_time_max	7.549999999999981
survival_time_mean	3.4499999999999957
survival_time_min	1.2500000000000004

No reset possible

24955

4191

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 08:50:29+00:00

2019-11-04 09:00:19+00:00

0:09:50

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24939

4206

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LF-sim-testing

step1-simulation

failed

ip-172-31-45-34-10500

2019-11-04 08:45:47+00:00

2019-11-04 08:50:15+00:00

0:04:28

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24937

4215

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LF-sim-validation

step1-simulation

failed

ip-172-31-45-34-10500

2019-11-04 08:44:37+00:00

2019-11-04 08:45:26+00:00

0:00:49

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24924

4225

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFV-sim-testing

step1-simulation

failed

ip-172-31-45-34-10500

2019-11-04 08:41:16+00:00

2019-11-04 08:44:00+00:00

0:02:44

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24915

4234

Andrea Censi 🇨🇭

challenge-aido_LF-template-pytorch

aido3-LFV-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 08:38:59+00:00

2019-11-04 08:41:03+00:00

0:02:04

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24898

4251

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 08:03:14+00:00

2019-11-04 08:38:44+00:00

0:35:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1142141592465633
survival_time_median	11.350000000000026
deviation-center-line_median	0.7321071292786286
in-drivable-lane_median	0.650000000000003

other stats

agent_compute-ego_max	0.055972979618952826
agent_compute-ego_mean	0.0473020543858028
agent_compute-ego_median	0.04871948490058798
agent_compute-ego_min	0.02817888151515614
deviation-center-line_max	1.3246904942074575
deviation-center-line_mean	0.6893750049371934
deviation-center-line_min	0.20285471105373215
deviation-heading_max	6.088674277620699
deviation-heading_mean	2.6060679541755554
deviation-heading_median	2.31513058513542
deviation-heading_min	0.6510978237056387
driven_any_max	2.3491599617164103
driven_any_mean	1.5732474426171632
driven_any_median	1.770236716774897
driven_any_min	0.4686710815559692
driven_lanedir_consec_max	2.3306750787402493
driven_lanedir_consec_mean	1.1831605882002634
driven_lanedir_consec_min	0.15617398466590093
driven_lanedir_max	2.3306750787402493
driven_lanedir_mean	1.2566065984373755
driven_lanedir_median	1.1142141592465633
driven_lanedir_min	0.42660664888547384
in-drivable-lane_max	4.000000000000057
in-drivable-lane_mean	1.250000000000009
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6458379438521271, "sim_physics": 0.11359533938494595, "survival_time": 4.399999999999992, "driven_lanedir": 0.6110517280625811, "sim_render-ego": 0.012109962376681242, "in-drivable-lane": 0, "agent_compute-ego": 0.02817888151515614, "deviation-heading": 1.0858847030474723, "set_robot_commands": 0.010934225537560203, "deviation-center-line": 0.34322184787182164, "driven_lanedir_consec": 0.6110517280625811, "sim_compute_sim_state": 0.005446805195374923, "sim_compute_performance-ego": 0.007619524543935602, "sim_compute_robot_state-ego": 0.00915576382116838}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7578143305829862, "sim_physics": 0.14801422440179504, "survival_time": 5.04999999999999, "driven_lanedir": 0.4394732651826092, "sim_render-ego": 0.01300803269490157, "in-drivable-lane": 0.9499999999999984, "agent_compute-ego": 0.05399487514307003, "deviation-heading": 2.5626845597386705, "set_robot_commands": 0.010806541631717494, "deviation-center-line": 0.26142348224070044, "driven_lanedir_consec": 0.15617398466590093, "sim_compute_sim_state": 0.005511810283849735, "sim_compute_performance-ego": 0.007887108491198851, "sim_compute_robot_state-ego": 0.009941790363576153}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3487911095153917, "sim_physics": 0.10598051309585572, "survival_time": 14.950000000000076, "driven_lanedir": 1.5304152052216558, "sim_render-ego": 0.01221678574879964, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.0477471113204956, "deviation-heading": 4.204109468500445, "set_robot_commands": 0.00957109292348226, "deviation-center-line": 0.929757811729099, "driven_lanedir_consec": 1.474270016294536, "sim_compute_sim_state": 0.005191903114318847, "sim_compute_performance-ego": 0.007402118047078451, "sim_compute_robot_state-ego": 0.008966546853383382}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348756038682839, "sim_physics": 0.07789342164993286, "survival_time": 14.950000000000076, "driven_lanedir": 1.8076506663569445, "sim_render-ego": 0.009672134717305502, "in-drivable-lane": 1.9499999999999955, "agent_compute-ego": 0.039167806307474774, "deviation-heading": 4.593829919595799, "set_robot_commands": 0.0071275424957275395, "deviation-center-line": 1.0245637418287206, "driven_lanedir_consec": 1.35928909435428, "sim_compute_sim_state": 0.004035867849985758, "sim_compute_performance-ego": 0.005616020361582438, "sim_compute_robot_state-ego": 0.0069693215688069665}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348527846108677, "sim_physics": 0.08691423416137695, "survival_time": 14.950000000000076, "driven_lanedir": 1.6489519660733558, "sim_render-ego": 0.01016664743423462, "in-drivable-lane": 2.2500000000000107, "agent_compute-ego": 0.04200666824976603, "deviation-heading": 6.088674277620699, "set_robot_commands": 0.007863240242004394, "deviation-center-line": 0.8292686975956742, "driven_lanedir_consec": 1.3653877298926114, "sim_compute_sim_state": 0.0041500075658162435, "sim_compute_performance-ego": 0.005894550482432048, "sim_compute_robot_state-ego": 0.007309707005818685}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348853779514341, "sim_physics": 0.08503754138946533, "survival_time": 14.950000000000076, "driven_lanedir": 1.7969230003290313, "sim_render-ego": 0.010494851271311442, "in-drivable-lane": 2.200000000000025, "agent_compute-ego": 0.04154098033905029, "deviation-heading": 4.618166871155476, "set_robot_commands": 0.008553930918375651, "deviation-center-line": 0.8684718163815152, "driven_lanedir_consec": 1.7969230003290313, "sim_compute_sim_state": 0.004285721778869629, "sim_compute_performance-ego": 0.006100343068440755, "sim_compute_robot_state-ego": 0.00761962095896403}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5650866201899332, "sim_physics": 0.10491897843100809, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4549934181075206, "sim_render-ego": 0.01163724490574428, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.046970119724025976, "deviation-heading": 0.6510978237056387, "set_robot_commands": 0.009384498967752827, "deviation-center-line": 0.25824336246013224, "driven_lanedir_consec": 0.4549934181075206, "sim_compute_sim_state": 0.004657807288231787, "sim_compute_performance-ego": 0.006660551219791561, "sim_compute_robot_state-ego": 0.008545655708808404}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.368575624816975, "sim_physics": 0.1228897153994458, "survival_time": 8.84999999999999, "driven_lanedir": 1.1142141592465633, "sim_render-ego": 0.013059218724568684, "in-drivable-lane": 0.650000000000003, "agent_compute-ego": 0.0547206024665617, "deviation-heading": 2.7456300554562296, "set_robot_commands": 0.010555057202355335, "deviation-center-line": 0.7321071292786286, "driven_lanedir_consec": 1.1142141592465633, "sim_compute_sim_state": 0.005219571334494036, "sim_compute_performance-ego": 0.007833134656572073, "sim_compute_robot_state-ego": 0.009850585528012722}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.349136927542953, "sim_physics": 0.11547348976135254, "survival_time": 14.950000000000076, "driven_lanedir": 2.3073802648726964, "sim_render-ego": 0.013147267500559489, "in-drivable-lane": 0, "agent_compute-ego": 0.05020115613937378, "deviation-heading": 2.31513058513542, "set_robot_commands": 0.010784618854522704, "deviation-center-line": 1.113236432343305, "driven_lanedir_consec": 2.3073802648726964, "sim_compute_sim_state": 0.005381551583607992, "sim_compute_performance-ego": 0.00783947229385376, "sim_compute_robot_state-ego": 0.00980266809463501}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5007781420155515, "sim_physics": 0.12458944320678712, "survival_time": 3.4499999999999957, "driven_lanedir": 0.4381228050644075, "sim_render-ego": 0.01346141359080439, "in-drivable-lane": 0, "agent_compute-ego": 0.05348160301429638, "deviation-heading": 1.0949398164683055, "set_robot_commands": 0.01040001883023027, "deviation-center-line": 0.20285471105373215, "driven_lanedir_consec": 0.4381228050644075, "sim_compute_sim_state": 0.00544410166533097, "sim_compute_performance-ego": 0.007989917976268824, "sim_compute_robot_state-ego": 0.010214850522469784}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.079382748932124, "sim_physics": 0.10272211385956892, "survival_time": 7.049999999999983, "driven_lanedir": 1.0375813612682263, "sim_render-ego": 0.012142894961309773, "in-drivable-lane": 0, "agent_compute-ego": 0.04932493182784277, "deviation-heading": 1.2399002081972172, "set_robot_commands": 0.008970228492790926, "deviation-center-line": 0.6548660308466514, "driven_lanedir_consec": 1.0375813612682263, "sim_compute_sim_state": 0.004786450812157164, "sim_compute_performance-ego": 0.007178250779496863, "sim_compute_robot_state-ego": 0.008765262914887557}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4686710815559692, "sim_physics": 0.1175280974461482, "survival_time": 3.2499999999999964, "driven_lanedir": 0.42660664888547384, "sim_render-ego": 0.011874899497398964, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.055972979618952826, "deviation-heading": 0.7073096151963908, "set_robot_commands": 0.010081331546490008, "deviation-center-line": 0.23253833813379704, "driven_lanedir_consec": 0.42660664888547384, "sim_compute_sim_state": 0.005279089854313777, "sim_compute_performance-ego": 0.00683288941016564, "sim_compute_robot_state-ego": 0.008988589506882888}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.770236716774897, "sim_physics": 0.11118384289846546, "survival_time": 11.350000000000026, "driven_lanedir": 1.0809106810108011, "sim_render-ego": 0.012628211849061405, "in-drivable-lane": 3.2000000000000064, "agent_compute-ego": 0.04871948490058798, "deviation-heading": 3.28627001590783, "set_robot_commands": 0.009275891182181068, "deviation-center-line": 0.425260799088699, "driven_lanedir_consec": 1.0505908050813544, "sim_compute_sim_state": 0.004802345704402167, "sim_compute_performance-ego": 0.007627259267059192, "sim_compute_robot_state-ego": 0.00960787277389728}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3491599617164103, "sim_physics": 0.11358493169148765, "survival_time": 14.950000000000076, "driven_lanedir": 2.3306750787402493, "sim_render-ego": 0.012598867416381837, "in-drivable-lane": 0, "agent_compute-ego": 0.046964616775512696, "deviation-heading": 1.6686148380073764, "set_robot_commands": 0.010367062091827393, "deviation-center-line": 1.3246904942074575, "driven_lanedir_consec": 2.3306750787402493, "sim_compute_sim_state": 0.005402835210164388, "sim_compute_performance-ego": 0.007919712861378988, "sim_compute_robot_state-ego": 0.0095752747853597}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.3491027674562774, "sim_physics": 0.11227824767430623, "survival_time": 14.950000000000076, "driven_lanedir": 1.8241487281385171, "sim_render-ego": 0.012732678254445394, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.05053899844487508, "deviation-heading": 2.2287765549003553, "set_robot_commands": 0.010032385985056558, "deviation-center-line": 1.1401203789979677, "driven_lanedir_consec": 1.8241487281385171, "sim_compute_sim_state": 0.00513548215230306, "sim_compute_performance-ego": 0.007970547676086426, "sim_compute_robot_state-ego": 0.00950519879659017}}
set_robot_commands_max	0.010934225537560203
set_robot_commands_mean	0.009647177793471644
set_robot_commands_median	0.010032385985056558
set_robot_commands_min	0.0071275424957275395
sim_compute_performance-ego_max	0.007989917976268824
sim_compute_performance-ego_mean	0.007224760075689433
sim_compute_performance-ego_median	0.007619524543935602
sim_compute_performance-ego_min	0.005616020361582438
sim_compute_robot_state-ego_max	0.010214850522469784
sim_compute_robot_state-ego_mean	0.008987913946884075
sim_compute_robot_state-ego_median	0.00915576382116838
sim_compute_robot_state-ego_min	0.0069693215688069665
sim_compute_sim_state_max	0.005511810283849735
sim_compute_sim_state_mean	0.004982090092881365
sim_compute_sim_state_median	0.005191903114318847
sim_compute_sim_state_min	0.004035867849985758
sim_physics_max	0.14801422440179504
sim_physics_mean	0.10950694229679613
sim_physics_median	0.11227824767430623
sim_physics_min	0.07789342164993286
sim_render-ego_max	0.01346141359080439
sim_render-ego_mean	0.01206340739623388
sim_render-ego_median	0.01221678574879964
sim_render-ego_min	0.009672134717305502
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.1266666666667
survival_time_min	3.2499999999999964

No reset possible

24892

4259

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 08:00:54+00:00

2019-11-04 08:02:53+00:00

0:01:59

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24870

4281

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 07:53:28+00:00

2019-11-04 08:00:18+00:00

0:06:50

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24864

4287

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 07:46:40+00:00

2019-11-04 07:53:06+00:00

0:06:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.02444118545168922
agent_compute-ego_mean	0.021481303387314788
agent_compute-ego_median	0.021146563035023363
agent_compute-ego_min	0.017043889147564044
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1897241737269148, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.011346605759632738, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.021146563035023363, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.00926030738444268, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.004724460312082798, "sim_compute_performance-ego": 0.006883099109311647, "sim_compute_robot_state-ego": 0.00892869732047938, "sim_compute_robot_state-npc0": 0.008115288577502287, "sim_compute_robot_state-npc1": 0.007389388506925559, "sim_compute_robot_state-npc2": 0.007675828812997552, "sim_compute_robot_state-npc3": 0.007728365403187426}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.1802452632359096, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.011738240718841553, "in-drivable-lane": 0, "agent_compute-ego": 0.020445500101361955, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.008313144956316267, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.004611372947692871, "sim_compute_performance-ego": 0.006609993321555001, "sim_compute_robot_state-ego": 0.008305753980364119, "sim_compute_robot_state-npc0": 0.00808180230004447, "sim_compute_robot_state-npc1": 0.008258989879063197, "sim_compute_robot_state-npc2": 0.007887916905539376, "sim_compute_robot_state-npc3": 0.008255856377737862}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.13194613317841464, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.009141422012477245, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.017043889147564044, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.007000564371497885, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.003843728778431717, "sim_compute_performance-ego": 0.005290411051037242, "sim_compute_robot_state-ego": 0.006516815389244302, "sim_compute_robot_state-npc0": 0.006486064022027173, "sim_compute_robot_state-npc1": 0.006364301570410867, "sim_compute_robot_state-npc2": 0.006369951859261226, "sim_compute_robot_state-npc3": 0.006259480726371691}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.2519364406665166, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.014474347233772278, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.024329379200935364, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.010778923829396566, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.005190407236417134, "sim_compute_performance-ego": 0.007550949851671855, "sim_compute_robot_state-ego": 0.00925914446512858, "sim_compute_robot_state-npc0": 0.008965134620666504, "sim_compute_robot_state-npc1": 0.009468754132588703, "sim_compute_robot_state-npc2": 0.008803541461626688, "sim_compute_robot_state-npc3": 0.009519735972086588}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.19392951329549157, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.01210338728768485, "in-drivable-lane": 0, "agent_compute-ego": 0.02444118545168922, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.010951973143078032, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.0051154522668747674, "sim_compute_performance-ego": 0.006985914139520554, "sim_compute_robot_state-ego": 0.008571931294032506, "sim_compute_robot_state-npc0": 0.00914250101361956, "sim_compute_robot_state-npc1": 0.00869652203151158, "sim_compute_robot_state-npc2": 0.008518673124767485, "sim_compute_robot_state-npc3": 0.008497737702869233}}
set_robot_commands_max	0.010951973143078032
set_robot_commands_mean	0.009260982736946286
set_robot_commands_median	0.00926030738444268
set_robot_commands_min	0.007000564371497885
sim_compute_performance-ego_max	0.007550949851671855
sim_compute_performance-ego_mean	0.00666407349461926
sim_compute_performance-ego_median	0.006883099109311647
sim_compute_performance-ego_min	0.005290411051037242
sim_compute_robot_state-ego_max	0.00925914446512858
sim_compute_robot_state-ego_mean	0.008316468489849778
sim_compute_robot_state-ego_median	0.008571931294032506
sim_compute_robot_state-ego_min	0.006516815389244302
sim_compute_robot_state-npc0_max	0.00914250101361956
sim_compute_robot_state-npc0_mean	0.008158158106771998
sim_compute_robot_state-npc0_median	0.008115288577502287
sim_compute_robot_state-npc0_min	0.006486064022027173
sim_compute_robot_state-npc1_max	0.009468754132588703
sim_compute_robot_state-npc1_mean	0.00803559122409998
sim_compute_robot_state-npc1_median	0.008258989879063197
sim_compute_robot_state-npc1_min	0.006364301570410867
sim_compute_robot_state-npc2_max	0.008803541461626688
sim_compute_robot_state-npc2_mean	0.007851182432838466
sim_compute_robot_state-npc2_median	0.007887916905539376
sim_compute_robot_state-npc2_min	0.006369951859261226
sim_compute_robot_state-npc3_max	0.009519735972086588
sim_compute_robot_state-npc3_mean	0.00805223523645056
sim_compute_robot_state-npc3_median	0.008255856377737862
sim_compute_robot_state-npc3_min	0.006259480726371691
sim_compute_sim_state_max	0.005190407236417134
sim_compute_sim_state_mean	0.004697084308299857
sim_compute_sim_state_median	0.004724460312082798
sim_compute_sim_state_min	0.003843728778431717
sim_physics_max	0.2519364406665166
sim_physics_mean	0.18955630482064945
sim_physics_median	0.1897241737269148
sim_physics_min	0.13194613317841464
sim_render-ego_max	0.014474347233772278
sim_render-ego_mean	0.011760800602481731
sim_render-ego_median	0.011738240718841553
sim_render-ego_min	0.009141422012477245
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24854

4301

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 07:35:54+00:00

2019-11-04 07:45:59+00:00

0:10:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6624558951504921
survival_time_median	2.000000000000001
deviation-center-line_median	0.08490920096961363
in-drivable-lane_median	0.1999999999999993

other stats

agent_compute-ego_max	0.03431680144333258
agent_compute-ego_mean	0.02698117611649085
agent_compute-ego_median	0.026771825551986695
agent_compute-ego_min	0.02317171511442765
deviation-center-line_max	0.2115306175656672
deviation-center-line_mean	0.1059365171201285
deviation-center-line_min	0.06902532930783761
deviation-heading_max	0.5529773614884596
deviation-heading_mean	0.31722659171317497
deviation-heading_median	0.3145505780820485
deviation-heading_min	0.17790279511896667
driven_any_max	2.1696546375441756
driven_any_mean	0.9422938839630692
driven_any_median	0.9996632207705836
driven_any_min	0.28362940600638153
driven_lanedir_consec_max	2.0004202552910058
driven_lanedir_consec_mean	0.7454689984048328
driven_lanedir_consec_min	0.275488859799796
driven_lanedir_max	2.0004202552910058
driven_lanedir_mean	0.7454689984048328
driven_lanedir_median	0.6624558951504921
driven_lanedir_min	0.275488859799796
in-drivable-lane_max	0.7500000000000002
in-drivable-lane_mean	0.27333333333333293
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.11766486167907717, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.01218554973602295, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.029816943407058715, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.009844505786895752, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.0051468491554260256, "sim_compute_performance-ego": 0.007650721073150635, "sim_compute_robot_state-ego": 0.009369653463363648}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0296612854712826, "sim_physics": 0.15929571012171304, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8723011611746517, "sim_render-ego": 0.019576299481275605, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.03431680144333258, "deviation-heading": 0.5268865240013682, "set_robot_commands": 0.01349054894796232, "deviation-center-line": 0.1481817317993273, "driven_lanedir_consec": 0.8723011611746517, "sim_compute_sim_state": 0.008096032026337414, "sim_compute_performance-ego": 0.010011847426251668, "sim_compute_robot_state-ego": 0.01276505865701815}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.09424391388893127, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.0098351389169693, "in-drivable-lane": 0, "agent_compute-ego": 0.023310035467147827, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.007321983575820923, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.0038635283708572383, "sim_compute_performance-ego": 0.00565868616104126, "sim_compute_robot_state-ego": 0.007001355290412903}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4605114688305756, "sim_physics": 0.13579757647080856, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43876913939124096, "sim_render-ego": 0.013177904215725985, "in-drivable-lane": 0, "agent_compute-ego": 0.02725023573095148, "deviation-heading": 0.3393674233921455, "set_robot_commands": 0.010411034930836073, "deviation-center-line": 0.07142284970145178, "driven_lanedir_consec": 0.43876913939124096, "sim_compute_sim_state": 0.005651929161765359, "sim_compute_performance-ego": 0.007749990983442826, "sim_compute_robot_state-ego": 0.009940494190562857}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5996546887300096, "sim_physics": 0.11276352802912394, "survival_time": 2.9999999999999973, "driven_lanedir": 1.1449045921439405, "sim_render-ego": 0.012150863806406656, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.02833928267161051, "deviation-heading": 0.17790279511896667, "set_robot_commands": 0.010442686080932618, "deviation-center-line": 0.2115306175656672, "driven_lanedir_consec": 1.1449045921439405, "sim_compute_sim_state": 0.005147290229797363, "sim_compute_performance-ego": 0.007731318473815918, "sim_compute_robot_state-ego": 0.009047754605611164}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4605114688305744, "sim_physics": 0.12309140508825128, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.013216246258128773, "in-drivable-lane": 0, "agent_compute-ego": 0.027716994285583496, "deviation-heading": 0.3681646786246838, "set_robot_commands": 0.01072118499062278, "deviation-center-line": 0.07726482156623121, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.005453900857405229, "sim_compute_performance-ego": 0.007521445100957697, "sim_compute_robot_state-ego": 0.009657567197626287}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.02966128547129, "sim_physics": 0.09506893739467714, "survival_time": 2.0500000000000007, "driven_lanedir": 0.5601770218273892, "sim_render-ego": 0.011282159060966678, "in-drivable-lane": 0.7500000000000002, "agent_compute-ego": 0.023580155721524863, "deviation-heading": 0.32355444237015635, "set_robot_commands": 0.008916488507898843, "deviation-center-line": 0.08490920096961363, "driven_lanedir_consec": 0.5601770218273892, "sim_compute_sim_state": 0.004488194861063143, "sim_compute_performance-ego": 0.006629560051894769, "sim_compute_robot_state-ego": 0.008186636901483304}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.31273308909619457, "sim_physics": 0.11025661580702838, "survival_time": 0.8500000000000002, "driven_lanedir": 0.3050503874991314, "sim_render-ego": 0.011892529094920438, "in-drivable-lane": 0, "agent_compute-ego": 0.02460770046009737, "deviation-heading": 0.18880886527581872, "set_robot_commands": 0.009330440970028149, "deviation-center-line": 0.07728062202497794, "driven_lanedir_consec": 0.3050503874991314, "sim_compute_sim_state": 0.00471648047952091, "sim_compute_performance-ego": 0.006730444291058709, "sim_compute_robot_state-ego": 0.008375097723568188}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6997653880805514, "sim_physics": 0.14264233907063803, "survival_time": 1.5000000000000009, "driven_lanedir": 0.6932401426939361, "sim_render-ego": 0.014414668083190918, "in-drivable-lane": 0, "agent_compute-ego": 0.030615639686584473, "deviation-heading": 0.20499704380051056, "set_robot_commands": 0.01202100118001302, "deviation-center-line": 0.0893147083916865, "driven_lanedir_consec": 0.6932401426939361, "sim_compute_sim_state": 0.005135099093119304, "sim_compute_performance-ego": 0.007567993799845378, "sim_compute_robot_state-ego": 0.009887456893920898}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9996632207705836, "sim_physics": 0.10812031030654908, "survival_time": 2.000000000000001, "driven_lanedir": 0.6624558951504921, "sim_render-ego": 0.012675398588180542, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.026016896963119505, "deviation-heading": 0.3376863277046913, "set_robot_commands": 0.008754134178161621, "deviation-center-line": 0.08436164061098934, "driven_lanedir_consec": 0.6624558951504921, "sim_compute_sim_state": 0.004876130819320678, "sim_compute_performance-ego": 0.007511806488037109, "sim_compute_robot_state-ego": 0.008973461389541627}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5996546887300176, "sim_physics": 0.1244951566060384, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183806352793682, "sim_render-ego": 0.011895338694254557, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.028737970193227137, "deviation-heading": 0.28606515891922396, "set_robot_commands": 0.009127481778462728, "deviation-center-line": 0.11803705330676682, "driven_lanedir_consec": 1.2183806352793682, "sim_compute_sim_state": 0.0047562956809997555, "sim_compute_performance-ego": 0.006997414429982503, "sim_compute_robot_state-ego": 0.008982646465301513}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.999663220770584, "sim_physics": 0.10662653446197508, "survival_time": 2.000000000000001, "driven_lanedir": 0.6472595776031794, "sim_render-ego": 0.012064653635025024, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.026121371984481813, "deviation-heading": 0.5529773614884596, "set_robot_commands": 0.009151816368103027, "deviation-center-line": 0.11678925740610405, "driven_lanedir_consec": 0.6472595776031794, "sim_compute_sim_state": 0.0045320093631744385, "sim_compute_performance-ego": 0.006801176071166992, "sim_compute_robot_state-ego": 0.008777773380279541}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9996632207705816, "sim_physics": 0.10466184616088868, "survival_time": 2.000000000000001, "driven_lanedir": 0.7633687986487552, "sim_render-ego": 0.01192060112953186, "in-drivable-lane": 0.3500000000000001, "agent_compute-ego": 0.026771825551986695, "deviation-heading": 0.2265255398365549, "set_robot_commands": 0.009151977300643922, "deviation-center-line": 0.07499156567757533, "driven_lanedir_consec": 0.7633687986487552, "sim_compute_sim_state": 0.004649078845977784, "sim_compute_performance-ego": 0.007063037157058716, "sim_compute_robot_state-ego": 0.00903451442718506}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.49031796957265295, "sim_physics": 0.10046171105426292, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4795803098565079, "sim_render-ego": 0.010751091915628183, "in-drivable-lane": 0, "agent_compute-ego": 0.02317171511442765, "deviation-heading": 0.24111734124432463, "set_robot_commands": 0.00770221585812776, "deviation-center-line": 0.06902532930783761, "driven_lanedir_consec": 0.4795803098565079, "sim_compute_sim_state": 0.004426759222279425, "sim_compute_performance-ego": 0.006181105323459791, "sim_compute_robot_state-ego": 0.008920628091563349}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1696546375441756, "sim_physics": 0.09407083897650996, "survival_time": 3.949999999999994, "driven_lanedir": 2.0004202552910058, "sim_render-ego": 0.011612970617753042, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.02434407306622855, "deviation-heading": 0.477679362566162, "set_robot_commands": 0.00886303865456883, "deviation-center-line": 0.2021170113452346, "driven_lanedir_consec": 2.0004202552910058, "sim_compute_sim_state": 0.004714332049406028, "sim_compute_performance-ego": 0.006757298602333552, "sim_compute_robot_state-ego": 0.008356848849525934}}
set_robot_commands_max	0.01349054894796232
set_robot_commands_mean	0.009683369273938558
set_robot_commands_median	0.009151977300643922
set_robot_commands_min	0.007321983575820923
sim_compute_performance-ego_max	0.010011847426251668
sim_compute_performance-ego_mean	0.007237589695566501
sim_compute_performance-ego_median	0.007063037157058716
sim_compute_performance-ego_min	0.00565868616104126
sim_compute_robot_state-ego_max	0.01276505865701815
sim_compute_robot_state-ego_mean	0.009151796501797628
sim_compute_robot_state-ego_median	0.008982646465301513
sim_compute_robot_state-ego_min	0.007001355290412903
sim_compute_sim_state_max	0.008096032026337414
sim_compute_sim_state_mean	0.005043594014430006
sim_compute_sim_state_median	0.0047562956809997555
sim_compute_sim_state_min	0.0038635283708572383
sim_physics_max	0.15929571012171304
sim_physics_mean	0.1152840856744315
sim_physics_median	0.11025661580702838
sim_physics_min	0.09407083897650996
sim_render-ego_max	0.019576299481275605
sim_render-ego_mean	0.012576760882265366
sim_render-ego_median	0.012064653635025024
sim_render-ego_min	0.0098351389169693
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	1.9033333333333329
survival_time_min	0.8000000000000002

No reset possible

24845

4317

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFV-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 07:20:21+00:00

2019-11-04 07:35:35+00:00

0:15:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.02362556561179783
agent_compute-ego_mean	0.021736984799238895
agent_compute-ego_median	0.021490347385406495
agent_compute-ego_min	0.019425320625305175
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1112205456826628
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.37150980594423094
deviation-heading_median	0.34774352178293905
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589055
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.15049050913916695, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.013036970739011411, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.021232560828880028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.00901470802448414, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.00440627998775906, "sim_compute_performance-ego": 0.0070570265805279765, "sim_compute_robot_state-ego": 0.008439479050812897, "sim_compute_robot_state-npc0": 0.007970037283720794, "sim_compute_robot_state-npc1": 0.008118523491753472, "sim_compute_robot_state-npc2": 0.007977092707598651, "sim_compute_robot_state-npc3": 0.007513355325769495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.18660804748535156, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.010586490631103515, "in-drivable-lane": 0, "agent_compute-ego": 0.02275021553039551, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008585338592529296, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.005030202865600586, "sim_compute_performance-ego": 0.006462211608886719, "sim_compute_robot_state-ego": 0.008027496337890625, "sim_compute_robot_state-npc0": 0.007978620529174805, "sim_compute_robot_state-npc1": 0.007519216537475586, "sim_compute_robot_state-npc2": 0.007354059219360352, "sim_compute_robot_state-npc3": 0.007764196395874024}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18817322191439176, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.011161023064663536, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0201698573012101, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.009181345763959382, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.0047893963362041275, "sim_compute_performance-ego": 0.007259830048209743, "sim_compute_robot_state-ego": 0.008476796903108296, "sim_compute_robot_state-npc0": 0.007577325168408845, "sim_compute_robot_state-npc1": 0.007902386941407857, "sim_compute_robot_state-npc2": 0.007908940315246582, "sim_compute_robot_state-npc3": 0.007908061931007787}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.18068844457215905, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.010880497437489183, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.020357297945626174, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.008676909193207946, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0045913140985030165, "sim_compute_performance-ego": 0.00653006457075288, "sim_compute_robot_state-ego": 0.007894639727435534, "sim_compute_robot_state-npc0": 0.007847776895836938, "sim_compute_robot_state-npc1": 0.007986946950984907, "sim_compute_robot_state-npc2": 0.007656000837495056, "sim_compute_robot_state-npc3": 0.007702791238132912}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.19548686061586656, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.013152837753295898, "in-drivable-lane": 0, "agent_compute-ego": 0.022932146276746477, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.010030158928462438, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.022265757833208357, "sim_compute_performance-ego": 0.007647139685494559, "sim_compute_robot_state-ego": 0.009342644895826068, "sim_compute_robot_state-npc0": 0.008743575641087123, "sim_compute_robot_state-npc1": 0.008550286293029785, "sim_compute_robot_state-npc2": 0.00825162444795881, "sim_compute_robot_state-npc3": 0.008411918367658342}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.15212271831653737, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.012919209621570728, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.023083995889734334, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.009637563316910356, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.005036618974473741, "sim_compute_performance-ego": 0.007493314919648347, "sim_compute_robot_state-ego": 0.008739957103022822, "sim_compute_robot_state-npc0": 0.008499745969419126, "sim_compute_robot_state-npc1": 0.008464596889637134, "sim_compute_robot_state-npc2": 0.008528475408200864, "sim_compute_robot_state-npc3": 0.008586720184043602}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0456729849899615, "sim_physics": 0.14633540753965024, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.011391299742239493, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.020663217261985497, "deviation-heading": 0.3927366768210136, "set_robot_commands": 0.008728817657188134, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.00439927754578767, "sim_compute_performance-ego": 0.006506601969401042, "sim_compute_robot_state-ego": 0.008027089966668023, "sim_compute_robot_state-npc0": 0.007760613052933304, "sim_compute_robot_state-npc1": 0.00768374072180854, "sim_compute_robot_state-npc2": 0.0073490893399273905, "sim_compute_robot_state-npc3": 0.007324174598411277}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8772562288570896, "sim_physics": 0.24571398629082575, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.012363640467325849, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.023466210895114473, "deviation-heading": 0.3844740406851849, "set_robot_commands": 0.00961881743537055, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.004929203457302517, "sim_compute_performance-ego": 0.0076467408074273, "sim_compute_robot_state-ego": 0.009348011016845703, "sim_compute_robot_state-npc0": 0.008784935209486219, "sim_compute_robot_state-npc1": 0.008784506056043837, "sim_compute_robot_state-npc2": 0.008018223444620769, "sim_compute_robot_state-npc3": 0.00823539098103841}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.843301097417158, "sim_physics": 0.19896395310111667, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.012538210205409838, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.02362556561179783, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.010385041651518448, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.005410997763923977, "sim_compute_performance-ego": 0.007526936738387398, "sim_compute_robot_state-ego": 0.010151386260986328, "sim_compute_robot_state-npc0": 0.00951720838961394, "sim_compute_robot_state-npc1": 0.008976184803506603, "sim_compute_robot_state-npc2": 0.008669334909190302, "sim_compute_robot_state-npc3": 0.008727135865584663}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.18157429218292237, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.011542272567749024, "in-drivable-lane": 0, "agent_compute-ego": 0.02120671272277832, "deviation-heading": 0.34774352178293905, "set_robot_commands": 0.008504285812377929, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.0043218755722045895, "sim_compute_performance-ego": 0.006924614906311035, "sim_compute_robot_state-ego": 0.008109378814697265, "sim_compute_robot_state-npc0": 0.008355817794799804, "sim_compute_robot_state-npc1": 0.008012466430664063, "sim_compute_robot_state-npc2": 0.007946338653564453, "sim_compute_robot_state-npc3": 0.007552509307861328}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.2089679718017578, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.011966609954833984, "in-drivable-lane": 0, "agent_compute-ego": 0.021490347385406495, "deviation-heading": 0.3801610449156702, "set_robot_commands": 0.009251642227172853, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.004623353481292725, "sim_compute_performance-ego": 0.006824994087219238, "sim_compute_robot_state-ego": 0.009268248081207277, "sim_compute_robot_state-npc0": 0.007485389709472656, "sim_compute_robot_state-npc1": 0.007832777500152589, "sim_compute_robot_state-npc2": 0.00817965269088745, "sim_compute_robot_state-npc3": 0.00786501169204712}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1979656972383198, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.012099266052246094, "in-drivable-lane": 0, "agent_compute-ego": 0.02241305301063939, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.010083687932867753, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.0048407002499229025, "sim_compute_performance-ego": 0.00755259865208676, "sim_compute_robot_state-ego": 0.01059001370480186, "sim_compute_robot_state-npc0": 0.00970115159687243, "sim_compute_robot_state-npc1": 0.008814472901193719, "sim_compute_robot_state-npc2": 0.009020654778731495, "sim_compute_robot_state-npc3": 0.008172863408138878}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700496, "sim_physics": 0.1433516550064087, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.010521349906921386, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.019425320625305175, "deviation-heading": 0.2263485117662672, "set_robot_commands": 0.00786923885345459, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.004418954849243164, "sim_compute_performance-ego": 0.006231975555419922, "sim_compute_robot_state-ego": 0.007922964096069336, "sim_compute_robot_state-npc0": 0.00747220516204834, "sim_compute_robot_state-npc1": 0.007520785331726074, "sim_compute_robot_state-npc2": 0.007179365158081054, "sim_compute_robot_state-npc3": 0.007289981842041016}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3514429441281624, "sim_physics": 0.20509052276611328, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.011023673144253817, "in-drivable-lane": 0, "agent_compute-ego": 0.02104860002344305, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.008381550962274725, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.004601153460415927, "sim_compute_performance-ego": 0.006748004393144088, "sim_compute_robot_state-ego": 0.00893058560111306, "sim_compute_robot_state-npc0": 0.007652239366011186, "sim_compute_robot_state-npc1": 0.007819598371332342, "sim_compute_robot_state-npc2": 0.007693951780145819, "sim_compute_robot_state-npc3": 0.007425319064747204}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.20480388038012445, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.012553614013049066, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.022189670679520587, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.009214313662782008, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.004664124274740414, "sim_compute_performance-ego": 0.007063563989133251, "sim_compute_robot_state-ego": 0.009671936229783662, "sim_compute_robot_state-npc0": 0.009179796491350449, "sim_compute_robot_state-npc1": 0.008768650950217734, "sim_compute_robot_state-npc2": 0.008322920118059431, "sim_compute_robot_state-npc3": 0.00780926918496891}}
set_robot_commands_max	0.010385041651518448
set_robot_commands_mean	0.009144228000970702
set_robot_commands_median	0.009181345763959382
set_robot_commands_min	0.00786923885345459
sim_compute_performance-ego_max	0.007647139685494559
sim_compute_performance-ego_mean	0.007031707900803349
sim_compute_performance-ego_median	0.0070570265805279765
sim_compute_performance-ego_min	0.006231975555419922
sim_compute_robot_state-ego_max	0.01059001370480186
sim_compute_robot_state-ego_mean	0.00886270851935125
sim_compute_robot_state-ego_median	0.008739957103022822
sim_compute_robot_state-ego_min	0.007894639727435534
sim_compute_robot_state-npc0_max	0.00970115159687243
sim_compute_robot_state-npc0_mean	0.008301762550682398
sim_compute_robot_state-npc0_median	0.007978620529174805
sim_compute_robot_state-npc0_min	0.00747220516204834
sim_compute_robot_state-npc1_max	0.008976184803506603
sim_compute_robot_state-npc1_mean	0.008183676011395616
sim_compute_robot_state-npc1_median	0.008012466430664063
sim_compute_robot_state-npc1_min	0.007519216537475586
sim_compute_robot_state-npc2_max	0.009020654778731495
sim_compute_robot_state-npc2_mean	0.008003714920604567
sim_compute_robot_state-npc2_median	0.007977092707598651
sim_compute_robot_state-npc2_min	0.007179365158081054
sim_compute_robot_state-npc3_max	0.008727135865584663
sim_compute_robot_state-npc3_mean	0.007885913292488332
sim_compute_robot_state-npc3_median	0.00780926918496891
sim_compute_robot_state-npc3_min	0.007289981842041016
sim_compute_sim_state_max	0.022265757833208357
sim_compute_sim_state_mean	0.005888614050038852
sim_compute_sim_state_median	0.004664124274740414
sim_compute_sim_state_min	0.0043218755722045895
sim_physics_max	0.24571398629082575
sim_physics_mean	0.18575581122338083
sim_physics_median	0.18817322191439176
sim_physics_min	0.1433516550064087
sim_render-ego_max	0.013152837753295898
sim_render-ego_mean	0.011849131020077518
sim_render-ego_median	0.011966609954833984
sim_render-ego_min	0.010521349906921386
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

24841

4329

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 07:08:10+00:00

2019-11-04 07:20:06+00:00

0:11:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.02352613109653279
agent_compute-ego_mean	0.021550685096998742
agent_compute-ego_median	0.021785948011610243
agent_compute-ego_min	0.017190905178294462
deviation-center-line_max	0.28386357003337986
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652288
deviation-heading_median	0.3292838510353387
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.975949037827615
driven_any_median	1.0117660515775695
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063861
driven_lanedir_consec_mean	0.6896171461819268
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063861
driven_lanedir_mean	0.6896171461819268
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.09923069565384476, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.01159234400148745, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.021785948011610243, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008664060522008825, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004904769085071705, "sim_compute_performance-ego": 0.007134468467147262, "sim_compute_robot_state-ego": 0.008840949447066695}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.14080316412682628, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.012370838838465074, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.022841430177875592, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.010342794306137982, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.005095430448943493, "sim_compute_performance-ego": 0.007303378161262064, "sim_compute_robot_state-ego": 0.01006165205263624}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.08817756877225988, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.009984942043528835, "in-drivable-lane": 0, "agent_compute-ego": 0.017190905178294462, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.00759270611931296, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.004049146876615637, "sim_compute_performance-ego": 0.00557710142696605, "sim_compute_robot_state-ego": 0.006807271172018612}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.10921416282653808, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.011294822692871092, "in-drivable-lane": 0, "agent_compute-ego": 0.021660890579223633, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.008543920516967774, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.00500361442565918, "sim_compute_performance-ego": 0.007348508834838867, "sim_compute_robot_state-ego": 0.008347282409667969}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.12028604821313786, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.012304861334305776, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02220425424696524, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.009539658510232274, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.005112204370619376, "sim_compute_performance-ego": 0.007499761219266095, "sim_compute_robot_state-ego": 0.009505935862094542}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.0965430298630072, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.01147920258191167, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01988657639951122, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.008728066269232303, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.0049448889129015865, "sim_compute_performance-ego": 0.007000806380291374, "sim_compute_robot_state-ego": 0.008453364274939713}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.11833698408944268, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.01268059015274048, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.02269206302506583, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0102287871497018, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.005128668887274606, "sim_compute_performance-ego": 0.007502632481711251, "sim_compute_robot_state-ego": 0.00933106882231576}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.10140250978015718, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.020115273339407783, "in-drivable-lane": 0, "agent_compute-ego": 0.020631063552129836, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.009300504411969866, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.004683710279918853, "sim_compute_performance-ego": 0.006394136519659133, "sim_compute_robot_state-ego": 0.008336305618286133}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.14049198263782567, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.012347997245142016, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.02352613109653279, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.010829400208036778, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.005198704994330972, "sim_compute_performance-ego": 0.007730007171630859, "sim_compute_robot_state-ego": 0.00941884719719321}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.0973550796508789, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.015520611676302825, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.02276369875127619, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.009636852957985616, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.004730376330288974, "sim_compute_performance-ego": 0.007116976651278409, "sim_compute_robot_state-ego": 0.008708823810924183}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.0965963215022892, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.013942953828093293, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.02172205974529316, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.008970517616767388, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.0050153949043967505, "sim_compute_performance-ego": 0.007002855276132559, "sim_compute_robot_state-ego": 0.00873583322995669}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12840686525617326, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.012164081845964705, "in-drivable-lane": 0, "agent_compute-ego": 0.022002560751778737, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.008922815322875977, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.004469011511121478, "sim_compute_performance-ego": 0.006556800433567592, "sim_compute_robot_state-ego": 0.008222298962729318}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.1054387139339073, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.011884086272295783, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.02249252094941981, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.009748374714570887, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.004905303319295247, "sim_compute_performance-ego": 0.0070407530840705425, "sim_compute_robot_state-ego": 0.00850992109261307}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09976417047006111, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.011878146065606013, "in-drivable-lane": 0, "agent_compute-ego": 0.021574135179872864, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.008705086178249784, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.004593301702428747, "sim_compute_performance-ego": 0.007190245169180411, "sim_compute_robot_state-ego": 0.009151343946103696}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.09207452278511195, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.010816029473847034, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.020286038810131597, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.008368534200331745, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.004515201437707041, "sim_compute_performance-ego": 0.006471757795296463, "sim_compute_robot_state-ego": 0.007781657518125048}}
set_robot_commands_max	0.010829400208036778
set_robot_commands_mean	0.00920813860029213
set_robot_commands_median	0.008970517616767388
set_robot_commands_min	0.00759270611931296
sim_compute_performance-ego_max	0.007730007171630859
sim_compute_performance-ego_mean	0.006991345938153261
sim_compute_performance-ego_median	0.007116976651278409
sim_compute_performance-ego_min	0.00557710142696605
sim_compute_robot_state-ego_max	0.01006165205263624
sim_compute_robot_state-ego_mean	0.00868083702777806
sim_compute_robot_state-ego_median	0.008708823810924183
sim_compute_robot_state-ego_min	0.006807271172018612
sim_compute_sim_state_max	0.005198704994330972
sim_compute_sim_state_mean	0.004823315165771576
sim_compute_sim_state_median	0.004905303319295247
sim_compute_sim_state_min	0.004049146876615637
sim_physics_max	0.14080316412682628
sim_physics_mean	0.10894145463743075
sim_physics_median	0.10140250978015718
sim_physics_min	0.08817756877225988
sim_render-ego_max	0.020115273339407783
sim_render-ego_mean	0.01269178542613132
sim_render-ego_median	0.012164081845964705
sim_render-ego_min	0.009984942043528835
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

24836

4335

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-11-04 07:00:52+00:00

2019-11-04 07:07:39+00:00

0:06:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.024905855215868904
agent_compute-ego_mean	0.02235339758041779
agent_compute-ego_median	0.02338336408138275
agent_compute-ego_min	0.017677273069109236
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22838567178460617, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.012451926364174372, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02389001544517807, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.009916546978527986, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.004948769943623603, "sim_compute_performance-ego": 0.0071110151991059505, "sim_compute_robot_state-ego": 0.009031199201752868, "sim_compute_robot_state-npc0": 0.008498783353008802, "sim_compute_robot_state-npc1": 0.008255367037616198, "sim_compute_robot_state-npc2": 0.008134033106550385, "sim_compute_robot_state-npc3": 0.008326388612578187}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.19101834297180176, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.011793954031808036, "in-drivable-lane": 0, "agent_compute-ego": 0.021910480090550015, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.009571867329733712, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.004642878259931292, "sim_compute_performance-ego": 0.0071245091302054265, "sim_compute_robot_state-ego": 0.009508754525865828, "sim_compute_robot_state-npc0": 0.00860102687563215, "sim_compute_robot_state-npc1": 0.008260667324066162, "sim_compute_robot_state-npc2": 0.008346199989318848, "sim_compute_robot_state-npc3": 0.008377986294882638}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.20976266583192696, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.01323575649446654, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.024905855215868904, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.010495609450108795, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.005381250844418424, "sim_compute_performance-ego": 0.007888455992763482, "sim_compute_robot_state-ego": 0.010043560879901776, "sim_compute_robot_state-npc0": 0.009539729183159986, "sim_compute_robot_state-npc1": 0.00917943704475477, "sim_compute_robot_state-npc2": 0.008897670264382965, "sim_compute_robot_state-npc3": 0.008805048118517237}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.2372529705365499, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.012678648034731546, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.02338336408138275, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.009735579291979471, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.005106290181477864, "sim_compute_performance-ego": 0.007659852504730225, "sim_compute_robot_state-ego": 0.010123302539189655, "sim_compute_robot_state-npc0": 0.00894970695177714, "sim_compute_robot_state-npc1": 0.008635883529980978, "sim_compute_robot_state-npc2": 0.008492658535639444, "sim_compute_robot_state-npc3": 0.008692815899848938}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.15177659761338008, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.00969408807300386, "in-drivable-lane": 0, "agent_compute-ego": 0.017677273069109236, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.007219280515398298, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.004189548038301014, "sim_compute_performance-ego": 0.005420945939563569, "sim_compute_robot_state-ego": 0.0071492308662051245, "sim_compute_robot_state-npc0": 0.007209346407935733, "sim_compute_robot_state-npc1": 0.0066612788609095985, "sim_compute_robot_state-npc2": 0.006421724955240886, "sim_compute_robot_state-npc3": 0.006537993748982747}}
set_robot_commands_max	0.010495609450108795
set_robot_commands_mean	0.009387776713149653
set_robot_commands_median	0.009735579291979471
set_robot_commands_min	0.007219280515398298
sim_compute_performance-ego_max	0.007888455992763482
sim_compute_performance-ego_mean	0.007040955753273731
sim_compute_performance-ego_median	0.0071245091302054265
sim_compute_performance-ego_min	0.005420945939563569
sim_compute_robot_state-ego_max	0.010123302539189655
sim_compute_robot_state-ego_mean	0.009171209602583047
sim_compute_robot_state-ego_median	0.009508754525865828
sim_compute_robot_state-ego_min	0.0071492308662051245
sim_compute_robot_state-npc0_max	0.009539729183159986
sim_compute_robot_state-npc0_mean	0.00855971855430276
sim_compute_robot_state-npc0_median	0.00860102687563215
sim_compute_robot_state-npc0_min	0.007209346407935733
sim_compute_robot_state-npc1_max	0.00917943704475477
sim_compute_robot_state-npc1_mean	0.008198526759465542
sim_compute_robot_state-npc1_median	0.008260667324066162
sim_compute_robot_state-npc1_min	0.0066612788609095985
sim_compute_robot_state-npc2_max	0.008897670264382965
sim_compute_robot_state-npc2_mean	0.008058457370226504
sim_compute_robot_state-npc2_median	0.008346199989318848
sim_compute_robot_state-npc2_min	0.006421724955240886
sim_compute_robot_state-npc3_max	0.008805048118517237
sim_compute_robot_state-npc3_mean	0.008148046534961949
sim_compute_robot_state-npc3_median	0.008377986294882638
sim_compute_robot_state-npc3_min	0.006537993748982747
sim_compute_sim_state_max	0.005381250844418424
sim_compute_sim_state_mean	0.00485374745355044
sim_compute_sim_state_median	0.004948769943623603
sim_compute_sim_state_min	0.004189548038301014
sim_physics_max	0.2372529705365499
sim_physics_mean	0.203639249747653
sim_physics_median	0.20976266583192696
sim_physics_min	0.15177659761338008
sim_render-ego_max	0.01323575649446654
sim_render-ego_mean	0.01197087459963687
sim_render-ego_median	0.012451926364174372
sim_render-ego_min	0.00969408807300386
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24817

4347

Frank (Chude) Qian 🇨🇦

Frank raw run 1

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-11-04 06:54:15+00:00

2019-11-04 07:00:17+00:00

0:06:02

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24811

4346

Frank (Chude) Qian 🇨🇦

Frank raw run 1

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-02 22:42:46+00:00

2019-11-02 22:52:38+00:00

0:09:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5307536165346418
survival_time_median	3.649999999999995
deviation-center-line_median	0.15729429345346263
in-drivable-lane_median	0.2499999999999991

other stats

agent_compute-ego_max	0.016446534901449126
agent_compute-ego_mean	0.0158274328883472
agent_compute-ego_median	0.015708949114825274
agent_compute-ego_min	0.015536258095189144
deviation-center-line_max	0.4893287036272684
deviation-center-line_mean	0.17919186786280658
deviation-center-line_min	0.0361911753331286
deviation-heading_max	3.298693025953033
deviation-heading_mean	0.9793698353465872
deviation-heading_median	0.7790349811692442
deviation-heading_min	0.3107738903875914
driven_any_max	2.192830687515576
driven_any_mean	0.8865297597769006
driven_any_median	0.9636357063630352
driven_any_min	0.17642538589869558
driven_lanedir_consec_max	1.5732785354212382
driven_lanedir_consec_mean	0.5905766331353004
driven_lanedir_consec_min	0.14798543700904165
driven_lanedir_max	1.6920842983550408
driven_lanedir_mean	0.6220550168724457
driven_lanedir_median	0.5394711364634506
driven_lanedir_min	0.14798543700904165
in-drivable-lane_max	2.699999999999992
in-drivable-lane_mean	0.6033333333333314
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9636357063630352, "sim_physics": 0.04787401630453868, "survival_time": 3.649999999999995, "driven_lanedir": 0.5394711364634506, "sim_render-ego": 0.01180416263946115, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.016446534901449126, "deviation-heading": 0.6461681479046909, "set_robot_commands": 0.0046103131281186455, "deviation-center-line": 0.1625613498660486, "driven_lanedir_consec": 0.5307536165346418, "sim_compute_sim_state": 0.0028883790316647047, "sim_compute_performance-ego": 0.004029669173776287, "sim_compute_robot_state-ego": 0.005039711521096425}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20808061779117737, "sim_physics": 0.05203057590283846, "survival_time": 0.9500000000000004, "driven_lanedir": 0.14798543700904165, "sim_render-ego": 0.007011488864296361, "in-drivable-lane": 0, "agent_compute-ego": 0.015536258095189144, "deviation-heading": 0.450932959536656, "set_robot_commands": 0.004395911568089535, "deviation-center-line": 0.0361911753331286, "driven_lanedir_consec": 0.14798543700904165, "sim_compute_sim_state": 0.002845864546926398, "sim_compute_performance-ego": 0.0037044600436561986, "sim_compute_robot_state-ego": 0.004908875415199681}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2622622877120444, "sim_physics": 0.04819603811336469, "survival_time": 3.949999999999994, "driven_lanedir": 0.983094532164297, "sim_render-ego": 0.00694473182098775, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.015761478037773807, "deviation-heading": 1.2523015822187198, "set_robot_commands": 0.00452538381648969, "deviation-center-line": 0.3140626225224443, "driven_lanedir_consec": 0.9211609329181942, "sim_compute_sim_state": 0.002841861942146398, "sim_compute_performance-ego": 0.0037804253493683247, "sim_compute_robot_state-ego": 0.0048721198794207995}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0516605355048116, "sim_physics": 0.04690835900502662, "survival_time": 3.649999999999995, "driven_lanedir": 0.9566429920956234, "sim_render-ego": 0.007138898927871495, "in-drivable-lane": 0, "agent_compute-ego": 0.015897332805476776, "deviation-heading": 1.0701329590874331, "set_robot_commands": 0.004665097145185078, "deviation-center-line": 0.14595331392666602, "driven_lanedir_consec": 0.9566429920956234, "sim_compute_sim_state": 0.00288833983956951, "sim_compute_performance-ego": 0.00382162773445861, "sim_compute_robot_state-ego": 0.004963022388824045}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9805832123838796, "sim_physics": 0.04770080785493593, "survival_time": 3.699999999999995, "driven_lanedir": 0.6572995738356191, "sim_render-ego": 0.007021085636035816, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.015708949114825274, "deviation-heading": 1.203341674590601, "set_robot_commands": 0.004649020530082084, "deviation-center-line": 0.1657000070223644, "driven_lanedir_consec": 0.6543747023683477, "sim_compute_sim_state": 0.0028793682923188083, "sim_compute_performance-ego": 0.003775045678422258, "sim_compute_robot_state-ego": 0.00489130213453963}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.8645226532759676, "sim_physics": 0.0493319034576416, "survival_time": 2.9499999999999975, "driven_lanedir": 0.644286949402852, "sim_render-ego": 0.007013753309088238, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.015621342901456154, "deviation-heading": 1.2629695404753634, "set_robot_commands": 0.004515449879533153, "deviation-center-line": 0.2165256209831154, "driven_lanedir_consec": 0.644286949402852, "sim_compute_sim_state": 0.002854840230133574, "sim_compute_performance-ego": 0.003795793500997253, "sim_compute_robot_state-ego": 0.004860700187036547}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.4289099463351662, "sim_physics": 0.04935918315764396, "survival_time": 1.5500000000000007, "driven_lanedir": 0.4145759101189946, "sim_render-ego": 0.007151619080574282, "in-drivable-lane": 0, "agent_compute-ego": 0.01635702963798277, "deviation-heading": 0.3624224363106679, "set_robot_commands": 0.004620790481567383, "deviation-center-line": 0.1133878038256539, "driven_lanedir_consec": 0.4145759101189946, "sim_compute_sim_state": 0.002926403476345924, "sim_compute_performance-ego": 0.003865741914318454, "sim_compute_robot_state-ego": 0.004888988310290921}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.261476602125692, "sim_physics": 0.04968134562174479, "survival_time": 1.0500000000000005, "driven_lanedir": 0.24544554570275112, "sim_render-ego": 0.007163025083996001, "in-drivable-lane": 0, "agent_compute-ego": 0.015681210018339612, "deviation-heading": 0.3107738903875914, "set_robot_commands": 0.004456440607706706, "deviation-center-line": 0.09934631831042393, "driven_lanedir_consec": 0.24544554570275112, "sim_compute_sim_state": 0.002852360407511393, "sim_compute_performance-ego": 0.0038038662501743863, "sim_compute_robot_state-ego": 0.0048947447822207495}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4669122589179304, "sim_physics": 0.04936967908808616, "survival_time": 5.649999999999988, "driven_lanedir": 0.49219934834387713, "sim_render-ego": 0.006969924521657218, "in-drivable-lane": 2.699999999999992, "agent_compute-ego": 0.01569180151002597, "deviation-heading": 1.6339641293154723, "set_robot_commands": 0.004592448209239318, "deviation-center-line": 0.15729429345346263, "driven_lanedir_consec": 0.22272538773091588, "sim_compute_sim_state": 0.002877174225528683, "sim_compute_performance-ego": 0.003821986966428503, "sim_compute_robot_state-ego": 0.004891558031065274}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0946717461079942, "sim_physics": 0.04806797441683317, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6087462414945364, "sim_render-ego": 0.0070128911419918664, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.015651404857635498, "deviation-heading": 0.7790349811692442, "set_robot_commands": 0.004552091422833894, "deviation-center-line": 0.1661307491242848, "driven_lanedir_consec": 0.5984261996263027, "sim_compute_sim_state": 0.0028807364012065685, "sim_compute_performance-ego": 0.0037688612937927246, "sim_compute_robot_state-ego": 0.004835740516060277}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5993574248448108, "sim_physics": 0.049065449198738474, "survival_time": 6.099999999999986, "driven_lanedir": 1.092298956016793, "sim_render-ego": 0.0070329201026041, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01605827886550153, "deviation-heading": 1.315784201218653, "set_robot_commands": 0.004393196496807161, "deviation-center-line": 0.3938361836618248, "driven_lanedir_consec": 1.092298956016793, "sim_compute_sim_state": 0.002869138952161445, "sim_compute_performance-ego": 0.003769102643747799, "sim_compute_robot_state-ego": 0.004845750136453597}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.17642538589869558, "sim_physics": 0.05480945110321045, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1566920934418976, "sim_render-ego": 0.007319498062133789, "in-drivable-lane": 0, "agent_compute-ego": 0.01593266725540161, "deviation-heading": 0.3458523495222221, "set_robot_commands": 0.0044854521751403805, "deviation-center-line": 0.072737899962651, "driven_lanedir_consec": 0.1566920934418976, "sim_compute_sim_state": 0.0029718637466430663, "sim_compute_performance-ego": 0.00390709638595581, "sim_compute_robot_state-ego": 0.005002212524414062}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.4455777532701586, "sim_physics": 0.049515724182128906, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4172223477612416, "sim_render-ego": 0.0069626990486593805, "in-drivable-lane": 0, "agent_compute-ego": 0.01557166436139275, "deviation-heading": 0.4096423874395112, "set_robot_commands": 0.004420638084411621, "deviation-center-line": 0.09379453481973546, "driven_lanedir_consec": 0.4172223477612416, "sim_compute_sim_state": 0.002889198415419635, "sim_compute_performance-ego": 0.003789004157571232, "sim_compute_robot_state-ego": 0.004844223751741297}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.30103957860656805, "sim_physics": 0.05010009848553201, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2827798908806689, "sim_render-ego": 0.006990297980930494, "in-drivable-lane": 0, "agent_compute-ego": 0.01568131861479386, "deviation-heading": 0.34853326506894716, "set_robot_commands": 0.004542122716489045, "deviation-center-line": 0.061027441503026754, "driven_lanedir_consec": 0.2827798908806689, "sim_compute_sim_state": 0.00288459529047427, "sim_compute_performance-ego": 0.003800164098324983, "sim_compute_robot_state-ego": 0.00488212834233823}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.192830687515576, "sim_physics": 0.04933870825797889, "survival_time": 7.84999999999998, "driven_lanedir": 1.6920842983550408, "sim_render-ego": 0.006854998837610719, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.015814222347964146, "deviation-heading": 3.298693025953033, "set_robot_commands": 0.004504592555343725, "deviation-center-line": 0.4893287036272684, "driven_lanedir_consec": 1.5732785354212382, "sim_compute_sim_state": 0.002869100327704362, "sim_compute_performance-ego": 0.0037968750971897392, "sim_compute_robot_state-ego": 0.004867810352592711}}
set_robot_commands_max	0.004665097145185078
set_robot_commands_mean	0.004528596587802496
set_robot_commands_median	0.00452538381648969
set_robot_commands_min	0.004393196496807161
sim_compute_performance-ego_max	0.004029669173776287
sim_compute_performance-ego_mean	0.003815314685878838
sim_compute_performance-ego_median	0.0037968750971897392
sim_compute_performance-ego_min	0.0037044600436561986
sim_compute_robot_state-ego_max	0.005039711521096425
sim_compute_robot_state-ego_mean	0.0048992592182196155
sim_compute_robot_state-ego_median	0.004888988310290921
sim_compute_robot_state-ego_min	0.004835740516060277
sim_compute_sim_state_max	0.0029718637466430663
sim_compute_sim_state_mean	0.002881281675050316
sim_compute_sim_state_median	0.0028793682923188083
sim_compute_sim_state_min	0.002841861942146398
sim_physics_max	0.05480945110321045
sim_physics_mean	0.049423287610016194
sim_physics_median	0.04933870825797889
sim_physics_min	0.04690835900502662
sim_render-ego_max	0.01180416263946115
sim_render-ego_mean	0.007359466337193245
sim_render-ego_median	0.007013753309088238
sim_render-ego_min	0.006854998837610719
simulation-passed	1
survival_time_max	7.84999999999998
survival_time_mean	3.2466666666666617
survival_time_min	0.9500000000000004

No reset possible

24804

4341

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-11-02 17:34:01+00:00

2019-11-02 18:00:34+00:00

0:26:33

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24793

4329

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-11-02 16:25:23+00:00

2019-11-02 16:33:44+00:00

0:08:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.02049711227416992
agent_compute-ego_mean	0.015420717274072297
agent_compute-ego_median	0.013964542320796422
agent_compute-ego_min	0.013007855882831649
deviation-center-line_max	0.28386357003337986
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652288
deviation-heading_median	0.3292838510353387
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.975949037827615
driven_any_median	1.0117660515775695
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063861
driven_lanedir_consec_mean	0.6896171461819268
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063861
driven_lanedir_mean	0.6896171461819268
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.06752921475304498, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010462222275910552, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.019157122682642053, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.007064726617601182, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004347531883804886, "sim_compute_performance-ego": 0.005909579771536368, "sim_compute_robot_state-ego": 0.0070193034631234625}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06575801793266745, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.009290540919584386, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01711710761575138, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.006500001047171799, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.004278290505502738, "sim_compute_performance-ego": 0.005052547828823912, "sim_compute_robot_state-ego": 0.006663018581913966}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.07638716697692871, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.009848748936372644, "in-drivable-lane": 0, "agent_compute-ego": 0.01965043124030618, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.006932426901424632, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.004001603407018325, "sim_compute_performance-ego": 0.005123755511115579, "sim_compute_robot_state-ego": 0.007028818130493164}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07791691780090332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.01022329330444336, "in-drivable-lane": 0, "agent_compute-ego": 0.02049711227416992, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.007489700317382813, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004228115081787109, "sim_compute_performance-ego": 0.0056590080261230465, "sim_compute_robot_state-ego": 0.007363290786743164}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.06867194477515885, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.009878185730946214, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01807464828974084, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.00651100919216494, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.004272313057621823, "sim_compute_performance-ego": 0.0055357112160211875, "sim_compute_robot_state-ego": 0.0068907707552366615}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.05445926530020578, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.007545549042370855, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.014217118827664122, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.004778326774130062, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.003072748378831513, "sim_compute_performance-ego": 0.004175395381693937, "sim_compute_robot_state-ego": 0.005274359060793507}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.05037258778299604, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.008262570415224348, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.014490936483655657, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.004836857318878174, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.0030849788870130268, "sim_compute_performance-ego": 0.004012776272637504, "sim_compute_robot_state-ego": 0.005126650844301496}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.05233651115780785, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.007179078601655506, "in-drivable-lane": 0, "agent_compute-ego": 0.013498646872384208, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.0043451786041259766, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.0028830142248244513, "sim_compute_performance-ego": 0.003804638272240048, "sim_compute_robot_state-ego": 0.0049395447685605005}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.05086386405815512, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.007069676609362586, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.013474387637639447, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.0044380446611824685, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.0028647083347126587, "sim_compute_performance-ego": 0.003779544668682551, "sim_compute_robot_state-ego": 0.0048124709371793065}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.050907325744628903, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.0071668191389604044, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.013415128534490412, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.00461905219338157, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.0029259551655162466, "sim_compute_performance-ego": 0.003826024315573952, "sim_compute_robot_state-ego": 0.004870843887329101}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.04921244026778581, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.007310427628554307, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.013615555577463918, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.004592034723851588, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.0029899516662993987, "sim_compute_performance-ego": 0.003919400177992784, "sim_compute_robot_state-ego": 0.004931682116025454}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.05505904981068203, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.007283142634800502, "in-drivable-lane": 0, "agent_compute-ego": 0.013964542320796422, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.004422494343348912, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.0029240335736955914, "sim_compute_performance-ego": 0.0038457001958574566, "sim_compute_robot_state-ego": 0.004850447177886963}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.04852942859425264, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.007012474770639457, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.013007855882831649, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.0045801284266453164, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.00286255630792356, "sim_compute_performance-ego": 0.003780210719389074, "sim_compute_robot_state-ego": 0.004847989362828872}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.052727831734551325, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.007139011665626809, "in-drivable-lane": 0, "agent_compute-ego": 0.01350306581567835, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.004429940824155454, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0029379968289975768, "sim_compute_performance-ego": 0.003853276923850731, "sim_compute_robot_state-ego": 0.004907510898731373}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.04874261921527339, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.007206152467166676, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.013627099055869906, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.004582463526258282, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.0029988990110509537, "sim_compute_performance-ego": 0.0039175281337663235, "sim_compute_robot_state-ego": 0.004914316476560107}}
set_robot_commands_max	0.007489700317382813
set_robot_commands_mean	0.005341492364780212
set_robot_commands_median	0.00461905219338157
set_robot_commands_min	0.0043451786041259766
sim_compute_performance-ego_max	0.005909579771536368
sim_compute_performance-ego_mean	0.00441300649435363
sim_compute_performance-ego_median	0.003919400177992784
sim_compute_performance-ego_min	0.003779544668682551
sim_compute_robot_state-ego_max	0.007363290786743164
sim_compute_robot_state-ego_mean	0.005629401149847141
sim_compute_robot_state-ego_median	0.0049395447685605005
sim_compute_robot_state-ego_min	0.0048124709371793065
sim_compute_sim_state_max	0.004347531883804886
sim_compute_sim_state_mean	0.0033781797543066565
sim_compute_sim_state_median	0.0029988990110509537
sim_compute_sim_state_min	0.00286255630792356
sim_physics_max	0.07791691780090332
sim_physics_mean	0.05796494572700281
sim_physics_median	0.052727831734551325
sim_physics_min	0.04852942859425264
sim_render-ego_max	0.010462222275910552
sim_render-ego_mean	0.00819185960944124
sim_render-ego_median	0.007310427628554307
sim_render-ego_min	0.007012474770639457
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

24769

4314

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LF-sim-testing

step1-simulation

host-error

ip-172-31-45-34-10500

2019-11-02 06:49:08+00:00

2019-11-02 07:00:03+00:00

0:10:55

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 641, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1301, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1555, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1611, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4314/step1-simulation-ip-172-31-45-34-10500-job24769/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-13-0/camera.mp4.metadata.yaml']' returned non-zero exit status 1.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24749

4302

Frank (Chude) Qian 🇨🇦

Frank test submission

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-10-31 14:05:52+00:00

2019-10-31 14:10:42+00:00

0:04:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6856800730956207
survival_time_median	2.000000000000001
deviation-center-line_median	0.08877415228107144
in-drivable-lane_median	0.1499999999999997

other stats

agent_compute-ego_max	0.02702935039997101
agent_compute-ego_mean	0.02234990036540444
agent_compute-ego_median	0.023582441050831866
agent_compute-ego_min	0.01810856298966841
deviation-center-line_max	0.2115306175656672
deviation-center-line_mean	0.11899130923898212
deviation-center-line_min	0.07142284970145178
deviation-heading_max	0.5268865240013682
deviation-heading_mean	0.3101645507734078
deviation-heading_median	0.3145505780820485
deviation-heading_min	0.17790279511896667
driven_any_max	1.5996546887300096
driven_any_mean	0.8746240139617669
driven_any_median	0.9996632207705848
driven_any_min	0.28362940600638153
driven_lanedir_consec_max	1.1449045921439405
driven_lanedir_consec_mean	0.68342876512105
driven_lanedir_consec_min	0.275488859799796
driven_lanedir_max	1.1449045921439405
driven_lanedir_mean	0.68342876512105
driven_lanedir_median	0.6856800730956207
driven_lanedir_min	0.275488859799796
in-drivable-lane_max	0.7499999999999973
in-drivable-lane_mean	0.26999999999999946
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.06796595454216003, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.007797425985336304, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.01836424469947815, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.005885380506515503, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.0031965970993041992, "sim_compute_performance-ego": 0.004341262578964234, "sim_compute_robot_state-ego": 0.005580484867095947}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0296612854712826, "sim_physics": 0.08505891009074885, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8723011611746517, "sim_render-ego": 0.010942121831382191, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.023582441050831866, "deviation-heading": 0.5268865240013682, "set_robot_commands": 0.008528819898279702, "deviation-center-line": 0.1481817317993273, "driven_lanedir_consec": 0.8723011611746517, "sim_compute_sim_state": 0.004994630813598633, "sim_compute_performance-ego": 0.006059245365421947, "sim_compute_robot_state-ego": 0.008191475054112876}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.09108345210552216, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.012925580143928528, "in-drivable-lane": 0, "agent_compute-ego": 0.02702935039997101, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.008917301893234253, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.005126953125, "sim_compute_performance-ego": 0.007091879844665527, "sim_compute_robot_state-ego": 0.008940353989601135}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4605114688305756, "sim_physics": 0.07049895416606557, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43876913939124096, "sim_render-ego": 0.007791649211536755, "in-drivable-lane": 0, "agent_compute-ego": 0.01810856298966841, "deviation-heading": 0.3393674233921455, "set_robot_commands": 0.005714795806191184, "deviation-center-line": 0.07142284970145178, "driven_lanedir_consec": 0.43876913939124096, "sim_compute_sim_state": 0.0032183257016268644, "sim_compute_performance-ego": 0.004279841076244007, "sim_compute_robot_state-ego": 0.00557642633264715}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5996546887300096, "sim_physics": 0.08628945748011271, "survival_time": 2.9999999999999973, "driven_lanedir": 1.1449045921439405, "sim_render-ego": 0.010998090108235678, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.024664902687072755, "deviation-heading": 0.17790279511896667, "set_robot_commands": 0.008087352911631266, "deviation-center-line": 0.2115306175656672, "driven_lanedir_consec": 1.1449045921439405, "sim_compute_sim_state": 0.004404389858245849, "sim_compute_performance-ego": 0.006064685185750326, "sim_compute_robot_state-ego": 0.007794209321339925}}
set_robot_commands_max	0.008917301893234253
set_robot_commands_mean	0.007426730203170381
set_robot_commands_median	0.008087352911631266
set_robot_commands_min	0.005714795806191184
sim_compute_performance-ego_max	0.007091879844665527
sim_compute_performance-ego_mean	0.005567382810209208
sim_compute_performance-ego_median	0.006059245365421947
sim_compute_performance-ego_min	0.004279841076244007
sim_compute_robot_state-ego_max	0.008940353989601135
sim_compute_robot_state-ego_mean	0.007216589912959407
sim_compute_robot_state-ego_median	0.007794209321339925
sim_compute_robot_state-ego_min	0.00557642633264715
sim_compute_sim_state_max	0.005126953125
sim_compute_sim_state_mean	0.004188179319555109
sim_compute_sim_state_median	0.004404389858245849
sim_compute_sim_state_min	0.0031965970993041992
sim_physics_max	0.09108345210552216
sim_physics_mean	0.08017934567692186
sim_physics_median	0.08505891009074885
sim_physics_min	0.06796595454216003
sim_render-ego_max	0.012925580143928528
sim_render-ego_mean	0.010090973456083892
sim_render-ego_median	0.010942121831382191
sim_render-ego_min	0.007791649211536755
simulation-passed	1
survival_time_max	2.9999999999999973
survival_time_mean	1.7899999999999998
survival_time_min	0.8000000000000002

No reset possible

24733

2360

Andrea Censi 🇨🇭

PredictorMean

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 14:04:50+00:00

2019-10-31 14:05:27+00:00

0:00:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.2851032385043495
error_L2	0.09681103103982158

No reset possible

24730

2815

Liam Paull 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 14:04:16+00:00

2019-10-31 14:04:42+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12406656362648254
error_L2	0.023860141215732066

No reset possible

24714

3265

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-45-34-10500

2019-10-31 14:03:46+00:00

2019-10-31 14:03:50+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24706

3133

Amaury Camus 🇨🇭

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 14:03:09+00:00

2019-10-31 14:03:24+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11752861479076863
error_L2	0.021630020780998307

No reset possible

24700

3257

Liu Sam 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-45-34-10500

2019-10-31 14:02:49+00:00

2019-10-31 14:02:53+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24684

3169

SIN KIAT LIM 🇲🇾

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 14:02:13+00:00

2019-10-31 14:02:28+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10212974919935756
error_L2	0.01651836554323851

No reset possible

24676

3177

Shen Yu Chia 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 14:01:42+00:00

2019-10-31 14:01:58+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10061121197052118
error_L2	0.015386511583880267

No reset possible

24668

3264

Liu Sam 🇹🇼

challenge-aido_LF-template-random

aido2-PRED

step1-simulation

host-error

yes

ip-172-31-45-34-10500

2019-10-31 14:01:16+00:00

2019-10-31 14:01:25+00:00

0:00:09

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24661

3230

Sheng-Cheng, Lee 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 14:00:26+00:00

2019-10-31 14:01:09+00:00

0:00:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11103853608040937
error_L2	0.018069364062186073

No reset possible

24560

4296

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-10-31 13:52:05+00:00

2019-10-31 14:00:12+00:00

0:08:07

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24549

4159

yang yi chun 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 13:51:19+00:00

2019-10-31 13:51:45+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10650663722979094
error_L2	0.01804118576647118

No reset possible

24540

4113

Frank (Chude) Qian 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

success

yes

ip-172-31-45-34-10500

2019-10-31 13:50:18+00:00

2019-10-31 13:50:49+00:00

0:00:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11713124020659166
error_L2	0.022731836034979913

No reset possible

24518

4287

Liam Paull 🇨🇦

challenge-aido_LF-template-random

aido3-LFVI-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-10-31 12:29:44+00:00

2019-10-31 12:36:20+00:00

0:06:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.018808497658258753
agent_compute-ego_mean	0.017385208025749353
agent_compute-ego_median	0.01722349226474762
agent_compute-ego_min	0.016146569024948848
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1390952731989607, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.00986688650107082, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.018808497658258753, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.010707809955258912, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.004141985615597496, "sim_compute_performance-ego": 0.005228990240942074, "sim_compute_robot_state-ego": 0.006583506547952, "sim_compute_robot_state-npc0": 0.006601620324050324, "sim_compute_robot_state-npc1": 0.006714962705781188, "sim_compute_robot_state-npc2": 0.006533085545407066, "sim_compute_robot_state-npc3": 0.006509463998335826}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.12987584727151052, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.00942366463797433, "in-drivable-lane": 0, "agent_compute-ego": 0.017843314579554966, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.006216985838753837, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.003851703235081264, "sim_compute_performance-ego": 0.005037742001669747, "sim_compute_robot_state-ego": 0.006418083395276751, "sim_compute_robot_state-npc0": 0.005848058632441929, "sim_compute_robot_state-npc1": 0.005931104932512555, "sim_compute_robot_state-npc2": 0.006168518747602191, "sim_compute_robot_state-npc3": 0.005975876535688128}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.12121785960151152, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.009350297520461593, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.016904166601236583, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.006202213972517588, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.003663037587138056, "sim_compute_performance-ego": 0.005176611317014231, "sim_compute_robot_state-ego": 0.006494626258183452, "sim_compute_robot_state-npc0": 0.00617787444475785, "sim_compute_robot_state-npc1": 0.005801119850677194, "sim_compute_robot_state-npc2": 0.005749531162595286, "sim_compute_robot_state-npc3": 0.005784541657827433}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.13380263249079383, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.008910040060679117, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.01722349226474762, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.006165355443954468, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.003701746463775635, "sim_compute_performance-ego": 0.004803215463956197, "sim_compute_robot_state-ego": 0.006188750267028809, "sim_compute_robot_state-npc0": 0.006017078955968221, "sim_compute_robot_state-npc1": 0.005962491035461426, "sim_compute_robot_state-npc2": 0.00597172478834788, "sim_compute_robot_state-npc3": 0.005860259135564168}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.12134105818612236, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.00851009005591983, "in-drivable-lane": 0, "agent_compute-ego": 0.016146569024948848, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.00594979240780785, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.003391538347516741, "sim_compute_performance-ego": 0.004540261768159412, "sim_compute_robot_state-ego": 0.005972487585885184, "sim_compute_robot_state-npc0": 0.00569220951625279, "sim_compute_robot_state-npc1": 0.005776768638974144, "sim_compute_robot_state-npc2": 0.005517653056553432, "sim_compute_robot_state-npc3": 0.00556530271257673}}
set_robot_commands_max	0.010707809955258912
set_robot_commands_mean	0.0070484315236585314
set_robot_commands_median	0.006202213972517588
set_robot_commands_min	0.00594979240780785
sim_compute_performance-ego_max	0.005228990240942074
sim_compute_performance-ego_mean	0.0049573641583483315
sim_compute_performance-ego_median	0.005037742001669747
sim_compute_performance-ego_min	0.004540261768159412
sim_compute_robot_state-ego_max	0.006583506547952
sim_compute_robot_state-ego_mean	0.00633149081086524
sim_compute_robot_state-ego_median	0.006418083395276751
sim_compute_robot_state-ego_min	0.005972487585885184
sim_compute_robot_state-npc0_max	0.006601620324050324
sim_compute_robot_state-npc0_mean	0.006067368374694222
sim_compute_robot_state-npc0_median	0.006017078955968221
sim_compute_robot_state-npc0_min	0.00569220951625279
sim_compute_robot_state-npc1_max	0.006714962705781188
sim_compute_robot_state-npc1_mean	0.006037289432681302
sim_compute_robot_state-npc1_median	0.005931104932512555
sim_compute_robot_state-npc1_min	0.005776768638974144
sim_compute_robot_state-npc2_max	0.006533085545407066
sim_compute_robot_state-npc2_mean	0.005988102660101172
sim_compute_robot_state-npc2_median	0.00597172478834788
sim_compute_robot_state-npc2_min	0.005517653056553432
sim_compute_robot_state-npc3_max	0.006509463998335826
sim_compute_robot_state-npc3_mean	0.005939088807998457
sim_compute_robot_state-npc3_median	0.005860259135564168
sim_compute_robot_state-npc3_min	0.00556530271257673
sim_compute_sim_state_max	0.004141985615597496
sim_compute_sim_state_mean	0.0037500022498218382
sim_compute_sim_state_median	0.003701746463775635
sim_compute_sim_state_min	0.003391538347516741
sim_physics_max	0.1390952731989607
sim_physics_mean	0.1290665341497798
sim_physics_median	0.12987584727151052
sim_physics_min	0.12121785960151152
sim_render-ego_max	0.00986688650107082
sim_render-ego_mean	0.009212195755221137
sim_render-ego_median	0.009350297520461593
sim_render-ego_min	0.00851009005591983
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24514

4279

Liam Paull 🇨🇦

PredictorLast

aido2-PRED

step1-simulation

error

ip-172-31-45-34-10500

2019-10-31 12:22:24+00:00

2019-10-31 12:23:41+00:00

0:01:17

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
    return deserialize_Dict(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
    return schema_to_type(schema, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
    res = schema_to_type_(schema0, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
    assert False, schema  # pragma: no cover
AssertionError: {'title': 'Any'}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
    return deserialize_dataclass(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
    raise Exception(msg) from e
Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}

| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
|     return deserialize_Dict(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
|     return schema_to_type(schema, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
|     res = schema_to_type_(schema0, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
|     assert False, schema  # pragma: no cover
| AssertionError: {'title': 'Any'}
| 

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 75, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 79, in _get_node_protocol
    timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 211, in read_one
    data = ipce_to_object(msg[FIELD_DATA], {}, expect_type=klass)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
    return deserialize_dataclass(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
    raise Exception(msg) from e
Exception: Cannot deserialize attribute meta (expect: <class 'zuper_nodes.language.InteractionProtocol'>)
value: {'inputs': {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'outputs': {'logs': {'type': 'array', 'items': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'title': 'List[str]', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'aborted': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_description': {'$id': 'http://invalid.json-schema.org/NodeDescription#', 'type': 'object', 'order': ['description'], 'title': 'NodeDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'NodeDescription(description: str)', '__qualname__': 'NodeDescription'}, 'set_config_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'build_description': {'$id': 'http://invalid.json-schema.org/BuildDescription#', 'type': 'object', 'order': [], 'title': 'BuildDescription', '$schema': 'http://json-schema.org/draft-07/schema#', '__module__': 'zuper_nodes_wrapper.meta_protocol', 'description': 'BuildDescription()', '__qualname__': 'BuildDescription'}, 'config_description': {'$id': 'http://invalid.json-schema.org/ConfigDescription#', 'type': 'object', 'order': ['config', 'current'], 'title': 'ConfigDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['config', 'current'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'config': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}, 'current': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'ConfigDescription(config: type, current: Any)', '__qualname__': 'ConfigDescription'}, 'protocol_description': {'$id': 'http://invalid.json-schema.org/ProtocolDescription#', 'type': 'object', 'order': ['data', 'meta'], 'title': 'ProtocolDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['data', 'meta'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'data': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}, 'meta': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}}, 'description': 'ProtocolDescription(data: zuper_nodes.language.InteractionProtocol, meta: zuper_nodes.language.InteractionProtocol)', '__qualname__': 'ProtocolDescription'}}, 'language': '((in:describe_config ; out:config_description) | (in:set_config ; (out:set_config_ack | out:set_config_error)) | (in:describe_protocol ; out:protocol_description) | (in:describe_node ; out:node_description) | (in:describe_build ; out:build_description) | (in:get_state ; out:node_state) | (in:set_state ; (out:set_state_ack | out:set_state_error)) | (in:get_logs ; out:logs) | out:aborted)*', 'description': '\nBasic interaction protocol for nodes spoken by the node wrapper.\n\n    '}

| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
|     return deserialize_Dict(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
|     return schema_to_type(schema, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
|     res = schema_to_type_(schema0, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
|     assert False, schema  # pragma: no cover
| AssertionError: {'title': 'Any'}
| 
| The above exception was the direct cause of the following exception:
| 
| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
|     return deserialize_dataclass(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
|     raise Exception(msg) from e
| Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
| value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}
| 
| | Traceback (most recent call last):
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| |     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
| |     return deserialize_Dict(K, mj, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
| |     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
| |     return schema_to_type(schema, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
| |     res = schema_to_type_(schema0, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
| |     assert False, schema  # pragma: no cover
| | AssertionError: {'title': 'Any'}
| |
|

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24504

4275

Riza Velioglu 🇩🇪

Uni Bielefeld

aido3-LFVI-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-10-29 18:08:00+00:00

2019-10-29 18:09:55+00:00

0:01:55

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24493

4266

Gianmarco Bernasconi

challenge-aido_LF-baseline-duckietown

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-10-29 17:54:08+00:00

2019-10-29 18:00:16+00:00

0:06:08

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24482

4255

Manfred Diaz

challenge-aido_LF-template-pytorch

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-10-25 23:15:11+00:00

2019-10-25 23:20:41+00:00

0:05:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.07265934229599003
survival_time_median	1.7000000000000008
deviation-center-line_median	0.040683336711396914
in-drivable-lane_median	0.5500000000000005

other stats

agent_compute-ego_max	0.017450350920359292
agent_compute-ego_mean	0.01682372917763477
agent_compute-ego_median	0.017008374719058767
agent_compute-ego_min	0.016056960279291325
deviation-center-line_max	0.47449747975546297
deviation-center-line_mean	0.12906959081446098
deviation-center-line_min	0.03457373119835598
deviation-heading_max	4.433835496768127
deviation-heading_mean	1.4072116040635696
deviation-heading_median	0.6923792881687504
deviation-heading_min	0.54442214863307
driven_any_max	1.9351016341939071
driven_any_mean	0.511664429981804
driven_any_median	0.17842511018471563
driven_any_min	0.08990549927347802
driven_lanedir_consec_max	0.23720623821008505
driven_lanedir_consec_mean	0.09380584609442884
driven_lanedir_consec_min	0.018388752919422657
driven_lanedir_max	0.23720623821008505
driven_lanedir_mean	0.09380584609442884
driven_lanedir_median	0.07265934229599003
driven_lanedir_min	0.018388752919422657
in-drivable-lane_max	10.400000000000071
in-drivable-lane_mean	2.430000000000015
in-drivable-lane_min	0.20000000000000015
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9351016341939071, "sim_physics": 0.04829322258631388, "survival_time": 14.950000000000076, "driven_lanedir": 0.23720623821008505, "sim_render-ego": 0.00682761271794637, "in-drivable-lane": 10.400000000000071, "agent_compute-ego": 0.017450350920359292, "deviation-heading": 4.433835496768127, "set_robot_commands": 0.004492380619049072, "deviation-center-line": 0.47449747975546297, "driven_lanedir_consec": 0.23720623821008505, "sim_compute_sim_state": 0.00282258669535319, "sim_compute_performance-ego": 0.0038382752736409505, "sim_compute_robot_state-ego": 0.004803129037221273}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1577706047386704, "sim_physics": 0.04850476128714425, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06742135210809619, "sim_render-ego": 0.007019843373979841, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.01639246940612793, "deviation-heading": 0.7232497114635719, "set_robot_commands": 0.004390350409916469, "deviation-center-line": 0.03457373119835598, "driven_lanedir_consec": 0.06742135210809619, "sim_compute_sim_state": 0.002780616283416748, "sim_compute_performance-ego": 0.003735951014927455, "sim_compute_robot_state-ego": 0.00479705844606672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08990549927347802, "sim_physics": 0.04650227590040727, "survival_time": 1.1000000000000003, "driven_lanedir": 0.018388752919422657, "sim_render-ego": 0.0068940249356356535, "in-drivable-lane": 0.30000000000000016, "agent_compute-ego": 0.016056960279291325, "deviation-heading": 0.54442214863307, "set_robot_commands": 0.004468180916526101, "deviation-center-line": 0.05645407673419884, "driven_lanedir_consec": 0.018388752919422657, "sim_compute_sim_state": 0.002757484262639826, "sim_compute_performance-ego": 0.0037137595089999113, "sim_compute_robot_state-ego": 0.004674174568869851}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19711930151824852, "sim_physics": 0.04864335060119629, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07265934229599003, "sim_render-ego": 0.006986772312837488, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.017008374719058767, "deviation-heading": 0.6923792881687504, "set_robot_commands": 0.0045526728910558366, "deviation-center-line": 0.040683336711396914, "driven_lanedir_consec": 0.07265934229599003, "sim_compute_sim_state": 0.0027410002315745633, "sim_compute_performance-ego": 0.0037795094882740695, "sim_compute_robot_state-ego": 0.004701894872328814}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.17842511018471563, "sim_physics": 0.050284750321332145, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07335354493855029, "sim_render-ego": 0.007059335708618164, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.01721049056333654, "deviation-heading": 0.6421713752843281, "set_robot_commands": 0.00442041369045482, "deviation-center-line": 0.03913932967289021, "driven_lanedir_consec": 0.07335354493855029, "sim_compute_sim_state": 0.002787071115830365, "sim_compute_performance-ego": 0.0037529538659488455, "sim_compute_robot_state-ego": 0.004752656992743997}}
set_robot_commands_max	0.0045526728910558366
set_robot_commands_mean	0.0044647997054004605
set_robot_commands_median	0.004468180916526101
set_robot_commands_min	0.004390350409916469
sim_compute_performance-ego_max	0.0038382752736409505
sim_compute_performance-ego_mean	0.0037640898303582465
sim_compute_performance-ego_median	0.0037529538659488455
sim_compute_performance-ego_min	0.0037137595089999113
sim_compute_robot_state-ego_max	0.004803129037221273
sim_compute_robot_state-ego_mean	0.004745782783446131
sim_compute_robot_state-ego_median	0.004752656992743997
sim_compute_robot_state-ego_min	0.004674174568869851
sim_compute_sim_state_max	0.00282258669535319
sim_compute_sim_state_mean	0.0027777517177629387
sim_compute_sim_state_median	0.002780616283416748
sim_compute_sim_state_min	0.0027410002315745633
sim_physics_max	0.050284750321332145
sim_physics_mean	0.04844567213927877
sim_physics_median	0.04850476128714425
sim_physics_min	0.04650227590040727
sim_render-ego_max	0.007059335708618164
sim_render-ego_mean	0.006957517809803504
sim_render-ego_median	0.006986772312837488
sim_render-ego_min	0.00682761271794637
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	4.170000000000016
survival_time_min	1.1000000000000003

No reset possible

24475

4254

Manfred Diaz

baseline-IL-sim-tensorflow

aido3-LF-sim-validation

step1-simulation

success

ip-172-31-45-34-10500

2019-10-25 17:02:58+00:00

2019-10-25 17:10:33+00:00

0:07:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.194158524428019
survival_time_median	6.099999999999986
deviation-center-line_median	0.3093865720560372
in-drivable-lane_median	1.2999999999999954

other stats

agent_compute-ego_max	0.02474307232215756
agent_compute-ego_mean	0.02171683924124061
agent_compute-ego_median	0.021120257493926257
agent_compute-ego_min	0.019674604758620266
deviation-center-line_max	0.672070223114193
deviation-center-line_mean	0.36512769746253926
deviation-center-line_min	0.20823051558846148
deviation-heading_max	1.124905669244138
deviation-heading_mean	0.8699378228405503
deviation-heading_median	0.8884481476566415
deviation-heading_min	0.6105441939748246
driven_any_max	3.163314170456143
driven_any_mean	1.7264740435227135
driven_any_median	1.6118634330088004
driven_any_min	1.0527852195127765
driven_lanedir_consec_max	1.6806830728550897
driven_lanedir_consec_mean	1.1175232202489902
driven_lanedir_consec_min	0.6294011183520585
driven_lanedir_max	1.6806830728550897
driven_lanedir_mean	1.1211045134748634
driven_lanedir_median	1.1988846411234282
driven_lanedir_min	0.6419516587818177
in-drivable-lane_max	5.150000000000012
in-drivable-lane_mean	1.959999999999999
in-drivable-lane_min	0.6499999999999977
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1086738246237795, "sim_physics": 0.06625362606935722, "survival_time": 4.299999999999993, "driven_lanedir": 0.6419516587818177, "sim_render-ego": 0.009353213532026424, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.02216020573017209, "deviation-heading": 0.8884481476566415, "set_robot_commands": 0.00631538657254951, "deviation-center-line": 0.20823051558846148, "driven_lanedir_consec": 0.6294011183520585, "sim_compute_sim_state": 0.004084728484929994, "sim_compute_performance-ego": 0.005406759506048158, "sim_compute_robot_state-ego": 0.006661714509476063}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0527852195127765, "sim_physics": 0.06448515740836538, "survival_time": 4.099999999999993, "driven_lanedir": 0.8361844225825658, "sim_render-ego": 0.009918111126597335, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.021120257493926257, "deviation-heading": 0.7451154576756855, "set_robot_commands": 0.006617732164336414, "deviation-center-line": 0.21490247838104912, "driven_lanedir_consec": 0.8361844225825658, "sim_compute_sim_state": 0.004015224735911299, "sim_compute_performance-ego": 0.005354919084688512, "sim_compute_robot_state-ego": 0.0066781741816823075}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.163314170456143, "sim_physics": 0.06108630061661225, "survival_time": 11.65000000000003, "driven_lanedir": 1.6806830728550897, "sim_render-ego": 0.008489860485551694, "in-drivable-lane": 5.150000000000012, "agent_compute-ego": 0.020886055901326847, "deviation-heading": 1.124905669244138, "set_robot_commands": 0.005706215109436297, "deviation-center-line": 0.672070223114193, "driven_lanedir_consec": 1.6806830728550897, "sim_compute_sim_state": 0.00372099262450386, "sim_compute_performance-ego": 0.004700751775324089, "sim_compute_robot_state-ego": 0.005970914988047063}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6118634330088004, "sim_physics": 0.07972311973571777, "survival_time": 6.099999999999986, "driven_lanedir": 1.247818772031417, "sim_render-ego": 0.0102657392376759, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02474307232215756, "deviation-heading": 0.980675645651462, "set_robot_commands": 0.007410549726642546, "deviation-center-line": 0.42104869817295554, "driven_lanedir_consec": 1.247188963027218, "sim_compute_sim_state": 0.004144027584888896, "sim_compute_performance-ego": 0.0056902052926235515, "sim_compute_robot_state-ego": 0.007367757500195113}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.695733570012068, "sim_physics": 0.05771166831254959, "survival_time": 6.399999999999985, "driven_lanedir": 1.1988846411234282, "sim_render-ego": 0.00857599452137947, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.019674604758620266, "deviation-heading": 0.6105441939748246, "set_robot_commands": 0.005897538736462593, "deviation-center-line": 0.3093865720560372, "driven_lanedir_consec": 1.194158524428019, "sim_compute_sim_state": 0.003500944003462791, "sim_compute_performance-ego": 0.004737256094813347, "sim_compute_robot_state-ego": 0.00605957955121994}}
set_robot_commands_max	0.007410549726642546
set_robot_commands_mean	0.0063894844618854725
set_robot_commands_median	0.00631538657254951
set_robot_commands_min	0.005706215109436297
sim_compute_performance-ego_max	0.0056902052926235515
sim_compute_performance-ego_mean	0.005177978350699532
sim_compute_performance-ego_median	0.005354919084688512
sim_compute_performance-ego_min	0.004700751775324089
sim_compute_robot_state-ego_max	0.007367757500195113
sim_compute_robot_state-ego_mean	0.006547628146124099
sim_compute_robot_state-ego_median	0.006661714509476063
sim_compute_robot_state-ego_min	0.005970914988047063
sim_compute_sim_state_max	0.004144027584888896
sim_compute_sim_state_mean	0.003893183486739368
sim_compute_sim_state_median	0.004015224735911299
sim_compute_sim_state_min	0.003500944003462791
sim_physics_max	0.07972311973571777
sim_physics_mean	0.06585197442852045
sim_physics_median	0.06448515740836538
sim_physics_min	0.05771166831254959
sim_render-ego_max	0.0102657392376759
sim_render-ego_mean	0.009320583780646164
sim_render-ego_median	0.009353213532026424
sim_render-ego_min	0.008489860485551694
simulation-passed	1
survival_time_max	11.65000000000003
survival_time_mean	6.509999999999998
survival_time_min	4.099999999999993

No reset possible

24459

4253

Nicky Humblet

PredictorLast

aido2-PRED

step1-simulation

success

ip-172-31-45-34-10500

2019-10-25 13:07:20+00:00

2019-10-25 13:08:27+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12781667845440797
error_L2	0.02398852936147107

No reset possible

24454

4248

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LF-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-10-25 04:55:25+00:00

2019-10-25 05:00:08+00:00

0:04:43

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24450

4244

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-10-24 23:56:19+00:00

2019-10-25 00:00:36+00:00

0:04:17

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24438

4237

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

aido3-LF-sim-testing

step1-simulation

success

ip-172-31-45-34-10500

2019-10-24 17:40:28+00:00

2019-10-24 17:48:21+00:00

0:07:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.1187177598523136
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.014371178768299244
agent_compute-ego_mean	0.013917689387616231
agent_compute-ego_median	0.014088690280914308
agent_compute-ego_min	0.013247260680565469
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054906
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829773
driven_any_max	1.6839250134630204
driven_any_mean	0.7327294413370019
driven_any_median	0.7309130538792374
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.044582457609579594, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.006825591476870255, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.014107720952638438, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.004470946083606129, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.002711598302277041, "sim_compute_performance-ego": 0.003937277995364767, "sim_compute_robot_state-ego": 0.004714724043725242}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.04485301574071248, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.006772518157958984, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.013344375292460124, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.004241649309794108, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.002634720007578532, "sim_compute_performance-ego": 0.003654825687408447, "sim_compute_robot_state-ego": 0.004686049620310466}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.05146397243846546, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.006807489828629928, "in-drivable-lane": 0, "agent_compute-ego": 0.01387178897857666, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.0042276490818370475, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.002661434086886319, "sim_compute_performance-ego": 0.0036433284932916817, "sim_compute_robot_state-ego": 0.004608945413069291}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.05034396549065908, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.009154503544171652, "in-drivable-lane": 0, "agent_compute-ego": 0.014088690280914308, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.004271969199180603, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.0026978800694147744, "sim_compute_performance-ego": 0.0036782175302505498, "sim_compute_robot_state-ego": 0.0047346850236256914}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.045666596163874085, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.006862526354582414, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.013742099637570587, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.0044013365455295725, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.002684764240099036, "sim_compute_performance-ego": 0.003704698189445164, "sim_compute_robot_state-ego": 0.004654340122057044}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3217723172279551, "sim_physics": 0.052426546812057495, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.006786535183588664, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.014252940813700356, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.004258741935094197, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.0027450223763783774, "sim_compute_performance-ego": 0.0036353866259257, "sim_compute_robot_state-ego": 0.004620581865310669}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466092, "sim_physics": 0.04486993642953726, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.0067296578333928036, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.01355301416837252, "deviation-heading": 0.6586708623908945, "set_robot_commands": 0.004271036539322291, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.002654879521100949, "sim_compute_performance-ego": 0.0036916793921054937, "sim_compute_robot_state-ego": 0.004585923292698004}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048737, "sim_physics": 0.04778472440583365, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.0068799640451158795, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.014119693211146764, "deviation-heading": 0.6465417997696937, "set_robot_commands": 0.004412284919193813, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.002679356506892613, "sim_compute_performance-ego": 0.0037072854382651193, "sim_compute_robot_state-ego": 0.0046506524085998535}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0820250408860437, "sim_physics": 0.047727116223039295, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.006748202203334063, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.014115062253228549, "deviation-heading": 0.613751936282656, "set_robot_commands": 0.0042082934544004245, "deviation-center-line": 0.1187177598523136, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.002707429315852023, "sim_compute_performance-ego": 0.003655082878025099, "sim_compute_robot_state-ego": 0.004622385419648269}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630204, "sim_physics": 0.04833478277379816, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.006797458908774636, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.014303367788141425, "deviation-heading": 1.4563581054906, "set_robot_commands": 0.004262911189686168, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.0027340282093394888, "sim_compute_performance-ego": 0.0036505742506547406, "sim_compute_robot_state-ego": 0.00466282150962136}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.26677752846248903, "sim_physics": 0.05183955033620199, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.006883889436721802, "in-drivable-lane": 0, "agent_compute-ego": 0.01430937647819519, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.004310895999272664, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.0026935338973999023, "sim_compute_performance-ego": 0.003685285647710165, "sim_compute_robot_state-ego": 0.0046634574731191}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387629, "sim_physics": 0.045605492282223395, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.006749880778325068, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.014065098452877688, "deviation-heading": 0.5216992361385433, "set_robot_commands": 0.004327191934957133, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.0026712417602539062, "sim_compute_performance-ego": 0.0036679893345027774, "sim_compute_robot_state-ego": 0.004597614337871601}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.04673504829406738, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.0067418766021728515, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.013273673057556152, "deviation-heading": 0.4739455376152245, "set_robot_commands": 0.004241490364074707, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.0026555490493774415, "sim_compute_performance-ego": 0.003634190559387207, "sim_compute_robot_state-ego": 0.004536371231079101}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.05021388714130108, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.006816442196185772, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.013247260680565469, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.0043062521861149715, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.0026988983154296875, "sim_compute_performance-ego": 0.0036524992722731377, "sim_compute_robot_state-ego": 0.004631225879375751}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792374, "sim_physics": 0.04617278664200394, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.00669825518572772, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.014371178768299244, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.004247819935833967, "deviation-center-line": 0.12406277512673572, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.00263706401542381, "sim_compute_performance-ego": 0.003633472654554579, "sim_compute_robot_state-ego": 0.004572435661598488}}
set_robot_commands_max	0.004470946083606129
set_robot_commands_mean	0.00429736457852652
set_robot_commands_median	0.004271036539322291
set_robot_commands_min	0.0042082934544004245
sim_compute_performance-ego_max	0.003937277995364767
sim_compute_performance-ego_mean	0.0036821195966109752
sim_compute_performance-ego_median	0.003655082878025099
sim_compute_performance-ego_min	0.003633472654554579
sim_compute_robot_state-ego_max	0.0047346850236256914
sim_compute_robot_state-ego_mean	0.004636147553447328
sim_compute_robot_state-ego_median	0.004631225879375751
sim_compute_robot_state-ego_min	0.004536371231079101
sim_compute_sim_state_max	0.0027450223763783774
sim_compute_sim_state_mean	0.00268449331158026
sim_compute_sim_state_median	0.002684764240099036
sim_compute_sim_state_min	0.002634720007578532
sim_physics_max	0.052426546812057495
sim_physics_mean	0.04790799191889029
sim_physics_median	0.047727116223039295
sim_physics_min	0.044582457609579594
sim_render-ego_max	0.009154503544171652
sim_render-ego_mean	0.006950319449036832
sim_render-ego_median	0.006797458908774636
sim_render-ego_min	0.00669825518572772
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

24436

4234

Andrea Censi 🇨🇭

challenge-aido_LF-template-pytorch

aido3-LFV-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-10-24 17:14:10+00:00

2019-10-24 17:17:37+00:00

0:03:27

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24417

4228

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFVI-sim-validation

step1-simulation

failed

ip-172-31-45-34-10500

2019-10-24 06:36:32+00:00

2019-10-24 06:37:25+00:00

0:00:53

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24409

4217

Manfred Diaz

Baseline-IL-logs-tensorflow

aido3-LFV-sim-testing

step1-simulation

failed

ip-172-31-45-34-10500

2019-10-24 06:26:51+00:00

2019-10-24 06:30:31+00:00

0:03:40

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24402

4209

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LFV-sim-testing

step1-simulation

failed

ip-172-31-45-34-10500

2019-10-24 04:56:00+00:00

2019-10-24 04:59:26+00:00

0:03:26

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24393

4204

Manfred Diaz

challenge-aido_LF-template-tensorflow

aido3-LFVI-sim-validation

step1-simulation

error

ip-172-31-45-34-10500

2019-10-24 03:38:22+00:00

2019-10-24 03:41:56+00:00

0:03:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24387

4194

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LF-sim-testing

step1-simulation

host-error

ip-172-31-45-34-10500

2019-10-23 20:54:17+00:00

2019-10-23 20:54:33+00:00

0:00:16

Error while running [...]


stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... 
stderr | Pulling solution       ... done
stderr | 
stderr | ERROR: for scenario_maker  error pulling image configuration: Get https://docker-images-prod.s3.amazonaws.com/registry-v2/docker/registry/v2/blobs/sha256/14/144b2b41f0f3aba8d57d616c2285b894d166df2311cc64da75759e0b4db0b5b2/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIA2KUBRXV6MFSIWI2W%2F20191023%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20191023T205419Z&X-Amz-Expires=1200&X-Amz-Security-Token=AgoJb3JpZ2luX2VjEA8aCXVzLWVhc3QtMSJIMEYCIQDjJ450whBwYBhpVyS1lurMTt3j6L5u1Siz75hKr9KFuQIhAOK7751zcQm4FstNy5Tsc%2F9yBSxSgRmY5EJbMvCPtpXQKtoDCBgQABoMNzEwMDE1MDQwODkyIgzxEVEutQujx7C2%2FvkqtwNq70maslPhNcwnx55uHyf61LhXpd9PYQMwZLqlnbUjpjkpASywOtacN8rCbPYGqwL4MqtJI7Bxgz4Bfnb147oj5BA6xzoA%2BKDmULU2JLUH5Pf5TP6KbiJT1iP77ugkuL24Ag4RcuPfAFuucHWBKJ5IwP1hnyYCp06Pn8LgCXU4CeAZ8cqnrGhCM4trnwhi8NQD88qJQeRQXnlrF0I8e5D9T21bC3SoFRcMfJ6l%2FP%2FtAyKlJN244DKQ7RNCuap%2B2HyV4%2FKqxHW1KiBLyYw1g4l00qEtZ1VDK%2Bh%2FbufJhUPlVq7p8%2FLRWnAdNk0ECi3ds3n3xMkNPMbZI1j8kBeMKcr%2BxRElLfL0KDV1n5EVrecm1wnTLr9KFO7Dj8i3m1UXdtubRuK%2B%2BO8CsIe48v3DPhNvqd4QV%2FoqoqtUqoIbX9L2oEzNbjbWGjhiPyhuK2nPax0hC%2FdwFI5320mvUcgMi%2B3R%2F3kzPSne1cZJVnYh7xEj84zsOo9FYgQJ4mf4PkvcJ%2F9sQBPTtb41q6abHWh22ckl3YW2njaTs8jQqo%2FfLTDU3tMAyl85tMVc%2BsNpYjwZTm2SjbSdfCTiMOrWwe0FOrMBER8eAu5r85JT%2Bk3%2BJDVNoXNzEN13s4%2FX0%2FrafhSmgEoqP%2B6DoRwGJgHw%2F2wwgWVXs5Uri8sBjNQaFbllnzpbF4wbOEwGfWPzbTWssh5AVtjhyffZ5AIpufSlGuthzHDFIHpEdAylDiI%2FUPoEx63MCkC4EcSnPhaR5gJMAL%2BD6kO42vrkUsBJy724GW9H8pHpClQ1WuuKJ9Xd6X%2BAwB3JdbKpRUWKBDRSlULRqfmLxqsQuVo%3D&X-Amz-SignedHeaders=host&X-Amz-Signature=b7590648bc1ecac36ee9df77ee1468b1af3f43af1dd082aaf844bea79ec1a242: net/http: TLS handshake timeout
stderr | error pulling image configuration: Get https://docker-images-prod.s3.amazonaws.com/registry-v2/docker/registry/v2/blobs/sha256/14/144b2b41f0f3aba8d57d616c2285b894d166df2311cc64da75759e0b4db0b5b2/data?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIA2KUBRXV6MFSIWI2W%2F20191023%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20191023T205419Z&X-Amz-Expires=1200&X-Amz-Security-Token=AgoJb3JpZ2luX2VjEA8aCXVzLWVhc3QtMSJIMEYCIQDjJ450whBwYBhpVyS1lurMTt3j6L5u1Siz75hKr9KFuQIhAOK7751zcQm4FstNy5Tsc%2F9yBSxSgRmY5EJbMvCPtpXQKtoDCBgQABoMNzEwMDE1MDQwODkyIgzxEVEutQujx7C2%2FvkqtwNq70maslPhNcwnx55uHyf61LhXpd9PYQMwZLqlnbUjpjkpASywOtacN8rCbPYGqwL4MqtJI7Bxgz4Bfnb147oj5BA6xzoA%2BKDmULU2JLUH5Pf5TP6KbiJT1iP77ugkuL24Ag4RcuPfAFuucHWBKJ5IwP1hnyYCp06Pn8LgCXU4CeAZ8cqnrGhCM4trnwhi8NQD88qJQeRQXnlrF0I8e5D9T21bC3SoFRcMfJ6l%2FP%2FtAyKlJN244DKQ7RNCuap%2B2HyV4%2FKqxHW1KiBLyYw1g4l00qEtZ1VDK%2Bh%2FbufJhUPlVq7p8%2FLRWnAdNk0ECi3ds3n3xMkNPMbZI1j8kBeMKcr%2BxRElLfL0KDV1n5EVrecm1wnTLr9KFO7Dj8i3m1UXdtubRuK%2B%2BO8CsIe48v3DPhNvqd4QV%2FoqoqtUqoIbX9L2oEzNbjbWGjhiPyhuK2nPax0hC%2FdwFI5320mvUcgMi%2B3R%2F3kzPSne1cZJVnYh7xEj84zsOo9FYgQJ4mf4PkvcJ%2F9sQBPTtb41q6abHWh22ckl3YW2njaTs8jQqo%2FfLTDU3tMAyl85tMVc%2BsNpYjwZTm2SjbSdfCTiMOrWwe0FOrMBER8eAu5r85JT%2Bk3%2BJDVNoXNzEN13s4%2FX0%2FrafhSmgEoqP%2B6DoRwGJgHw%2F2wwgWVXs5Uri8sBjNQaFbllnzpbF4wbOEwGfWPzbTWssh5AVtjhyffZ5AIpufSlGuthzHDFIHpEdAylDiI%2FUPoEx63MCkC4EcSnPhaR5gJMAL%2BD6kO42vrkUsBJy724GW9H8pHpClQ1WuuKJ9Xd6X%2BAwB3JdbKpRUWKBDRSlULRqfmLxqsQuVo%3D&X-Amz-SignedHeaders=host&X-Amz-Signature=b7590648bc1ecac36ee9df77ee1468b1af3f43af1dd082aaf844bea79ec1a242: net/http: TLS handshake timeout
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24365

4183

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

aido3-LFVI-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-10-23 16:53:52+00:00

2019-10-23 16:57:14+00:00

0:03:22

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24359

4174

Bhairav Mehta

challenge-aido_LF-template-pytorch

aido3-LFV-sim-validation

step1-simulation

failed

ip-172-31-45-34-10500

2019-10-21 23:19:16+00:00

2019-10-21 23:22:12+00:00

0:02:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24349

4165

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

aido3-LFV-sim-testing

step1-simulation

error

ip-172-31-45-34-10500

2019-10-21 14:48:08+00:00

2019-10-21 15:00:10+00:00

0:12:02

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible