Evaluator 1298

step1-simulation

error

yes

2019-05-21 20:22:17+00:00

2019-05-21 21:01:40+00:00

0:39:23

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23676

3716

jiang peng

Second test -RGB- TH-jp

step1-simulation

failed

yes

2019-05-21 14:45:28+00:00

2019-05-21 14:46:57+00:00

0:01:29

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23573

3687

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

step1-simulation

success

yes

2019-05-20 17:03:21+00:00

2019-05-20 17:52:10+00:00

0:48:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6950573847640089
survival_time_median	14.950000000000076
deviation-center-line_median	0.307138938696771
in-drivable-lane_median	7.200000000000037

other stats

agent_compute-ego_max	0.23721035003662108
agent_compute-ego_mean	0.23668865002526177
agent_compute-ego_median	0.23683757623036705
agent_compute-ego_min	0.23561009486516316
deviation-center-line_max	0.7441993675765441
deviation-center-line_mean	0.36818899156986545
deviation-center-line_min	0.10083546877568052
deviation-heading_max	5.990117020581061
deviation-heading_mean	5.896451626677996
deviation-heading_median	5.9380236931489225
deviation-heading_min	5.613995197946513
driven_any_max	2.1853065485311514
driven_any_mean	2.1853065485311425
driven_any_median	2.1853065485311416
driven_any_min	2.1853065485311323
driven_lanedir_consec_max	0.6964859913423234
driven_lanedir_consec_mean	0.694822873038991
driven_lanedir_consec_min	0.6925369611104519
driven_lanedir_max	0.6964859913423234
driven_lanedir_mean	0.694822873038991
driven_lanedir_median	0.6950573847640089
driven_lanedir_min	0.6925369611104519
in-drivable-lane_max	7.400000000000038
in-drivable-lane_mean	7.236666666666703
in-drivable-lane_min	7.200000000000037
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.05540801445643107, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.03698193152745565, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.23683757623036705, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.05495564381281535, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.024101943969726564, "sim_compute_performance-ego": 0.040296319325764975, "sim_compute_robot_state-ego": 0.04209806362787882}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.05653468688329061, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.037351961930592856, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23676480372746783, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.05517516215642293, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.024076714515686035, "sim_compute_performance-ego": 0.040464489459991454, "sim_compute_robot_state-ego": 0.04233774264653524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.05321986198425293, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.03681208690007528, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.2370089077949524, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.0544206706682841, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.024102057615915936, "sim_compute_performance-ego": 0.04041594346364339, "sim_compute_robot_state-ego": 0.04165962855021159}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.055453038215637206, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.03716473340988159, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23699439684549967, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05555543661117554, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.02432903289794922, "sim_compute_performance-ego": 0.040550702412923176, "sim_compute_robot_state-ego": 0.04204116264979045}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.05490198055903117, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.03692545970280965, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2369475213686625, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.0548666787147522, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.02398018995920817, "sim_compute_performance-ego": 0.04082356214523315, "sim_compute_robot_state-ego": 0.041719214121500654}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.1853065485311394, "sim_physics": 0.05635195096333822, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957599080131578, "sim_render-ego": 0.03729402462641398, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.23721035003662108, "deviation-heading": 5.818542702573388, "set_robot_commands": 0.05534505287806193, "deviation-center-line": 0.7441993675765441, "driven_lanedir_consec": 0.6957599080131578, "sim_compute_sim_state": 0.02426735719045003, "sim_compute_performance-ego": 0.04018746614456177, "sim_compute_robot_state-ego": 0.042279125054677326}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.185306548531151, "sim_physics": 0.058723700841267906, "survival_time": 14.950000000000076, "driven_lanedir": 0.6947112112972071, "sim_render-ego": 0.036991956233978274, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2369151457150777, "deviation-heading": 5.9347088906542345, "set_robot_commands": 0.05465580940246582, "deviation-center-line": 0.21723026496478212, "driven_lanedir_consec": 0.6947112112972071, "sim_compute_sim_state": 0.024090518951416017, "sim_compute_performance-ego": 0.039801987012227376, "sim_compute_robot_state-ego": 0.042444509665171305}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.1853065485311323, "sim_physics": 0.05456495443979899, "survival_time": 14.950000000000076, "driven_lanedir": 0.6954494436503662, "sim_render-ego": 0.036432549953460694, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2360766800244649, "deviation-heading": 5.951584056210216, "set_robot_commands": 0.05435362259546916, "deviation-center-line": 0.26967879357000285, "driven_lanedir_consec": 0.6954494436503662, "sim_compute_sim_state": 0.023977265357971192, "sim_compute_performance-ego": 0.04027249018351237, "sim_compute_robot_state-ego": 0.04236126820246378}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.185306548531139, "sim_physics": 0.05507463216781616, "survival_time": 14.950000000000076, "driven_lanedir": 0.6951211993980144, "sim_render-ego": 0.03688037395477295, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23631850719451905, "deviation-heading": 5.9380236931489225, "set_robot_commands": 0.05519824028015137, "deviation-center-line": 0.19127509329278516, "driven_lanedir_consec": 0.6951211993980144, "sim_compute_sim_state": 0.02394600788752238, "sim_compute_performance-ego": 0.039985068639119464, "sim_compute_robot_state-ego": 0.04210440317789713}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.185306548531147, "sim_physics": 0.054854060808817544, "survival_time": 14.950000000000076, "driven_lanedir": 0.6957742227582209, "sim_render-ego": 0.036839893658955895, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2371842900911967, "deviation-heading": 5.84542238624642, "set_robot_commands": 0.05441298961639404, "deviation-center-line": 0.13803594115198106, "driven_lanedir_consec": 0.6957742227582209, "sim_compute_sim_state": 0.02428417444229126, "sim_compute_performance-ego": 0.04047910213470459, "sim_compute_robot_state-ego": 0.04215747435887655}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.1853065485311443, "sim_physics": 0.05530855337778727, "survival_time": 14.950000000000076, "driven_lanedir": 0.6925369611104519, "sim_render-ego": 0.03663061698277791, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23694254398345949, "deviation-heading": 5.954990711277449, "set_robot_commands": 0.05444358269373576, "deviation-center-line": 0.30943438450656163, "driven_lanedir_consec": 0.6925369611104519, "sim_compute_sim_state": 0.02409991582234701, "sim_compute_performance-ego": 0.041022329330444335, "sim_compute_robot_state-ego": 0.04184239069620768}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.1853065485311416, "sim_physics": 0.05632275501887003, "survival_time": 14.950000000000076, "driven_lanedir": 0.6949038747368048, "sim_render-ego": 0.03682883103688558, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.2363297462463379, "deviation-heading": 5.860593780739516, "set_robot_commands": 0.05514081796010335, "deviation-center-line": 0.10083546877568052, "driven_lanedir_consec": 0.6949038747368048, "sim_compute_sim_state": 0.02405474106470744, "sim_compute_performance-ego": 0.04058392922083537, "sim_compute_robot_state-ego": 0.04217564264933269}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.185306548531148, "sim_physics": 0.055737411181132, "survival_time": 14.950000000000076, "driven_lanedir": 0.6952620692692497, "sim_render-ego": 0.03620652914047241, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2365825978914897, "deviation-heading": 5.922408824528451, "set_robot_commands": 0.05512197971343994, "deviation-center-line": 0.5431694946909088, "driven_lanedir_consec": 0.6952620692692497, "sim_compute_sim_state": 0.023713927268981933, "sim_compute_performance-ego": 0.04018219312032064, "sim_compute_robot_state-ego": 0.04159367481867472}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.185306548531144, "sim_physics": 0.05142515659332275, "survival_time": 14.950000000000076, "driven_lanedir": 0.6941725425290013, "sim_render-ego": 0.03642830928166707, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23561009486516316, "deviation-heading": 5.949714932679345, "set_robot_commands": 0.05410462697347005, "deviation-center-line": 0.17004088680976326, "driven_lanedir_consec": 0.6941725425290013, "sim_compute_sim_state": 0.023550658226013182, "sim_compute_performance-ego": 0.03999435424804688, "sim_compute_robot_state-ego": 0.04115627447764079}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1853065485311363, "sim_physics": 0.05076943000157674, "survival_time": 14.950000000000076, "driven_lanedir": 0.6940085325942875, "sim_render-ego": 0.0364530865351359, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.23660658836364745, "deviation-heading": 5.948883981105356, "set_robot_commands": 0.05396711508433024, "deviation-center-line": 0.4328281184579712, "driven_lanedir_consec": 0.6940085325942875, "sim_compute_sim_state": 0.023842470645904543, "sim_compute_performance-ego": 0.039710747400919594, "sim_compute_robot_state-ego": 0.041542232036590576}}
set_robot_commands_max	0.05555543661117554
set_robot_commands_mean	0.054781161944071455
set_robot_commands_median	0.0548666787147522
set_robot_commands_min	0.05396711508433024
sim_compute_performance-ego_max	0.041022329330444335
sim_compute_performance-ego_mean	0.0403180456161499
sim_compute_performance-ego_median	0.040296319325764975
sim_compute_performance-ego_min	0.039710747400919594
sim_compute_robot_state-ego_max	0.042444509665171305
sim_compute_robot_state-ego_mean	0.04196752044889662
sim_compute_robot_state-ego_median	0.04209806362787882
sim_compute_robot_state-ego_min	0.04115627447764079
sim_compute_sim_state_max	0.02432903289794922
sim_compute_sim_state_mean	0.024027798387739396
sim_compute_sim_state_median	0.024076714515686035
sim_compute_sim_state_min	0.023550658226013182
sim_physics_max	0.058723700841267906
sim_physics_mean	0.05497667916615803
sim_physics_median	0.05530855337778727
sim_physics_min	0.05076943000157674
sim_render-ego_max	0.037351961930592856
sim_render-ego_mean	0.03681482299168905
sim_render-ego_median	0.036839893658955895
sim_render-ego_min	0.03620652914047241
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

23567

3687

Tony Hsu 🇹🇼

Baseline solution using reinforcement learning

step1-simulation

timeout

yes

aido2-LFVI-sim-validation

2019-05-20 16:25:14+00:00

2019-05-20 17:02:35+00:00

0:37:21

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23517

3665

FANG MEIYI 🇸🇬

test

step1-simulation

error

yes

2019-05-20 08:41:33+00:00

2019-05-20 09:00:36+00:00

0:19:03

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23474

3656

jiang peng

RL-TH-xyz

step1-simulation

host-error

yes

2019-05-20 04:59:41+00:00

2019-05-20 05:00:23+00:00

0:00:42

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3656/step1-simulation-ip-172-31-40-253-16443-job23474': '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3656/step1-simulation-ip-172-31-40-253-16443-job23474'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23460

3652

FANG MEIYI 🇸🇬

test

aido2-LFV-sim-testing

step1-simulation

error

yes

aido2-LFV-sim-validation

2019-05-20 03:20:12+00:00

2019-05-20 04:00:13+00:00

0:40:01

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23393

3630

Nicky Eichmann

step1-simulation

success

yes

2019-05-19 18:33:36+00:00

2019-05-19 18:43:15+00:00

0:09:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6697553564194623
survival_time_median	3.999999999999994
deviation-center-line_median	0.16228261327146776
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.10102930665016174
agent_compute-ego_mean	0.10030368906730153
agent_compute-ego_median	0.10012105107307434
agent_compute-ego_min	0.09989489316940307
deviation-center-line_max	0.512915375271305
deviation-center-line_mean	0.24345692255887
deviation-center-line_min	0.06073337098493198
deviation-heading_max	3.5766827836398773
deviation-heading_mean	1.5872827986791844
deviation-heading_median	0.3984686189931251
deviation-heading_min	0.2638670899443274
driven_any_max	2.2031243131939977
driven_any_mean	1.3100875604799749
driven_any_median	1.6209092387737205
driven_any_min	0.400811386017316
driven_lanedir_consec_max	1.2262010153072178
driven_lanedir_consec_mean	0.7688536698833344
driven_lanedir_consec_min	0.3869401393359331
driven_lanedir_max	2.005960546694184
driven_lanedir_mean	1.0957456613562246
driven_lanedir_median	1.1362676253235442
driven_lanedir_min	0.3869401393359331
in-drivable-lane_max	3.9000000000000097
in-drivable-lane_mean	1.5099999999999991
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.8758380796837184, "sim_physics": 0.08624497743753287, "survival_time": 10.400000000000013, "driven_lanedir": 1.5244557823969478, "sim_render-ego": 0.03673926339699672, "in-drivable-lane": 3.9000000000000097, "agent_compute-ego": 0.10043592636401837, "deviation-heading": 3.4104173335011674, "set_robot_commands": 0.056047023488925055, "deviation-center-line": 0.512915375271305, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.023496259863560017, "sim_compute_performance-ego": 0.040227716931929954, "sim_compute_robot_state-ego": 0.04192592088992779, "sim_compute_robot_state-npc0": 0.04177339833516341, "sim_compute_robot_state-npc1": 0.04078611502280602, "sim_compute_robot_state-npc2": 0.04035302423513853, "sim_compute_robot_state-npc3": 0.040471478150441095}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4497547847311213, "sim_physics": 0.10330170392990112, "survival_time": 1.2000000000000004, "driven_lanedir": 0.42510421303051427, "sim_render-ego": 0.03676355878512064, "in-drivable-lane": 0, "agent_compute-ego": 0.10012105107307434, "deviation-heading": 0.3984686189931251, "set_robot_commands": 0.054285953442255654, "deviation-center-line": 0.09297933544283107, "driven_lanedir_consec": 0.42510421303051427, "sim_compute_sim_state": 0.02291812499364217, "sim_compute_performance-ego": 0.04075401027997335, "sim_compute_robot_state-ego": 0.042757898569107056, "sim_compute_robot_state-npc0": 0.04181105891863505, "sim_compute_robot_state-npc1": 0.04056483507156372, "sim_compute_robot_state-npc2": 0.03957482179005941, "sim_compute_robot_state-npc3": 0.04103253285090128}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6209092387737205, "sim_physics": 0.0885932445526123, "survival_time": 3.999999999999994, "driven_lanedir": 1.1362676253235442, "sim_render-ego": 0.03660239577293396, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.10102930665016174, "deviation-heading": 0.2869781673174241, "set_robot_commands": 0.05589191317558288, "deviation-center-line": 0.16228261327146776, "driven_lanedir_consec": 1.1362676253235442, "sim_compute_sim_state": 0.02301382124423981, "sim_compute_performance-ego": 0.039711830019950864, "sim_compute_robot_state-ego": 0.04173339009284973, "sim_compute_robot_state-npc0": 0.040979033708572386, "sim_compute_robot_state-npc1": 0.04025131762027741, "sim_compute_robot_state-npc2": 0.040200090408325194, "sim_compute_robot_state-npc3": 0.0393524706363678}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.2031243131939977, "sim_physics": 0.09033308680362112, "survival_time": 11.350000000000026, "driven_lanedir": 2.005960546694184, "sim_render-ego": 0.03633827680008002, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.10003726807985013, "deviation-heading": 3.5766827836398773, "set_robot_commands": 0.0559680966028558, "deviation-center-line": 0.3883739178238141, "driven_lanedir_consec": 1.2262010153072178, "sim_compute_sim_state": 0.02320155068116041, "sim_compute_performance-ego": 0.04003089009927758, "sim_compute_robot_state-ego": 0.04180543643262418, "sim_compute_robot_state-npc0": 0.041622429692272575, "sim_compute_robot_state-npc1": 0.04041679630195517, "sim_compute_robot_state-npc2": 0.040392414588760174, "sim_compute_robot_state-npc3": 0.0401804321137819}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.400811386017316, "sim_physics": 0.09400545358657836, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3869401393359331, "sim_render-ego": 0.03614261150360107, "in-drivable-lane": 0, "agent_compute-ego": 0.09989489316940307, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.05563539266586304, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3869401393359331, "sim_compute_sim_state": 0.02250063419342041, "sim_compute_performance-ego": 0.03968029022216797, "sim_compute_robot_state-ego": 0.04216578006744385, "sim_compute_robot_state-npc0": 0.04121485948562622, "sim_compute_robot_state-npc1": 0.040969443321228025, "sim_compute_robot_state-npc2": 0.03986095190048218, "sim_compute_robot_state-npc3": 0.03958117961883545}}
set_robot_commands_max	0.056047023488925055
set_robot_commands_mean	0.05556567587509649
set_robot_commands_median	0.05589191317558288
set_robot_commands_min	0.054285953442255654
sim_compute_performance-ego_max	0.04075401027997335
sim_compute_performance-ego_mean	0.04008094751065995
sim_compute_performance-ego_median	0.04003089009927758
sim_compute_performance-ego_min	0.03968029022216797
sim_compute_robot_state-ego_max	0.042757898569107056
sim_compute_robot_state-ego_mean	0.04207768521039052
sim_compute_robot_state-ego_median	0.04192592088992779
sim_compute_robot_state-ego_min	0.04173339009284973
sim_compute_robot_state-npc0_max	0.04181105891863505
sim_compute_robot_state-npc0_mean	0.04148015602805393
sim_compute_robot_state-npc0_median	0.041622429692272575
sim_compute_robot_state-npc0_min	0.040979033708572386
sim_compute_robot_state-npc1_max	0.040969443321228025
sim_compute_robot_state-npc1_mean	0.04059770146756607
sim_compute_robot_state-npc1_median	0.04056483507156372
sim_compute_robot_state-npc1_min	0.04025131762027741
sim_compute_robot_state-npc2_max	0.040392414588760174
sim_compute_robot_state-npc2_mean	0.04007626058455309
sim_compute_robot_state-npc2_median	0.040200090408325194
sim_compute_robot_state-npc2_min	0.03957482179005941
sim_compute_robot_state-npc3_max	0.04103253285090128
sim_compute_robot_state-npc3_mean	0.04012361867406551
sim_compute_robot_state-npc3_median	0.0401804321137819
sim_compute_robot_state-npc3_min	0.0393524706363678
sim_compute_sim_state_max	0.023496259863560017
sim_compute_sim_state_mean	0.02302607819520456
sim_compute_sim_state_median	0.02301382124423981
sim_compute_sim_state_min	0.02250063419342041
sim_physics_max	0.10330170392990112
sim_physics_mean	0.09249569326204916
sim_physics_median	0.09033308680362112
sim_physics_min	0.08624497743753287
sim_render-ego_max	0.03676355878512064
sim_render-ego_mean	0.03651722125174649
sim_render-ego_median	0.03660239577293396
sim_render-ego_min	0.03614261150360107
simulation-passed	1
survival_time_max	11.350000000000026
survival_time_mean	5.590000000000007
survival_time_min	1.0000000000000002

No reset possible

23368

3615

jiang peng

Fourth test - TH

step1-simulation

failed

yes

aido2-LFV-sim-validation

2019-05-19 14:19:14+00:00

2019-05-19 14:20:37+00:00

0:01:23

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 41, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 11, in preprocess
               ||     new_obs = imresize(new_obs, self.shape).transpose(2, 0, 1)
               || UnboundLocalError: local variable 'new_obs' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23364

3610

Riza Velioglu 🇩🇪

step1-simulation

error

yes

2019-05-19 11:55:32+00:00

2019-05-19 12:02:24+00:00

0:06:52

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23323

3594

Victor Adolfo Romero Cano 🇨🇴

step1-simulation

success

yes

2019-05-18 16:27:37+00:00

2019-05-18 16:41:59+00:00

0:14:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.16378140449523926
agent_compute-ego_mean	0.1389357533677124
agent_compute-ego_median	0.1448869624380338
agent_compute-ego_min	0.11462607631435642
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11586431662241618, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06266359046653465, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1607568484765512, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10414248042636448, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03923052328604239, "sim_compute_performance-ego": 0.07365499160907886, "sim_compute_robot_state-ego": 0.08111370492864538}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11372776592479032, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06521427865121879, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16378140449523926, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1022806448094985, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.042386742199168485, "sim_compute_performance-ego": 0.07575200118270575, "sim_compute_robot_state-ego": 0.08354442259844612}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11981867341434256, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06183620060191435, "in-drivable-lane": 0, "agent_compute-ego": 0.1573303447050207, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.1056507615482106, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.040575167712043315, "sim_compute_performance-ego": 0.07328597237082089, "sim_compute_robot_state-ego": 0.08466175023247213}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11018988609313964, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06116747856140137, "in-drivable-lane": 0, "agent_compute-ego": 0.13926164627075197, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08912125587463379, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03660594940185547, "sim_compute_performance-ego": 0.06280479431152344, "sim_compute_robot_state-ego": 0.06606741905212403}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10912308511854726, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06404248370399958, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1538840668110908, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.1003370043597644, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.039253826382793955, "sim_compute_performance-ego": 0.06913390944275676, "sim_compute_robot_state-ego": 0.074479112142249}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.11591140591368385, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06214986042100556, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15201468856967226, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09371954081009844, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03902973447527204, "sim_compute_performance-ego": 0.06673169622615892, "sim_compute_robot_state-ego": 0.07284184864589147}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10696581857545036, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06351179310253688, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1595968987260546, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10297516414097375, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03888000760759626, "sim_compute_performance-ego": 0.07056780798094613, "sim_compute_robot_state-ego": 0.07417540890829903}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.11412987254914785, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.05784315154665992, "in-drivable-lane": 0, "agent_compute-ego": 0.15192403112139022, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10200499352954684, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03762314433143253, "sim_compute_performance-ego": 0.06025020281473795, "sim_compute_robot_state-ego": 0.06956241244361513}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.09917624117964403, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.059599739010051146, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1448869624380338, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09227264533608646, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03643732555841995, "sim_compute_performance-ego": 0.06572489415184926, "sim_compute_robot_state-ego": 0.07117536108372575}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.0844983924518932, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.046777140010486946, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.11976810802112926, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.07207276604392311, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.031127734617753464, "sim_compute_performance-ego": 0.0523488694971258, "sim_compute_robot_state-ego": 0.05546910112554377}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.07648963432807426, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.04613266053137841, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.11462607631435642, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.07119097028459821, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.029626056745454862, "sim_compute_performance-ego": 0.050407939142995066, "sim_compute_robot_state-ego": 0.05326927172673213}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.07933522122246879, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.0487974796976362, "in-drivable-lane": 0, "agent_compute-ego": 0.11557383196694512, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.06946768930980138, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.032002363886152, "sim_compute_performance-ego": 0.051994962351662774, "sim_compute_robot_state-ego": 0.05205708742141723}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.08101258090898103, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.046439657024308745, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.11674254548315909, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.08029543184766583, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.02917202313741048, "sim_compute_performance-ego": 0.052576728895598765, "sim_compute_robot_state-ego": 0.05772572405198041}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.08803394105699328, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.04589918807700828, "in-drivable-lane": 0, "agent_compute-ego": 0.11633930382905185, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.07016210202817563, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.02942687493783456, "sim_compute_performance-ego": 0.05328381503069842, "sim_compute_robot_state-ego": 0.05323163668314616}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.07655374209086101, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.04608458397435207, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.11754954328723982, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.07157415735955332, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03004852696961048, "sim_compute_performance-ego": 0.050283684450037336, "sim_compute_robot_state-ego": 0.055176590003219304}}
set_robot_commands_max	0.1056507615482106
set_robot_commands_mean	0.08848450718059299
set_robot_commands_median	0.09227264533608646
set_robot_commands_min	0.06946768930980138
sim_compute_performance-ego_max	0.07575200118270575
sim_compute_performance-ego_mean	0.061920151297246394
sim_compute_performance-ego_median	0.06280479431152344
sim_compute_performance-ego_min	0.050283684450037336
sim_compute_robot_state-ego_max	0.08466175023247213
sim_compute_robot_state-ego_mean	0.06697005673650049
sim_compute_robot_state-ego_median	0.06956241244361513
sim_compute_robot_state-ego_min	0.05205708742141723
sim_compute_sim_state_max	0.042386742199168485
sim_compute_sim_state_mean	0.03542840008325601
sim_compute_sim_state_median	0.03660594940185547
sim_compute_sim_state_min	0.02917202313741048
sim_physics_max	0.11981867341434256
sim_physics_mean	0.09938870516336223
sim_physics_median	0.10696581857545036
sim_physics_min	0.07648963432807426
sim_render-ego_max	0.06521427865121879
sim_render-ego_mean	0.05587728569203286
sim_render-ego_median	0.059599739010051146
sim_render-ego_min	0.04589918807700828
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

23299

3062

Andrea Censi 🇨🇭

rotation

aido2-LFVI-sim-testing

step1-simulation

error

yes

2019-05-17 20:51:00+00:00

2019-05-17 21:00:17+00:00

0:09:17

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

23257

3579

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

success

yes

2019-05-17 20:03:46+00:00

2019-05-17 20:10:28+00:00

0:06:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.35964936354402743
survival_time_median	3.7499999999999942
deviation-center-line_median	0.21369280827834236
in-drivable-lane_median	0.09999999999999964

other stats

agent_compute-ego_max	0.12546940203066226
agent_compute-ego_mean	0.124067285767308
agent_compute-ego_median	0.12429789225260417
agent_compute-ego_min	0.12141933441162107
deviation-center-line_max	0.602825889465949
deviation-center-line_mean	0.28392538327241146
deviation-center-line_min	0.1763305212072711
deviation-heading_max	1.689150181220063
deviation-heading_mean	1.26813486365273
deviation-heading_median	1.416197518225926
deviation-heading_min	0.7611793338297212
driven_any_max	1.3831469253346158
driven_any_mean	0.5791650263425614
driven_any_median	0.4056509748999866
driven_any_min	0.19612248687407408
driven_lanedir_consec_max	1.370268665309784
driven_lanedir_consec_mean	0.5373415502934475
driven_lanedir_consec_min	0.1708785597652276
driven_lanedir_max	1.370268665309784
driven_lanedir_mean	0.5373415502934475
driven_lanedir_median	0.35964936354402743
driven_lanedir_min	0.1708785597652276
in-drivable-lane_max	0.34999999999999876
in-drivable-lane_mean	0.11999999999999962
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3831469253346158, "sim_physics": 0.05666283369064331, "survival_time": 14.950000000000076, "driven_lanedir": 1.370268665309784, "sim_render-ego": 0.03658902883529663, "in-drivable-lane": 0, "agent_compute-ego": 0.1242510469754537, "deviation-heading": 1.689150181220063, "set_robot_commands": 0.05588979800542196, "deviation-center-line": 0.602825889465949, "driven_lanedir_consec": 1.370268665309784, "sim_compute_sim_state": 0.023737999598185223, "sim_compute_performance-ego": 0.03941260814666748, "sim_compute_robot_state-ego": 0.04160643657048543}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6492915727513868, "sim_physics": 0.053681620845088256, "survival_time": 6.749999999999984, "driven_lanedir": 0.581907550414042, "sim_render-ego": 0.035763129481562864, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.12546940203066226, "deviation-heading": 1.443927327685942, "set_robot_commands": 0.05469828181796604, "deviation-center-line": 0.24647139442140037, "driven_lanedir_consec": 0.581907550414042, "sim_compute_sim_state": 0.0235867147092466, "sim_compute_performance-ego": 0.03958906597561306, "sim_compute_robot_state-ego": 0.041950550785771125}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19612248687407408, "sim_physics": 0.05361342430114746, "survival_time": 2.000000000000001, "driven_lanedir": 0.1708785597652276, "sim_render-ego": 0.035152167081832886, "in-drivable-lane": 0.09999999999999988, "agent_compute-ego": 0.12141933441162107, "deviation-heading": 0.7611793338297212, "set_robot_commands": 0.05642997026443482, "deviation-center-line": 0.21369280827834236, "driven_lanedir_consec": 0.1708785597652276, "sim_compute_sim_state": 0.023167335987091062, "sim_compute_performance-ego": 0.04015628695487976, "sim_compute_robot_state-ego": 0.04089636802673339}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2616131718527433, "sim_physics": 0.05855499744415283, "survival_time": 2.499999999999999, "driven_lanedir": 0.20400361243415643, "sim_render-ego": 0.036834392547607425, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12489875316619874, "deviation-heading": 1.416197518225926, "set_robot_commands": 0.05662423610687256, "deviation-center-line": 0.1763305212072711, "driven_lanedir_consec": 0.20400361243415643, "sim_compute_sim_state": 0.023081822395324705, "sim_compute_performance-ego": 0.0415396785736084, "sim_compute_robot_state-ego": 0.0418822431564331}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4056509748999866, "sim_physics": 0.056918125152587894, "survival_time": 3.7499999999999942, "driven_lanedir": 0.35964936354402743, "sim_render-ego": 0.037020362218221026, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.12429789225260417, "deviation-heading": 1.0302199573019963, "set_robot_commands": 0.05747590700785319, "deviation-center-line": 0.18030630298909445, "driven_lanedir_consec": 0.35964936354402743, "sim_compute_sim_state": 0.02998043696085612, "sim_compute_performance-ego": 0.03950153668721517, "sim_compute_robot_state-ego": 0.04115680694580078}}
set_robot_commands_max	0.05747590700785319
set_robot_commands_mean	0.05622363864050972
set_robot_commands_median	0.05642997026443482
set_robot_commands_min	0.05469828181796604
sim_compute_performance-ego_max	0.0415396785736084
sim_compute_performance-ego_mean	0.040039835267596774
sim_compute_performance-ego_median	0.03958906597561306
sim_compute_performance-ego_min	0.03941260814666748
sim_compute_robot_state-ego_max	0.041950550785771125
sim_compute_robot_state-ego_mean	0.041498481097044765
sim_compute_robot_state-ego_median	0.04160643657048543
sim_compute_robot_state-ego_min	0.04089636802673339
sim_compute_sim_state_max	0.02998043696085612
sim_compute_sim_state_mean	0.02471086193014074
sim_compute_sim_state_median	0.0235867147092466
sim_compute_sim_state_min	0.023081822395324705
sim_physics_max	0.05855499744415283
sim_physics_mean	0.05588620028672394
sim_physics_median	0.05666283369064331
sim_physics_min	0.05361342430114746
sim_render-ego_max	0.037020362218221026
sim_render-ego_mean	0.03627181603290417
sim_render-ego_median	0.03658902883529663
sim_render-ego_min	0.035152167081832886
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.990000000000011
survival_time_min	2.000000000000001

No reset possible

23171

3570

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

error

yes