Duckietown Challenges Home Challenges Submissions

Evaluator 1584

ID1584
evaluatorip-172-31-45-34-10499
ownerI don't have one 😀
machineip-172-31-45-34
processip-172-31-45-34-10499
versiond-c:5.0.7;d-c-r:5.0.10;d-s:5.0.3
first heard
last heard
statusinactive
# evaluating
# success25 24339
# timeout
# failed5 24353
# error11 24364
# aborted
# host-error5 24343
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
251164394Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-ros - Template solution using ROSaido3-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-45-34-104990:03:03
Error while running [...]

stderr | Pulling evaluator      ... 
stderr | Pulling simulator      ... 
stderr | Pulling solution       ... done
stderr | 
stderr | ERROR: for scenario_maker  Cannot overwrite digest sha256:e973619acedfa53e32b44d07e5a03a07c60c7093402155ff75ec550e6a14bcbe
stderr | Cannot overwrite digest sha256:e973619acedfa53e32b44d07e5a03a07c60c7093402155ff75ec550e6a14bcbe
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
251094387Soroush Saryazdi 🇨🇦bluejayaido3-LF-sim-validationstep1-simulationfailednoip-172-31-45-34-104990:05:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 32 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250994380Soroush Saryazdi 🇨🇦bluejayaido3-LF-sim-testingstep1-simulationfailednoip-172-31-45-34-104990:06:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 70 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250904374Frank (Chude) Qian 🇨🇦Frank raw run 1aido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-45-34-104990:18:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3858591994586664
survival_time_median9.299999999999995
deviation-center-line_median0.5986066843905092
in-drivable-lane_median1.0999999999999983


other stats
agent_compute-ego_max0.016952221393585206
agent_compute-ego_mean0.016479575053211813
agent_compute-ego_median0.01655403644807877
agent_compute-ego_min0.015704558820140605
deviation-center-line_max1.141608086401673
deviation-center-line_mean0.556372252129171
deviation-center-line_min0.12131656840540386
deviation-heading_max10.821315755772932
deviation-heading_mean5.241129465312686
deviation-heading_median5.961604479255771
deviation-heading_min1.1846836538802208
driven_any_max2.8004422402334477
driven_any_mean1.5814155138647326
driven_any_median1.7252299385988383
driven_any_min0.4370074734606931
driven_lanedir_consec_max0.8490078086903763
driven_lanedir_consec_mean0.45198348857933024
driven_lanedir_consec_min0.09092589086285165
driven_lanedir_max1.6255722674340325
driven_lanedir_mean0.8564664773435151
driven_lanedir_median1.108456795267259
driven_lanedir_min0.16111106998378233
in-drivable-lane_max3.5500000000000087
in-drivable-lane_mean1.4500000000000062
in-drivable-lane_min0.2500000000000002
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6693748990002835, "sim_physics": 0.059315137068430585, "survival_time": 14.950000000000076, "driven_lanedir": 1.3661206769243244, "sim_render-ego": 0.007052828470865885, "in-drivable-lane": 3.5500000000000087, "agent_compute-ego": 0.016952221393585206, "deviation-heading": 8.253417464909207, "set_robot_commands": 0.005018398761749267, "deviation-center-line": 0.8735111700920946, "driven_lanedir_consec": 0.8264671428414594, "sim_compute_sim_state": 0.0030029741923014324, "sim_compute_performance-ego": 0.004127635955810547, "sim_compute_robot_state-ego": 0.006256041526794434}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4962434549352504, "sim_physics": 0.06117137785880796, "survival_time": 3.099999999999997, "driven_lanedir": 0.20618500890729208, "sim_render-ego": 0.00723827269769484, "in-drivable-lane": 0.8999999999999986, "agent_compute-ego": 0.016811586195422758, "deviation-heading": 1.6070063436235258, "set_robot_commands": 0.004906066002384309, "deviation-center-line": 0.17666405999764434, "driven_lanedir_consec": 0.166343274753473, "sim_compute_sim_state": 0.0029844199457476216, "sim_compute_performance-ego": 0.003995433930427798, "sim_compute_robot_state-ego": 0.00504926327736147}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.737749153778181, "sim_physics": 0.05796057165267077, "survival_time": 14.950000000000076, "driven_lanedir": 1.4736915891232818, "sim_render-ego": 0.007103609002154806, "in-drivable-lane": 2.6500000000000137, "agent_compute-ego": 0.01662712671286286, "deviation-heading": 8.784330913945913, "set_robot_commands": 0.0050047233351895645, "deviation-center-line": 1.141608086401673, "driven_lanedir_consec": 0.8201875496215569, "sim_compute_sim_state": 0.0029859287682982992, "sim_compute_performance-ego": 0.004016071657671976, "sim_compute_robot_state-ego": 0.005030706175992322}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.7972061494143037, "sim_physics": 0.056880375965922866, "survival_time": 14.700000000000074, "driven_lanedir": 1.6255722674340325, "sim_render-ego": 0.0071158068520682195, "in-drivable-lane": 2.1000000000000134, "agent_compute-ego": 0.016628277545072595, "deviation-heading": 8.909371344327132, "set_robot_commands": 0.005020455438263563, "deviation-center-line": 0.9432459183530394, "driven_lanedir_consec": 0.8490078086903763, "sim_compute_sim_state": 0.003024738662096919, "sim_compute_performance-ego": 0.00404455142767251, "sim_compute_robot_state-ego": 0.005061893236069452}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.752228053411943, "sim_physics": 0.05717867374420166, "survival_time": 14.950000000000076, "driven_lanedir": 1.4653284769819883, "sim_render-ego": 0.006985631783803304, "in-drivable-lane": 2.500000000000015, "agent_compute-ego": 0.015966766675313313, "deviation-heading": 9.716429462613933, "set_robot_commands": 0.004958020846048991, "deviation-center-line": 0.93668681691308, "driven_lanedir_consec": 0.7940892063305598, "sim_compute_sim_state": 0.0029016908009847006, "sim_compute_performance-ego": 0.0039564768473307295, "sim_compute_robot_state-ego": 0.004998444716135661}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4370074734606931, "sim_physics": 0.06034083689673472, "survival_time": 2.9499999999999975, "driven_lanedir": 0.16111106998378233, "sim_render-ego": 0.007088806669590837, "in-drivable-lane": 1.0999999999999983, "agent_compute-ego": 0.016055996135129768, "deviation-heading": 1.1846836538802208, "set_robot_commands": 0.004834352913549391, "deviation-center-line": 0.18778076633073168, "driven_lanedir_consec": 0.14765275402901734, "sim_compute_sim_state": 0.0028916860030869305, "sim_compute_performance-ego": 0.003919993416737702, "sim_compute_robot_state-ego": 0.004942352488889533}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.4841881260355245, "sim_physics": 0.057675225394112725, "survival_time": 2.4499999999999993, "driven_lanedir": 0.1847943109981216, "sim_render-ego": 0.007234106258470185, "in-drivable-lane": 0.6500000000000004, "agent_compute-ego": 0.015704558820140605, "deviation-heading": 1.4078079703619988, "set_robot_commands": 0.0050584977986861245, "deviation-center-line": 0.12131656840540386, "driven_lanedir_consec": 0.1669813352652647, "sim_compute_sim_state": 0.0029537239853216677, "sim_compute_performance-ego": 0.0039918665983239, "sim_compute_robot_state-ego": 0.005043414174293985}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.159338779245515, "sim_physics": 0.05710361736677426, "survival_time": 11.55000000000003, "driven_lanedir": 1.241045753716577, "sim_render-ego": 0.007193892549126695, "in-drivable-lane": 2.100000000000014, "agent_compute-ego": 0.01648597799854361, "deviation-heading": 5.961604479255771, "set_robot_commands": 0.005002812389687542, "deviation-center-line": 0.7776731455131128, "driven_lanedir_consec": 0.6577833523546591, "sim_compute_sim_state": 0.003037383546044816, "sim_compute_performance-ego": 0.004051391180459555, "sim_compute_robot_state-ego": 0.005082622751013025}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.8004422402334477, "sim_physics": 0.05984201351801555, "survival_time": 14.950000000000076, "driven_lanedir": 1.5842245541188464, "sim_render-ego": 0.008013857205708822, "in-drivable-lane": 2.30000000000002, "agent_compute-ego": 0.016587337652842205, "deviation-heading": 8.908387091087025, "set_robot_commands": 0.0050687901178995765, "deviation-center-line": 0.9121924167346108, "driven_lanedir_consec": 0.642156277891237, "sim_compute_sim_state": 0.003020939032236735, "sim_compute_performance-ego": 0.004075618584950765, "sim_compute_robot_state-ego": 0.00511189619700114}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5219229143807377, "sim_physics": 0.057737863288735446, "survival_time": 2.6499999999999986, "driven_lanedir": 0.24206535071960425, "sim_render-ego": 0.007326054123212707, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.016540711780764022, "deviation-heading": 2.0243056396271197, "set_robot_commands": 0.004897369528716465, "deviation-center-line": 0.17865156264431717, "driven_lanedir_consec": 0.17763699234826147, "sim_compute_sim_state": 0.0030360041924242702, "sim_compute_performance-ego": 0.004123197411591152, "sim_compute_robot_state-ego": 0.005088882626227613}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.5454582887453847, "sim_physics": 0.059312477707862854, "survival_time": 3.1999999999999966, "driven_lanedir": 0.3025066215796879, "sim_render-ego": 0.009769782423973083, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.016622737050056458, "deviation-heading": 2.121638594634123, "set_robot_commands": 0.004966769367456436, "deviation-center-line": 0.2291797814990683, "driven_lanedir_consec": 0.09092589086285165, "sim_compute_sim_state": 0.002999301999807358, "sim_compute_performance-ego": 0.00404021143913269, "sim_compute_robot_state-ego": 0.005051758140325546}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5554445525428294, "sim_physics": 0.06118217504249429, "survival_time": 2.6499999999999986, "driven_lanedir": 0.2654338881498062, "sim_render-ego": 0.007391718198668282, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.016428484106963535, "deviation-heading": 1.443692433944788, "set_robot_commands": 0.005094442727430811, "deviation-center-line": 0.12681163428771564, "driven_lanedir_consec": 0.22909521145674283, "sim_compute_sim_state": 0.003060894192389722, "sim_compute_performance-ego": 0.004082414339173515, "sim_compute_robot_state-ego": 0.00511523462691397}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.4718286352170784, "sim_physics": 0.05791551300457546, "survival_time": 2.799999999999998, "driven_lanedir": 0.225892602099106, "sim_render-ego": 0.00730258652142116, "in-drivable-lane": 0.7500000000000004, "agent_compute-ego": 0.016817063093185425, "deviation-heading": 1.390123801621047, "set_robot_commands": 0.004860333033970424, "deviation-center-line": 0.1831196837263522, "driven_lanedir_consec": 0.14965656140091022, "sim_compute_sim_state": 0.0029870271682739258, "sim_compute_performance-ego": 0.004024331058774676, "sim_compute_robot_state-ego": 0.005031496286392212}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.7252299385988383, "sim_physics": 0.05710131378584011, "survival_time": 9.299999999999995, "driven_lanedir": 1.108456795267259, "sim_render-ego": 0.007192274575592369, "in-drivable-lane": 0.8499999999999983, "agent_compute-ego": 0.01655403644807877, "deviation-heading": 6.082827030085566, "set_robot_commands": 0.0050294488988896855, "deviation-center-line": 0.5986066843905092, "driven_lanedir_consec": 0.3858591994586664, "sim_compute_sim_state": 0.0030116983639296665, "sim_compute_performance-ego": 0.004044482784886514, "sim_compute_robot_state-ego": 0.005064838676042454}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.567570048970976, "sim_physics": 0.05644226551055908, "survival_time": 14.950000000000076, "driven_lanedir": 1.394568194149016, "sim_render-ego": 0.007030547459920248, "in-drivable-lane": 1.2000000000000082, "agent_compute-ego": 0.016410744190216063, "deviation-heading": 10.821315755772932, "set_robot_commands": 0.0048668599128723145, "deviation-center-line": 0.9585354866482112, "driven_lanedir_consec": 0.675909771384918, "sim_compute_sim_state": 0.002957585652669271, "sim_compute_performance-ego": 0.003977468808492025, "sim_compute_robot_state-ego": 0.004984761079152425}}
set_robot_commands_max0.005094442727430811
set_robot_commands_mean0.004972489404852965
set_robot_commands_median0.005002812389687542
set_robot_commands_min0.004834352913549391
sim_compute_performance-ego_max0.004127635955810547
sim_compute_performance-ego_mean0.004031409696095737
sim_compute_performance-ego_median0.00404021143913269
sim_compute_performance-ego_min0.003919993416737702
sim_compute_robot_state-ego_max0.006256041526794434
sim_compute_robot_state-ego_mean0.005127573731907017
sim_compute_robot_state-ego_median0.005051758140325546
sim_compute_robot_state-ego_min0.004942352488889533
sim_compute_sim_state_max0.003060894192389722
sim_compute_sim_state_mean0.002990399767040889
sim_compute_sim_state_median0.002999301999807358
sim_compute_sim_state_min0.0028916860030869305
sim_physics_max0.06118217504249429
sim_physics_mean0.05847729585371589
sim_physics_median0.05791551300457546
sim_physics_min0.05644226551055908
sim_render-ego_max0.009769782423973083
sim_render-ego_mean0.007402651652818096
sim_render-ego_median0.007193892549126695
sim_render-ego_min0.006985631783803304
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.673333333333366
survival_time_min2.4499999999999993
No reset possible
250744371Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-tensorflowaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:06:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1770155275585643
survival_time_median1.2500000000000004
deviation-center-line_median0.08725365444990549
in-drivable-lane_median0


other stats
agent_compute-ego_max0.034296302795410155
agent_compute-ego_mean0.027408462272750005
agent_compute-ego_median0.025625690817832947
agent_compute-ego_min0.02495550155639649
deviation-center-line_max0.11836838176033088
deviation-center-line_mean0.08818302005455639
deviation-center-line_min0.06749680249688203
deviation-heading_max0.8014604682253328
deviation-heading_mean0.521934598020622
deviation-heading_median0.5118724737262541
deviation-heading_min0.29593082295456563
driven_any_max0.3566188856186238
driven_any_mean0.23338708957340368
driven_any_median0.2443654823621191
driven_any_min0.14114735954041277
driven_lanedir_consec_max0.3151283060883885
driven_lanedir_consec_mean0.19514825693397503
driven_lanedir_consec_min0.11020752618218976
driven_lanedir_max0.3151283060883885
driven_lanedir_mean0.19514825693397503
driven_lanedir_median0.1770155275585643
driven_lanedir_min0.11020752618218976
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.3566188856186238, "sim_physics": 0.2501041793823242, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3151283060883885, "sim_render-ego": 0.012799510955810549, "in-drivable-lane": 0, "agent_compute-ego": 0.034296302795410155, "deviation-heading": 0.4637330378248563, "set_robot_commands": 0.010626649856567383, "deviation-center-line": 0.08725365444990549, "driven_lanedir_consec": 0.3151283060883885, "sim_compute_sim_state": 0.005712261199951172, "sim_compute_performance-ego": 0.007880430221557617, "sim_compute_robot_state-ego": 0.010657901763916016, "sim_compute_robot_state-npc0": 0.009453287124633789, "sim_compute_robot_state-npc1": 0.009746427536010745, "sim_compute_robot_state-npc2": 0.010025453567504884, "sim_compute_robot_state-npc3": 0.009061403274536133}, "udem1-1-0": {"driven_any": 0.2443654823621191, "sim_physics": 0.18908928058765553, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1770155275585643, "sim_render-ego": 0.013591395484076606, "in-drivable-lane": 0, "agent_compute-ego": 0.02556822035047743, "deviation-heading": 0.8014604682253328, "set_robot_commands": 0.008052128332632559, "deviation-center-line": 0.09356697539772103, "driven_lanedir_consec": 0.1770155275585643, "sim_compute_sim_state": 0.0049701884940818505, "sim_compute_performance-ego": 0.006664081856056496, "sim_compute_robot_state-ego": 0.008171417095043041, "sim_compute_robot_state-npc0": 0.007830142974853516, "sim_compute_robot_state-npc1": 0.008069903762252242, "sim_compute_robot_state-npc2": 0.007716302518491392, "sim_compute_robot_state-npc3": 0.00767481768572772}, "udem1-2-0": {"driven_any": 0.14114735954041277, "sim_physics": 0.2952902615070343, "survival_time": 0.8000000000000002, "driven_lanedir": 0.11020752618218976, "sim_render-ego": 0.01358291506767273, "in-drivable-lane": 0, "agent_compute-ego": 0.025625690817832947, "deviation-heading": 0.29593082295456563, "set_robot_commands": 0.01101095974445343, "deviation-center-line": 0.06749680249688203, "driven_lanedir_consec": 0.11020752618218976, "sim_compute_sim_state": 0.00518132746219635, "sim_compute_performance-ego": 0.007476478815078735, "sim_compute_robot_state-ego": 0.009262517094612122, "sim_compute_robot_state-npc0": 0.00957159698009491, "sim_compute_robot_state-npc1": 0.007891222834587097, "sim_compute_robot_state-npc2": 0.009101897478103638, "sim_compute_robot_state-npc3": 0.008965417742729187}, "udem1-3-0": {"driven_any": 0.17495462783553486, "sim_physics": 0.1770941925048828, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15154120773038948, "sim_render-ego": 0.011685800552368165, "in-drivable-lane": 0, "agent_compute-ego": 0.02495550155639649, "deviation-heading": 0.5366761873721013, "set_robot_commands": 0.008247642517089844, "deviation-center-line": 0.11836838176033088, "driven_lanedir_consec": 0.15154120773038948, "sim_compute_sim_state": 0.0043662357330322265, "sim_compute_performance-ego": 0.006134824752807617, "sim_compute_robot_state-ego": 0.007970457077026366, "sim_compute_robot_state-npc0": 0.007037801742553711, "sim_compute_robot_state-npc1": 0.007549247741699219, "sim_compute_robot_state-npc2": 0.006888628005981445, "sim_compute_robot_state-npc3": 0.0073529243469238285}, "udem1-4-0": {"driven_any": 0.2498490925103279, "sim_physics": 0.20111730694770813, "survival_time": 1.2000000000000004, "driven_lanedir": 0.22184871711034315, "sim_render-ego": 0.0122163196404775, "in-drivable-lane": 0, "agent_compute-ego": 0.026596595843633015, "deviation-heading": 0.5118724737262541, "set_robot_commands": 0.008651435375213623, "deviation-center-line": 0.07422928616794251, "driven_lanedir_consec": 0.22184871711034315, "sim_compute_sim_state": 0.004775027434031169, "sim_compute_performance-ego": 0.007089863220850627, "sim_compute_robot_state-ego": 0.00885152816772461, "sim_compute_robot_state-npc0": 0.008264760176340738, "sim_compute_robot_state-npc1": 0.008064707120259603, "sim_compute_robot_state-npc2": 0.008100688457489014, "sim_compute_robot_state-npc3": 0.007820953925450643}}
set_robot_commands_max0.01101095974445343
set_robot_commands_mean0.009317763165191367
set_robot_commands_median0.008651435375213623
set_robot_commands_min0.008052128332632559
sim_compute_performance-ego_max0.007880430221557617
sim_compute_performance-ego_mean0.0070491357732702185
sim_compute_performance-ego_median0.007089863220850627
sim_compute_performance-ego_min0.006134824752807617
sim_compute_robot_state-ego_max0.010657901763916016
sim_compute_robot_state-ego_mean0.008982764239664431
sim_compute_robot_state-ego_median0.00885152816772461
sim_compute_robot_state-ego_min0.007970457077026366
sim_compute_robot_state-npc0_max0.00957159698009491
sim_compute_robot_state-npc0_mean0.008431517799695332
sim_compute_robot_state-npc0_median0.008264760176340738
sim_compute_robot_state-npc0_min0.007037801742553711
sim_compute_robot_state-npc1_max0.009746427536010745
sim_compute_robot_state-npc1_mean0.008264301798961782
sim_compute_robot_state-npc1_median0.008064707120259603
sim_compute_robot_state-npc1_min0.007549247741699219
sim_compute_robot_state-npc2_max0.010025453567504884
sim_compute_robot_state-npc2_mean0.008366594005514075
sim_compute_robot_state-npc2_median0.008100688457489014
sim_compute_robot_state-npc2_min0.006888628005981445
sim_compute_robot_state-npc3_max0.009061403274536133
sim_compute_robot_state-npc3_mean0.008175103395073501
sim_compute_robot_state-npc3_median0.007820953925450643
sim_compute_robot_state-npc3_min0.0073529243469238285
sim_compute_sim_state_max0.005712261199951172
sim_compute_sim_state_mean0.005001008064658554
sim_compute_sim_state_median0.0049701884940818505
sim_compute_sim_state_min0.0043662357330322265
sim_physics_max0.2952902615070343
sim_physics_mean0.22253904418592096
sim_physics_median0.20111730694770813
sim_physics_min0.1770941925048828
sim_render-ego_max0.013591395484076606
sim_render-ego_mean0.012775188340081107
sim_render-ego_median0.012799510955810549
sim_render-ego_min0.011685800552368165
simulation-passed1
survival_time_max1.3500000000000003
survival_time_mean1.1700000000000004
survival_time_min0.8000000000000002
No reset possible
250194363Soroush Saryazdi 🇨🇦bluejayaido3-LFVI-sim-validationstep1-simulationerrornoip-172-31-45-34-104990:03:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
250074353Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.17416096638457823
survival_time_median1.1500000000000004
deviation-center-line_median0.08419768026875477
in-drivable-lane_median0


other stats
agent_compute-ego_max0.029278589331585423
agent_compute-ego_mean0.02734755221527931
agent_compute-ego_median0.02687513828277588
agent_compute-ego_min0.02596920536410424
deviation-center-line_max0.31413146517032137
deviation-center-line_mean0.13236830129201427
deviation-center-line_min0.06671973999529197
deviation-heading_max1.5533833055301427
deviation-heading_mean0.7301848522557084
deviation-heading_median0.67098759642306
deviation-heading_min0.23113335033206195
driven_any_max0.9668878366644156
driven_any_mean0.3657000109513836
driven_any_median0.2443843189533799
driven_any_min0.13433028211844222
driven_lanedir_consec_max0.823530720197785
driven_lanedir_consec_mean0.2898754711176526
driven_lanedir_consec_min0.09961888770347738
driven_lanedir_max0.823530720197785
driven_lanedir_mean0.2898754711176526
driven_lanedir_median0.17416096638457823
driven_lanedir_min0.09961888770347738
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.019999999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2443843189533799, "sim_physics": 0.1956779749497123, "survival_time": 1.1500000000000004, "driven_lanedir": 0.165375916414777, "sim_render-ego": 0.012343126794566278, "in-drivable-lane": 0, "agent_compute-ego": 0.029278589331585423, "deviation-heading": 0.67098759642306, "set_robot_commands": 0.010129534679910412, "deviation-center-line": 0.08419768026875477, "driven_lanedir_consec": 0.165375916414777, "sim_compute_sim_state": 0.004844862481822138, "sim_compute_performance-ego": 0.007365641386612602, "sim_compute_robot_state-ego": 0.00910323599110479, "sim_compute_robot_state-npc0": 0.0085516183272652, "sim_compute_robot_state-npc1": 0.008577015088952106, "sim_compute_robot_state-npc2": 0.008377914843351944, "sim_compute_robot_state-npc3": 0.008350455242654552}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2540036701193792, "sim_physics": 0.18843064000529627, "survival_time": 1.5500000000000007, "driven_lanedir": 0.17416096638457823, "sim_render-ego": 0.012606613097652312, "in-drivable-lane": 0, "agent_compute-ego": 0.02596920536410424, "deviation-heading": 0.8521524561274626, "set_robot_commands": 0.010098603463942004, "deviation-center-line": 0.1220375098228473, "driven_lanedir_consec": 0.17416096638457823, "sim_compute_sim_state": 0.004832560016262916, "sim_compute_performance-ego": 0.006751806505264774, "sim_compute_robot_state-ego": 0.009240081233362998, "sim_compute_robot_state-npc0": 0.008648010992234754, "sim_compute_robot_state-npc1": 0.008214496797130953, "sim_compute_robot_state-npc2": 0.008287529791555098, "sim_compute_robot_state-npc3": 0.008053679620065996}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.228893946901301, "sim_physics": 0.20398507620158948, "survival_time": 0.9500000000000004, "driven_lanedir": 0.18669086488764552, "sim_render-ego": 0.012422473807083933, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02825030527616802, "deviation-heading": 0.23113335033206195, "set_robot_commands": 0.010505048852217824, "deviation-center-line": 0.07475511120285587, "driven_lanedir_consec": 0.18669086488764552, "sim_compute_sim_state": 0.0047196589018169205, "sim_compute_performance-ego": 0.006784464183606599, "sim_compute_robot_state-ego": 0.008722443329660516, "sim_compute_robot_state-npc0": 0.00875947349949887, "sim_compute_robot_state-npc1": 0.009619097960622687, "sim_compute_robot_state-npc2": 0.00963164630689119, "sim_compute_robot_state-npc3": 0.008816806893599661}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13433028211844222, "sim_physics": 0.21718608631807215, "survival_time": 0.8500000000000002, "driven_lanedir": 0.09961888770347738, "sim_render-ego": 0.011956355151008156, "in-drivable-lane": 0, "agent_compute-ego": 0.026364522821762985, "deviation-heading": 0.3432675528658145, "set_robot_commands": 0.008769554250380573, "deviation-center-line": 0.06671973999529197, "driven_lanedir_consec": 0.09961888770347738, "sim_compute_sim_state": 0.005012975019567153, "sim_compute_performance-ego": 0.006977558135986328, "sim_compute_robot_state-ego": 0.008071675020105699, "sim_compute_robot_state-npc0": 0.007842554765589097, "sim_compute_robot_state-npc1": 0.00832995246438419, "sim_compute_robot_state-npc2": 0.008858456331140855, "sim_compute_robot_state-npc3": 0.007741409189560834}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9668878366644156, "sim_physics": 0.1694889985598051, "survival_time": 3.899999999999994, "driven_lanedir": 0.823530720197785, "sim_render-ego": 0.012441473129468089, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.02687513828277588, "deviation-heading": 1.5533833055301427, "set_robot_commands": 0.009560138751298951, "deviation-center-line": 0.31413146517032137, "driven_lanedir_consec": 0.823530720197785, "sim_compute_sim_state": 0.005033453305562337, "sim_compute_performance-ego": 0.007250021665524214, "sim_compute_robot_state-ego": 0.008975707567655124, "sim_compute_robot_state-npc0": 0.008925395134167794, "sim_compute_robot_state-npc1": 0.008262285819420448, "sim_compute_robot_state-npc2": 0.008243796152946277, "sim_compute_robot_state-npc3": 0.008246764158591246}}
set_robot_commands_max0.010505048852217824
set_robot_commands_mean0.009812575999549952
set_robot_commands_median0.010098603463942004
set_robot_commands_min0.008769554250380573
sim_compute_performance-ego_max0.007365641386612602
sim_compute_performance-ego_mean0.007025898375398904
sim_compute_performance-ego_median0.006977558135986328
sim_compute_performance-ego_min0.006751806505264774
sim_compute_robot_state-ego_max0.009240081233362998
sim_compute_robot_state-ego_mean0.008822628628377824
sim_compute_robot_state-ego_median0.008975707567655124
sim_compute_robot_state-ego_min0.008071675020105699
sim_compute_robot_state-npc0_max0.008925395134167794
sim_compute_robot_state-npc0_mean0.008545410543751141
sim_compute_robot_state-npc0_median0.008648010992234754
sim_compute_robot_state-npc0_min0.007842554765589097
sim_compute_robot_state-npc1_max0.009619097960622687
sim_compute_robot_state-npc1_mean0.008600569626102079
sim_compute_robot_state-npc1_median0.00832995246438419
sim_compute_robot_state-npc1_min0.008214496797130953
sim_compute_robot_state-npc2_max0.00963164630689119
sim_compute_robot_state-npc2_mean0.008679868685177072
sim_compute_robot_state-npc2_median0.008377914843351944
sim_compute_robot_state-npc2_min0.008243796152946277
sim_compute_robot_state-npc3_max0.008816806893599661
sim_compute_robot_state-npc3_mean0.008241823020894459
sim_compute_robot_state-npc3_median0.008246764158591246
sim_compute_robot_state-npc3_min0.007741409189560834
sim_compute_sim_state_max0.005033453305562337
sim_compute_sim_state_mean0.0048887019450062925
sim_compute_sim_state_median0.004844862481822138
sim_compute_sim_state_min0.0047196589018169205
sim_physics_max0.21718608631807215
sim_physics_mean0.19495375520689504
sim_physics_median0.1956779749497123
sim_physics_min0.1694889985598051
sim_render-ego_max0.012606613097652312
sim_render-ego_mean0.012354008395955754
sim_render-ego_median0.012422473807083933
sim_render-ego_min0.011956355151008156
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean1.679999999999999
survival_time_min0.8500000000000002
No reset possible
249944139Andrea Censi 🇨🇭rotationaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-45-34-104990:49:32
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249894158Andrea Censi 🇨🇭minimal_agent_python2 (Python 2)aido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5588337849539742
survival_time_median5.549999999999988
deviation-center-line_median0.3652019984091639
in-drivable-lane_median0


other stats
agent_compute-ego_max0.010658973100169606
agent_compute-ego_mean0.010130118283459989
agent_compute-ego_median0.010283425047590928
agent_compute-ego_min0.009226148192946976
deviation-center-line_max0.5183621890690367
deviation-center-line_mean0.3091633025512927
deviation-center-line_min0.10686438692139356
deviation-heading_max0.6191860504142408
deviation-heading_mean0.5051792851842161
deviation-heading_median0.4989824923438323
deviation-heading_min0.42218734391092383
driven_any_max2.764827318571964
driven_any_mean1.4658358085690737
driven_any_median1.5648273185720385
driven_any_min0.37986052535838966
driven_lanedir_consec_max1.9044523873117627
driven_lanedir_consec_mean1.19641611532087
driven_lanedir_consec_min0.3667130323691865
driven_lanedir_max1.9045033171069223
driven_lanedir_mean1.1964799961413226
driven_lanedir_median1.5590414710313567
driven_lanedir_min0.3667130323691865
in-drivable-lane_max2.8500000000000165
in-drivable-lane_mean0.8600000000000023
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.19667858476037375, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.012265549049721108, "in-drivable-lane": 0, "agent_compute-ego": 0.010283425047590928, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.010069894361066388, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.004854569563994536, "sim_compute_performance-ego": 0.0073100339185010205, "sim_compute_robot_state-ego": 0.00917126466562082, "sim_compute_robot_state-npc0": 0.008805023657309043, "sim_compute_robot_state-npc1": 0.00814787332002107, "sim_compute_robot_state-npc2": 0.008817406388016435, "sim_compute_robot_state-npc3": 0.008323961550051027}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.17508426872459618, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.012177976402076516, "in-drivable-lane": 0, "agent_compute-ego": 0.009226148192946976, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.009098040091024865, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.004767617663821658, "sim_compute_performance-ego": 0.006886765763566301, "sim_compute_robot_state-ego": 0.008398339555070206, "sim_compute_robot_state-npc0": 0.0083729447545232, "sim_compute_robot_state-npc1": 0.008304177103815851, "sim_compute_robot_state-npc2": 0.008123397827148438, "sim_compute_robot_state-npc3": 0.00835407102430189}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.2080472210385152, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.012852627710001358, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.010658973100169606, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.01061321252229198, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.005372112160486891, "sim_compute_performance-ego": 0.007731022424255775, "sim_compute_robot_state-ego": 0.009509992915273505, "sim_compute_robot_state-npc0": 0.008822557941967289, "sim_compute_robot_state-npc1": 0.009185860488588446, "sim_compute_robot_state-npc2": 0.008735048849851091, "sim_compute_robot_state-npc3": 0.008729191015887735}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.20212883350112676, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.01215741272372101, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.010436375103695855, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.010045210104338162, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.005053640036058676, "sim_compute_performance-ego": 0.007152308968349277, "sim_compute_robot_state-ego": 0.008951291988033275, "sim_compute_robot_state-npc0": 0.008457492159299201, "sim_compute_robot_state-npc1": 0.008367310019687832, "sim_compute_robot_state-npc2": 0.008419899416219501, "sim_compute_robot_state-npc3": 0.00843466389241643}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.17807678133249283, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.012525178492069244, "in-drivable-lane": 0, "agent_compute-ego": 0.010045669972896576, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.009223446249961851, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.005060568451881409, "sim_compute_performance-ego": 0.006876498460769653, "sim_compute_robot_state-ego": 0.008650384843349457, "sim_compute_robot_state-npc0": 0.008690550923347473, "sim_compute_robot_state-npc1": 0.00834830105304718, "sim_compute_robot_state-npc2": 0.00870010256767273, "sim_compute_robot_state-npc3": 0.007983393967151642}}
set_robot_commands_max0.01061321252229198
set_robot_commands_mean0.00980996066573665
set_robot_commands_median0.010045210104338162
set_robot_commands_min0.009098040091024865
sim_compute_performance-ego_max0.007731022424255775
sim_compute_performance-ego_mean0.007191325907088405
sim_compute_performance-ego_median0.007152308968349277
sim_compute_performance-ego_min0.006876498460769653
sim_compute_robot_state-ego_max0.009509992915273505
sim_compute_robot_state-ego_mean0.008936254793469451
sim_compute_robot_state-ego_median0.008951291988033275
sim_compute_robot_state-ego_min0.008398339555070206
sim_compute_robot_state-npc0_max0.008822557941967289
sim_compute_robot_state-npc0_mean0.008629713887289243
sim_compute_robot_state-npc0_median0.008690550923347473
sim_compute_robot_state-npc0_min0.0083729447545232
sim_compute_robot_state-npc1_max0.009185860488588446
sim_compute_robot_state-npc1_mean0.008470704397032075
sim_compute_robot_state-npc1_median0.00834830105304718
sim_compute_robot_state-npc1_min0.00814787332002107
sim_compute_robot_state-npc2_max0.008817406388016435
sim_compute_robot_state-npc2_mean0.008559171009781638
sim_compute_robot_state-npc2_median0.00870010256767273
sim_compute_robot_state-npc2_min0.008123397827148438
sim_compute_robot_state-npc3_max0.008729191015887735
sim_compute_robot_state-npc3_mean0.008365056289961743
sim_compute_robot_state-npc3_median0.00835407102430189
sim_compute_robot_state-npc3_min0.007983393967151642
sim_compute_sim_state_max0.005372112160486891
sim_compute_sim_state_mean0.005021701575248634
sim_compute_sim_state_median0.005053640036058676
sim_compute_sim_state_min0.004767617663821658
sim_physics_max0.2080472210385152
sim_physics_mean0.19200313787142093
sim_physics_median0.19667858476037375
sim_physics_min0.17508426872459618
sim_render-ego_max0.012852627710001358
sim_render-ego_mean0.012395748875517846
sim_render-ego_median0.012265549049721108
sim_render-ego_min0.01215741272372101
simulation-passed1
survival_time_max9.55
survival_time_mean5.219999999999994
survival_time_min1.6000000000000008
No reset possible
249114239Manfred DiazBaseline-IL-logs-tensorflowaido3-LF-sim-testingstep1-simulationerrornoip-172-31-45-34-104990:33:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
249104248Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3409771666104766
survival_time_median1.900000000000001
deviation-center-line_median0.09340084065802556
in-drivable-lane_median0.7500000000000007


other stats
agent_compute-ego_max0.034590375423431394
agent_compute-ego_mean0.02921542052079218
agent_compute-ego_median0.02926358212245984
agent_compute-ego_min0.025437549540871067
deviation-center-line_max0.34066849415932043
deviation-center-line_mean0.15301917850452854
deviation-center-line_min0.06777042800078045
deviation-heading_max2.2121958098813677
deviation-heading_mean1.0584464024597076
deviation-heading_median0.6866624667403909
deviation-heading_min0.4484334211570551
driven_any_max1.556379079652988
driven_any_mean0.758358625707314
driven_any_median0.4659417215364601
driven_any_min0.1850592752422579
driven_lanedir_consec_max1.1774723964888985
driven_lanedir_consec_mean0.42563267322105913
driven_lanedir_consec_min0.08577288620926682
driven_lanedir_max1.1774723964888985
driven_lanedir_mean0.42563267322105913
driven_lanedir_median0.3409771666104766
driven_lanedir_min0.08577288620926682
in-drivable-lane_max2.4499999999999953
in-drivable-lane_mean0.8099999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1850592752422579, "sim_physics": 0.13511109352111816, "survival_time": 1.0000000000000002, "driven_lanedir": 0.08577288620926682, "sim_render-ego": 0.015210723876953124, "in-drivable-lane": 0, "agent_compute-ego": 0.034590375423431394, "deviation-heading": 0.6866624667403909, "set_robot_commands": 0.0112939715385437, "deviation-center-line": 0.06777042800078045, "driven_lanedir_consec": 0.08577288620926682, "sim_compute_sim_state": 0.0063220739364624025, "sim_compute_performance-ego": 0.010172057151794431, "sim_compute_robot_state-ego": 0.011555421352386474}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1798216232134078, "sim_physics": 0.1350905600558506, "survival_time": 4.449999999999992, "driven_lanedir": 0.36121735016617496, "sim_render-ego": 0.012877330351411628, "in-drivable-lane": 2.4499999999999953, "agent_compute-ego": 0.02926358212245984, "deviation-heading": 1.3698151461594985, "set_robot_commands": 0.009978830144646464, "deviation-center-line": 0.17831258490733098, "driven_lanedir_consec": 0.36121735016617496, "sim_compute_sim_state": 0.0053015130289484945, "sim_compute_performance-ego": 0.007719776603613007, "sim_compute_robot_state-ego": 0.009841771607988336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.556379079652988, "sim_physics": 0.12803617846064208, "survival_time": 5.949999999999987, "driven_lanedir": 1.1774723964888985, "sim_render-ego": 0.013553407011913652, "in-drivable-lane": 0.7999999999999985, "agent_compute-ego": 0.030026686291734713, "deviation-heading": 2.2121958098813677, "set_robot_commands": 0.011635453761124811, "deviation-center-line": 0.34066849415932043, "driven_lanedir_consec": 1.1774723964888985, "sim_compute_sim_state": 0.005669411490945255, "sim_compute_performance-ego": 0.007961601770224692, "sim_compute_robot_state-ego": 0.00952837647510176}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4045914288914565, "sim_physics": 0.12360430508852004, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3409771666104766, "sim_render-ego": 0.014260046184062958, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.026758909225463867, "deviation-heading": 0.5751251683602248, "set_robot_commands": 0.010682456195354462, "deviation-center-line": 0.09340084065802556, "driven_lanedir_consec": 0.3409771666104766, "sim_compute_sim_state": 0.0058836787939071655, "sim_compute_performance-ego": 0.007993489503860474, "sim_compute_robot_state-ego": 0.009159766137599943}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4659417215364601, "sim_physics": 0.10722073755766216, "survival_time": 1.900000000000001, "driven_lanedir": 0.1627235666304787, "sim_render-ego": 0.011551467995894585, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.025437549540871067, "deviation-heading": 0.4484334211570551, "set_robot_commands": 0.008886048668309263, "deviation-center-line": 0.08494354479718526, "driven_lanedir_consec": 0.1627235666304787, "sim_compute_sim_state": 0.004873714948955335, "sim_compute_performance-ego": 0.007097652083949039, "sim_compute_robot_state-ego": 0.009050337891829642}}
set_robot_commands_max0.011635453761124811
set_robot_commands_mean0.01049535206159574
set_robot_commands_median0.010682456195354462
set_robot_commands_min0.008886048668309263
sim_compute_performance-ego_max0.010172057151794431
sim_compute_performance-ego_mean0.008188915422688329
sim_compute_performance-ego_median0.007961601770224692
sim_compute_performance-ego_min0.007097652083949039
sim_compute_robot_state-ego_max0.011555421352386474
sim_compute_robot_state-ego_mean0.009827134692981233
sim_compute_robot_state-ego_median0.00952837647510176
sim_compute_robot_state-ego_min0.009050337891829642
sim_compute_sim_state_max0.0063220739364624025
sim_compute_sim_state_mean0.00561007843984373
sim_compute_sim_state_median0.005669411490945255
sim_compute_sim_state_min0.004873714948955335
sim_physics_max0.13511109352111816
sim_physics_mean0.12581257493675865
sim_physics_median0.12803617846064208
sim_physics_min0.10722073755766216
sim_render-ego_max0.015210723876953124
sim_render-ego_mean0.013490595084047189
sim_render-ego_median0.013553407011913652
sim_render-ego_min0.011551467995894585
simulation-passed1
survival_time_max5.949999999999987
survival_time_mean2.979999999999996
survival_time_min1.0000000000000002
No reset possible
248994250Manfred Diazchallenge-aido_LF-template-tensorflowaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:06:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3840495133324143
survival_time_median1.5500000000000007
deviation-center-line_median0.0866304846000135
in-drivable-lane_median0


other stats
agent_compute-ego_max0.031676663292778864
agent_compute-ego_mean0.029465573793245697
agent_compute-ego_median0.029964923858642575
agent_compute-ego_min0.02585943121659128
deviation-center-line_max0.1280513161473511
deviation-center-line_mean0.09002313484941057
deviation-center-line_min0.07116304306197635
deviation-heading_max0.648598880694961
deviation-heading_mean0.5102197934287324
deviation-heading_median0.5265363748103021
deviation-heading_min0.3801898387000524
driven_any_max0.4868304083675451
driven_any_mean0.396097300524156
driven_any_median0.42125531090465046
driven_any_min0.27576242752478886
driven_lanedir_consec_max0.4653477974992546
driven_lanedir_consec_mean0.3407024915021963
driven_lanedir_consec_min0.20172605716220637
driven_lanedir_max0.4653477974992546
driven_lanedir_mean0.3407024915021963
driven_lanedir_median0.3840495133324143
driven_lanedir_min0.20172605716220637
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.020000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.27576242752478886, "sim_physics": 0.12032297524538908, "survival_time": 1.1000000000000003, "driven_lanedir": 0.20172605716220637, "sim_render-ego": 0.012291550636291504, "in-drivable-lane": 0, "agent_compute-ego": 0.029833284291354092, "deviation-heading": 0.5265363748103021, "set_robot_commands": 0.009339646859602495, "deviation-center-line": 0.07116304306197635, "driven_lanedir_consec": 0.20172605716220637, "sim_compute_sim_state": 0.004901755939830433, "sim_compute_performance-ego": 0.0070427331057461824, "sim_compute_robot_state-ego": 0.008667664094404741}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.47077323377272545, "sim_physics": 0.12040369575088088, "survival_time": 1.850000000000001, "driven_lanedir": 0.3840495133324143, "sim_render-ego": 0.01440120387721706, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02999356630686167, "deviation-heading": 0.648598880694961, "set_robot_commands": 0.01070031604251346, "deviation-center-line": 0.09245377665373378, "driven_lanedir_consec": 0.3840495133324143, "sim_compute_sim_state": 0.005397448668608794, "sim_compute_performance-ego": 0.0074914146114040065, "sim_compute_robot_state-ego": 0.011250128617157807}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4868304083675451, "sim_physics": 0.10899253267990916, "survival_time": 1.900000000000001, "driven_lanedir": 0.4653477974992546, "sim_render-ego": 0.012175974092985454, "in-drivable-lane": 0, "agent_compute-ego": 0.02585943121659128, "deviation-heading": 0.425962433435797, "set_robot_commands": 0.009410920896028218, "deviation-center-line": 0.1280513161473511, "driven_lanedir_consec": 0.4653477974992546, "sim_compute_sim_state": 0.00483762590508712, "sim_compute_performance-ego": 0.007034960545991596, "sim_compute_robot_state-ego": 0.00862239536486174}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3258651220510707, "sim_physics": 0.15326817830403647, "survival_time": 1.3500000000000003, "driven_lanedir": 0.25609595047751865, "sim_render-ego": 0.01458190988611292, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.031676663292778864, "deviation-heading": 0.5698114395025493, "set_robot_commands": 0.011032855069195782, "deviation-center-line": 0.07181705378397815, "driven_lanedir_consec": 0.25609595047751865, "sim_compute_sim_state": 0.005616973947595667, "sim_compute_performance-ego": 0.008162366019354926, "sim_compute_robot_state-ego": 0.011912469510678892}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42125531090465046, "sim_physics": 0.1302064311119818, "survival_time": 1.5500000000000007, "driven_lanedir": 0.3962931390395874, "sim_render-ego": 0.014751142071139428, "in-drivable-lane": 0, "agent_compute-ego": 0.029964923858642575, "deviation-heading": 0.3801898387000524, "set_robot_commands": 0.011256640957247826, "deviation-center-line": 0.0866304846000135, "driven_lanedir_consec": 0.3962931390395874, "sim_compute_sim_state": 0.005593515211536038, "sim_compute_performance-ego": 0.00783206570533014, "sim_compute_robot_state-ego": 0.010260751170496789}}
set_robot_commands_max0.011256640957247826
set_robot_commands_mean0.010348075964917556
set_robot_commands_median0.01070031604251346
set_robot_commands_min0.009339646859602495
sim_compute_performance-ego_max0.008162366019354926
sim_compute_performance-ego_mean0.007512707997565371
sim_compute_performance-ego_median0.0074914146114040065
sim_compute_performance-ego_min0.007034960545991596
sim_compute_robot_state-ego_max0.011912469510678892
sim_compute_robot_state-ego_mean0.010142681751519994
sim_compute_robot_state-ego_median0.010260751170496789
sim_compute_robot_state-ego_min0.00862239536486174
sim_compute_sim_state_max0.005616973947595667
sim_compute_sim_state_mean0.00526946393453161
sim_compute_sim_state_median0.005397448668608794
sim_compute_sim_state_min0.00483762590508712
sim_physics_max0.15326817830403647
sim_physics_mean0.12663876261843948
sim_physics_median0.12040369575088088
sim_physics_min0.10899253267990916
sim_render-ego_max0.014751142071139428
sim_render-ego_mean0.013640356112749273
sim_render-ego_median0.01440120387721706
sim_render-ego_min0.012175974092985454
simulation-passed1
survival_time_max1.900000000000001
survival_time_mean1.5500000000000007
survival_time_min1.1000000000000003
No reset possible
248864259Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-45-34-104990:02:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248674284Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-45-34-104990:10:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
248524304Frank (Chude) Qian 🇨🇦Frank test submissionaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-45-34-104990:16:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.43495812661747424
survival_time_median2.0500000000000007
deviation-center-line_median0.09687098510612133
in-drivable-lane_median0.4500000000000002


other stats
agent_compute-ego_max0.02973506667397239
agent_compute-ego_mean0.02582173045157495
agent_compute-ego_median0.025766976674397788
agent_compute-ego_min0.020094255606333416
deviation-center-line_max0.23261450644924175
deviation-center-line_mean0.09978733911587848
deviation-center-line_min0.05490406966943519
deviation-heading_max0.7002960682232355
deviation-heading_mean0.33441413138792325
deviation-heading_median0.30410032611577853
deviation-heading_min0.1541202345559414
driven_any_max2.049654638257259
driven_any_mean1.0200634097564325
driven_any_median1.0296612854712788
driven_any_min0.37149985167138455
driven_lanedir_consec_max1.2187176370157662
driven_lanedir_consec_mean0.6231087646131666
driven_lanedir_consec_min0.3341891362194134
driven_lanedir_max1.2187176370157662
driven_lanedir_mean0.6231087646131666
driven_lanedir_median0.43495812661747424
driven_lanedir_min0.3341891362194134
in-drivable-lane_max2.149999999999994
in-drivable-lane_mean0.5999999999999993
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.15143495798110962, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.01254568099975586, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.02727839946746826, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.009492641687393189, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.004924917221069336, "sim_compute_performance-ego": 0.007803994417190552, "sim_compute_robot_state-ego": 0.008948451280593872, "sim_compute_robot_state-npc0": 0.008581846952438354, "sim_compute_robot_state-npc1": 0.008532780408859252, "sim_compute_robot_state-npc2": 0.008752518892288208, "sim_compute_robot_state-npc3": 0.008427929878234864}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4605114688305785, "sim_physics": 0.29991547627882525, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.014540661465037952, "in-drivable-lane": 0, "agent_compute-ego": 0.02928517081520774, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.014699209820140492, "deviation-center-line": 0.0772648215662309, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.006325244903564453, "sim_compute_performance-ego": 0.008786645802584562, "sim_compute_robot_state-ego": 0.010734178803183817, "sim_compute_robot_state-npc0": 0.01042574102228338, "sim_compute_robot_state-npc1": 0.010414296930486506, "sim_compute_robot_state-npc2": 0.011854800311001864, "sim_compute_robot_state-npc3": 0.01027071475982666}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.20836934645970664, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.012699715296427407, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.027571916580200195, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.01048125425974528, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.0052270611127217615, "sim_compute_performance-ego": 0.007231382528940836, "sim_compute_robot_state-ego": 0.00980970859527588, "sim_compute_robot_state-npc0": 0.008759383360544841, "sim_compute_robot_state-npc1": 0.008291256427764893, "sim_compute_robot_state-npc2": 0.008445223172505697, "sim_compute_robot_state-npc3": 0.00823228359222412}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59965468873004, "sim_physics": 0.19356000026067097, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2187176370157662, "sim_render-ego": 0.011619027455647786, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.025766976674397788, "deviation-heading": 0.2793068494541745, "set_robot_commands": 0.009473299980163576, "deviation-center-line": 0.11447341980984076, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.004919079939524332, "sim_compute_performance-ego": 0.006786123911539713, "sim_compute_robot_state-ego": 0.008370725313822429, "sim_compute_robot_state-npc0": 0.00892182985941569, "sim_compute_robot_state-npc1": 0.008507903416951497, "sim_compute_robot_state-npc2": 0.00886397361755371, "sim_compute_robot_state-npc3": 0.008709784348805745}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810249, "sim_physics": 0.15208804607391355, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3872027169265986, "sim_render-ego": 0.012231719493865967, "in-drivable-lane": 0, "agent_compute-ego": 0.02633359432220459, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.008677685260772705, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3872027169265986, "sim_compute_sim_state": 0.005760562419891357, "sim_compute_performance-ego": 0.006864774227142334, "sim_compute_robot_state-ego": 0.008926331996917725, "sim_compute_robot_state-npc0": 0.00813450813293457, "sim_compute_robot_state-npc1": 0.008138310909271241, "sim_compute_robot_state-npc2": 0.008649349212646484, "sim_compute_robot_state-npc3": 0.008508002758026123}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0596597849416751, "sim_physics": 0.17437881515139625, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4194320481036524, "sim_render-ego": 0.012924784705752418, "in-drivable-lane": 0.8500000000000006, "agent_compute-ego": 0.027408145722888765, "deviation-heading": 0.7002960682232355, "set_robot_commands": 0.010197071802048456, "deviation-center-line": 0.1184982840435769, "driven_lanedir_consec": 0.4194320481036524, "sim_compute_sim_state": 0.005129978770301456, "sim_compute_performance-ego": 0.00719319638751802, "sim_compute_robot_state-ego": 0.008800319262913294, "sim_compute_robot_state-npc0": 0.009513968513125463, "sim_compute_robot_state-npc1": 0.008993631317501976, "sim_compute_robot_state-npc2": 0.008564063480922155, "sim_compute_robot_state-npc3": 0.008758777663821266}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9996632207705796, "sim_physics": 0.15480607151985168, "survival_time": 2.000000000000001, "driven_lanedir": 0.6650890986148248, "sim_render-ego": 0.011583083868026731, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.025722366571426392, "deviation-heading": 0.4487014341183701, "set_robot_commands": 0.009621894359588623, "deviation-center-line": 0.10928357993966978, "driven_lanedir_consec": 0.6650890986148248, "sim_compute_sim_state": 0.004909509420394897, "sim_compute_performance-ego": 0.0070838391780853275, "sim_compute_robot_state-ego": 0.008753049373626708, "sim_compute_robot_state-npc0": 0.00882619023323059, "sim_compute_robot_state-npc1": 0.008377611637115479, "sim_compute_robot_state-npc2": 0.00839504599571228, "sim_compute_robot_state-npc3": 0.008215290307998658}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.049654638257259, "sim_physics": 0.2025238577524821, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7460407290516171, "sim_render-ego": 0.011991100311279297, "in-drivable-lane": 2.149999999999994, "agent_compute-ego": 0.025521917343139647, "deviation-heading": 0.30410032611577853, "set_robot_commands": 0.00824644406636556, "deviation-center-line": 0.1152644463841786, "driven_lanedir_consec": 0.7460407290516171, "sim_compute_sim_state": 0.004925181070963541, "sim_compute_performance-ego": 0.006865332921346029, "sim_compute_robot_state-ego": 0.008609565099080403, "sim_compute_robot_state-npc0": 0.00794979731241862, "sim_compute_robot_state-npc1": 0.007931432723999023, "sim_compute_robot_state-npc2": 0.008377450307210287, "sim_compute_robot_state-npc3": 0.00823648452758789}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0296612854712894, "sim_physics": 0.1594786120624077, "survival_time": 2.0500000000000007, "driven_lanedir": 0.3882646174160169, "sim_render-ego": 0.012257971414705604, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.02566261407805652, "deviation-heading": 0.2534940122720117, "set_robot_commands": 0.009455506394549116, "deviation-center-line": 0.07868203516863714, "driven_lanedir_consec": 0.3882646174160169, "sim_compute_sim_state": 0.0048045530551817355, "sim_compute_performance-ego": 0.006958984747165587, "sim_compute_robot_state-ego": 0.008848975344402035, "sim_compute_robot_state-npc0": 0.008383111255924875, "sim_compute_robot_state-npc1": 0.007967192952225848, "sim_compute_robot_state-npc2": 0.007733019386849753, "sim_compute_robot_state-npc3": 0.007961499981763886}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.46051146883057537, "sim_physics": 0.2254119352860884, "survival_time": 1.1000000000000003, "driven_lanedir": 0.44436723204554784, "sim_render-ego": 0.013034885579889473, "in-drivable-lane": 0, "agent_compute-ego": 0.02973506667397239, "deviation-heading": 0.29213064768397096, "set_robot_commands": 0.010783228007229893, "deviation-center-line": 0.06393803408849831, "driven_lanedir_consec": 0.44436723204554784, "sim_compute_sim_state": 0.00594507564197887, "sim_compute_performance-ego": 0.008594805544072931, "sim_compute_robot_state-ego": 0.009246208451010964, "sim_compute_robot_state-npc0": 0.00952678376978094, "sim_compute_robot_state-npc1": 0.008929913694208319, "sim_compute_robot_state-npc2": 0.008388074961575594, "sim_compute_robot_state-npc3": 0.009963945908979937}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.37149985167138455, "sim_physics": 0.23185154011375023, "survival_time": 0.9500000000000004, "driven_lanedir": 0.35179947184110283, "sim_render-ego": 0.01313747857746325, "in-drivable-lane": 0, "agent_compute-ego": 0.028060825247513625, "deviation-heading": 0.3107679325636635, "set_robot_commands": 0.011459200005782278, "deviation-center-line": 0.05490406966943519, "driven_lanedir_consec": 0.35179947184110283, "sim_compute_sim_state": 0.004872685984561318, "sim_compute_performance-ego": 0.0067390517184608865, "sim_compute_robot_state-ego": 0.008805726703844573, "sim_compute_robot_state-npc0": 0.008429539831061112, "sim_compute_robot_state-npc1": 0.008410742408350894, "sim_compute_robot_state-npc2": 0.008492080788863333, "sim_compute_robot_state-npc3": 0.007776937986675061}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4307612897755764, "sim_physics": 0.1620331264677502, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261301360773668, "sim_render-ego": 0.012508392333984377, "in-drivable-lane": 0, "agent_compute-ego": 0.023986850466047017, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.00994910512651716, "deviation-center-line": 0.09941450694466288, "driven_lanedir_consec": 0.4261301360773668, "sim_compute_sim_state": 0.005117393675304595, "sim_compute_performance-ego": 0.006532828013102214, "sim_compute_robot_state-ego": 0.007771321705409459, "sim_compute_robot_state-npc0": 0.007753224599929083, "sim_compute_robot_state-npc1": 0.008093323026384627, "sim_compute_robot_state-npc2": 0.00801494008018857, "sim_compute_robot_state-npc3": 0.008636769794282458}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0296612854712788, "sim_physics": 0.1375828254513624, "survival_time": 2.0500000000000007, "driven_lanedir": 0.3341891362194134, "sim_render-ego": 0.010565007605203769, "in-drivable-lane": 1.1500000000000006, "agent_compute-ego": 0.02410464752011183, "deviation-heading": 0.1931703465763851, "set_robot_commands": 0.008335410094842679, "deviation-center-line": 0.09687098510612133, "driven_lanedir_consec": 0.3341891362194134, "sim_compute_sim_state": 0.004581166476738162, "sim_compute_performance-ego": 0.006486433308298995, "sim_compute_robot_state-ego": 0.007841273051936453, "sim_compute_robot_state-npc0": 0.007120824441677187, "sim_compute_robot_state-npc1": 0.007100739130159703, "sim_compute_robot_state-npc2": 0.006884667931533441, "sim_compute_robot_state-npc3": 0.0069973119875279865}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5996546887300007, "sim_physics": 0.13105512857437135, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2178752145687624, "sim_render-ego": 0.009212851524353027, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.020094255606333416, "deviation-heading": 0.508484918322853, "set_robot_commands": 0.00725627342859904, "deviation-center-line": 0.23261450644924175, "driven_lanedir_consec": 1.2178752145687624, "sim_compute_sim_state": 0.0037570118904113768, "sim_compute_performance-ego": 0.005265486240386963, "sim_compute_robot_state-ego": 0.006552990277608236, "sim_compute_robot_state-npc0": 0.0064753532409667965, "sim_compute_robot_state-npc1": 0.006062634785970052, "sim_compute_robot_state-npc2": 0.00603405237197876, "sim_compute_robot_state-npc3": 0.006152506669362386}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2096560704846235, "sim_physics": 0.14609440336836146, "survival_time": 2.3499999999999996, "driven_lanedir": 0.4085053433383865, "sim_render-ego": 0.009361262017108024, "in-drivable-lane": 1.2999999999999994, "agent_compute-ego": 0.020793209684656023, "deviation-heading": 0.3389915723746089, "set_robot_commands": 0.007749811131903466, "deviation-center-line": 0.06805678782796773, "driven_lanedir_consec": 0.4085053433383865, "sim_compute_sim_state": 0.0036084296855520698, "sim_compute_performance-ego": 0.005453469905447453, "sim_compute_robot_state-ego": 0.006622598526325632, "sim_compute_robot_state-npc0": 0.006818061179303108, "sim_compute_robot_state-npc1": 0.0063380383430643285, "sim_compute_robot_state-npc2": 0.006061772082714324, "sim_compute_robot_state-npc3": 0.006326081904959172}}
set_robot_commands_max0.014699209820140492
set_robot_commands_mean0.009725202361709434
set_robot_commands_median0.009492641687393189
set_robot_commands_min0.00725627342859904
sim_compute_performance-ego_max0.008786645802584562
sim_compute_performance-ego_mean0.00697642325675216
sim_compute_performance-ego_median0.006865332921346029
sim_compute_performance-ego_min0.005265486240386963
sim_compute_robot_state-ego_max0.010734178803183817
sim_compute_robot_state-ego_mean0.008576094919063434
sim_compute_robot_state-ego_median0.008800319262913294
sim_compute_robot_state-ego_min0.006552990277608236
sim_compute_robot_state-npc0_max0.01042574102228338
sim_compute_robot_state-npc0_mean0.008374677580335641
sim_compute_robot_state-npc0_median0.008429539831061112
sim_compute_robot_state-npc0_min0.0064753532409667965
sim_compute_robot_state-npc1_max0.010414296930486506
sim_compute_robot_state-npc1_mean0.008139320540820909
sim_compute_robot_state-npc1_median0.008291256427764893
sim_compute_robot_state-npc1_min0.006062634785970052
sim_compute_robot_state-npc2_max0.011854800311001864
sim_compute_robot_state-npc2_mean0.00823406883956963
sim_compute_robot_state-npc2_median0.00839504599571228
sim_compute_robot_state-npc2_min0.00603405237197876
sim_compute_robot_state-npc3_max0.01027071475982666
sim_compute_robot_state-npc3_mean0.008211621471338413
sim_compute_robot_state-npc3_median0.00823648452758789
sim_compute_robot_state-npc3_min0.006152506669362386
sim_compute_sim_state_max0.006325244903564453
sim_compute_sim_state_mean0.00498719008454395
sim_compute_sim_state_median0.004924917221069336
sim_compute_sim_state_min0.0036084296855520698
sim_physics_max0.29991547627882525
sim_physics_mean0.1820389428534699
sim_physics_median0.1620331264677502
sim_physics_min0.13105512857437135
sim_render-ego_max0.014540661465037952
sim_render-ego_mean0.012014241509900063
sim_render-ego_median0.012257971414705604
sim_render-ego_min0.009212851524353027
simulation-passed1
survival_time_max3.7499999999999942
survival_time_mean2.0333333333333328
survival_time_min0.9500000000000004
No reset possible
248474314Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LF-sim-testingstep1-simulationsuccessnoip-172-31-45-34-104990:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.03817297487842793
agent_compute-ego_mean0.02340406191136824
agent_compute-ego_median0.022047200445401465
agent_compute-ego_min0.01949697494506836
deviation-center-line_max0.28386357003337986
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652288
deviation-heading_median0.3292838510353387
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.975949037827615
driven_any_median1.0117660515775695
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063861
driven_lanedir_consec_mean0.6896171461819268
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063861
driven_lanedir_mean0.6896171461819268
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.09138276841905382, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.011087947421603732, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.020851748960989493, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008453567822774252, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004350688722398546, "sim_compute_performance-ego": 0.006684638835765698, "sim_compute_robot_state-ego": 0.007654812600877549}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10782726138245824, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.011118711209764667, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0209806853649663, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00924238036660587, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.004700010898066502, "sim_compute_performance-ego": 0.006354453516941445, "sim_compute_robot_state-ego": 0.008321313297047335}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13409851579105153, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.014124786152559169, "in-drivable-lane": 0, "agent_compute-ego": 0.025155081468469957, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.011700882631189685, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.005809882107902975, "sim_compute_performance-ego": 0.00906689026776482, "sim_compute_robot_state-ego": 0.011124582851634306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08375667572021485, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.009708232879638672, "in-drivable-lane": 0, "agent_compute-ego": 0.01949697494506836, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.007297067642211914, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004128913879394531, "sim_compute_performance-ego": 0.006348886489868164, "sim_compute_robot_state-ego": 0.008159828186035157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.1197691114642952, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.013128353070609175, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02388930622535416, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.010507740551912332, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0055655527718459505, "sim_compute_performance-ego": 0.00769357741633548, "sim_compute_robot_state-ego": 0.009479498561424543}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.14110201718855878, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.014167211493667292, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.03817297487842793, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.012799438165158642, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.006022540890440649, "sim_compute_performance-ego": 0.008564734945491868, "sim_compute_robot_state-ego": 0.011094803712805924}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.10024920531681604, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.012316882610321043, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.021279415913990567, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.008992190871919905, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.004912384918757847, "sim_compute_performance-ego": 0.007125769342694964, "sim_compute_robot_state-ego": 0.008622620786939348}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13057967594691686, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.024441151391892207, "in-drivable-lane": 0, "agent_compute-ego": 0.025227819170270647, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.010928063165573846, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.005204859234037853, "sim_compute_performance-ego": 0.0076576414562406995, "sim_compute_robot_state-ego": 0.010353633335658485}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.1035067388566874, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.012214313119144764, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.022047200445401465, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.009533021409632796, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.005093913967326536, "sim_compute_performance-ego": 0.007205146854206667, "sim_compute_robot_state-ego": 0.008824465638500149}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.10630862496115943, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.015471397746693004, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.021382769671353427, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.009038691087202592, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.004862989078868519, "sim_compute_performance-ego": 0.007182390039617365, "sim_compute_robot_state-ego": 0.008662080764770508}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.14152501465438247, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.014346624349618886, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.022897556230619356, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.009103072154057493, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.004875941710038619, "sim_compute_performance-ego": 0.007187174512194349, "sim_compute_robot_state-ego": 0.009081552555034686}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.106807461806706, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.01281524556023734, "in-drivable-lane": 0, "agent_compute-ego": 0.02369047062737601, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.01043856143951416, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.005113635744367327, "sim_compute_performance-ego": 0.007431796618870327, "sim_compute_robot_state-ego": 0.009706956999642509}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.09780417236627316, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.011603056215772442, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.021489779154459637, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.008167916653203029, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.004258113748887006, "sim_compute_performance-ego": 0.007545789082845052, "sim_compute_robot_state-ego": 0.008862177530924479}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09276412151477954, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.012151205981219255, "in-drivable-lane": 0, "agent_compute-ego": 0.019797987408108186, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.0075882187596073855, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.004491338023432979, "sim_compute_performance-ego": 0.0072143254456696684, "sim_compute_robot_state-ego": 0.00877913722285518}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.11780204492456772, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.012543224820903705, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.024701158205668133, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.010556863803489537, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.005284608579149433, "sim_compute_performance-ego": 0.007319130149542117, "sim_compute_robot_state-ego": 0.009362571379717658}}
set_robot_commands_max0.012799438165158642
set_robot_commands_mean0.009623178434936897
set_robot_commands_median0.00924238036660587
set_robot_commands_min0.007297067642211914
sim_compute_performance-ego_max0.00906689026776482
sim_compute_performance-ego_mean0.007372156331603246
sim_compute_performance-ego_median0.0072143254456696684
sim_compute_performance-ego_min0.006348886489868164
sim_compute_robot_state-ego_max0.011124582851634306
sim_compute_robot_state-ego_mean0.009206002361591187
sim_compute_robot_state-ego_median0.008862177530924479
sim_compute_robot_state-ego_min0.007654812600877549
sim_compute_sim_state_max0.006022540890440649
sim_compute_sim_state_mean0.0049783582849943515
sim_compute_sim_state_median0.004912384918757847
sim_compute_sim_state_min0.004128913879394531
sim_physics_max0.14152501465438247
sim_physics_mean0.11168556068759476
sim_physics_median0.106807461806706
sim_physics_min0.08375667572021485
sim_render-ego_max0.024441151391892207
sim_render-ego_mean0.013415889601576358
sim_render-ego_median0.012543224820903705
sim_render-ego_min0.009708232879638672
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
248404332Soroush Saryazdi 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-testingstep1-simulationsuccessnoip-172-31-45-34-104990:14:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.02396154845202411
agent_compute-ego_mean0.021233802671267673
agent_compute-ego_median0.021450980713492947
agent_compute-ego_min0.01511592214757746
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1112205456826628
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.37150980594423094
deviation-heading_median0.34774352178293905
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589055
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.13810169255291974, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010779107058489765, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.021878410268712928, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008704494546960902, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004264275232950847, "sim_compute_performance-ego": 0.006292453518620244, "sim_compute_robot_state-ego": 0.007691445174040618, "sim_compute_robot_state-npc0": 0.007488180089879919, "sim_compute_robot_state-npc1": 0.007409316522103769, "sim_compute_robot_state-npc2": 0.007441944546169705, "sim_compute_robot_state-npc3": 0.007436460918850369}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.1286558437347412, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.008147201538085937, "in-drivable-lane": 0, "agent_compute-ego": 0.018925905227661133, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.006094655990600586, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003282804489135742, "sim_compute_performance-ego": 0.004713163375854492, "sim_compute_robot_state-ego": 0.006040992736816406, "sim_compute_robot_state-npc0": 0.005537309646606445, "sim_compute_robot_state-npc1": 0.0054490756988525395, "sim_compute_robot_state-npc2": 0.0054070186614990235, "sim_compute_robot_state-npc3": 0.00531698226928711}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18075900956204063, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.011285101112566497, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.021450980713492947, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.008868841748488577, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.005062078174791838, "sim_compute_performance-ego": 0.006510201253389057, "sim_compute_robot_state-ego": 0.008226011928759124, "sim_compute_robot_state-npc0": 0.008253012832842375, "sim_compute_robot_state-npc1": 0.007419056014010781, "sim_compute_robot_state-npc2": 0.0081288406723424, "sim_compute_robot_state-npc3": 0.007411109773736251}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.1884899048865596, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.01179922683329522, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02224556102028376, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.009313441530058655, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.004860226112075999, "sim_compute_performance-ego": 0.006939595258688625, "sim_compute_robot_state-ego": 0.008727834194521361, "sim_compute_robot_state-npc0": 0.008525797083408018, "sim_compute_robot_state-npc1": 0.008299978473518469, "sim_compute_robot_state-npc2": 0.008290251599082464, "sim_compute_robot_state-npc3": 0.007894896253754821}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.1660165020397731, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.012727737426757812, "in-drivable-lane": 0, "agent_compute-ego": 0.02165682826723371, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0094882675579616, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0049591064453125, "sim_compute_performance-ego": 0.007274627685546875, "sim_compute_robot_state-ego": 0.008842442716870989, "sim_compute_robot_state-npc0": 0.008562036922999791, "sim_compute_robot_state-npc1": 0.008320135729653495, "sim_compute_robot_state-npc2": 0.008300134113856725, "sim_compute_robot_state-npc3": 0.008451410702296666}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.18005488095460115, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.012038111686706545, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.02396154845202411, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.010506281146296748, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.004912676634611907, "sim_compute_performance-ego": 0.0071192582448323565, "sim_compute_robot_state-ego": 0.008850093241091128, "sim_compute_robot_state-npc0": 0.008908254128915293, "sim_compute_robot_state-npc1": 0.00884780177363643, "sim_compute_robot_state-npc2": 0.00814593721319128, "sim_compute_robot_state-npc3": 0.00801641411251492}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0456729849899615, "sim_physics": 0.17230978276994494, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.01165520261835169, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.02098991694273772, "deviation-heading": 0.3927366768210136, "set_robot_commands": 0.008421544675473814, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.004407948917812771, "sim_compute_performance-ego": 0.006587377300968877, "sim_compute_robot_state-ego": 0.008408723054108795, "sim_compute_robot_state-npc0": 0.00834031899770101, "sim_compute_robot_state-npc1": 0.007769151970192238, "sim_compute_robot_state-npc2": 0.007676137818230523, "sim_compute_robot_state-npc3": 0.007632816279375994}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8772562288570896, "sim_physics": 0.20699765417310928, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.011331150266859267, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.021167559093899196, "deviation-heading": 0.3844740406851849, "set_robot_commands": 0.009436776902940536, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.0042914867401123045, "sim_compute_performance-ego": 0.006937360763549805, "sim_compute_robot_state-ego": 0.00815009011162652, "sim_compute_robot_state-npc0": 0.008280605740017362, "sim_compute_robot_state-npc1": 0.007754415935940213, "sim_compute_robot_state-npc2": 0.007275131013658311, "sim_compute_robot_state-npc3": 0.007351430257161459}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.843301097417158, "sim_physics": 0.16905808967092764, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.012078072713769, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.023297605307205864, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.009146037309066109, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.00534063836802607, "sim_compute_performance-ego": 0.007321974505548892, "sim_compute_robot_state-ego": 0.009362526561902918, "sim_compute_robot_state-npc0": 0.008796396462813667, "sim_compute_robot_state-npc1": 0.0085070858830991, "sim_compute_robot_state-npc2": 0.008428076039189878, "sim_compute_robot_state-npc3": 0.008435477381167204}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.19372125148773192, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.011707930564880372, "in-drivable-lane": 0, "agent_compute-ego": 0.02133404731750488, "deviation-heading": 0.34774352178293905, "set_robot_commands": 0.009428853988647462, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.00477449893951416, "sim_compute_performance-ego": 0.006789121627807617, "sim_compute_robot_state-ego": 0.008516521453857421, "sim_compute_robot_state-npc0": 0.008381705284118652, "sim_compute_robot_state-npc1": 0.00835258960723877, "sim_compute_robot_state-npc2": 0.008117427825927734, "sim_compute_robot_state-npc3": 0.008319506645202637}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.25979199409484866, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.01259469985961914, "in-drivable-lane": 0, "agent_compute-ego": 0.02250533103942871, "deviation-heading": 0.3801610449156702, "set_robot_commands": 0.009935760498046876, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.0048060774803161625, "sim_compute_performance-ego": 0.007602357864379883, "sim_compute_robot_state-ego": 0.009973263740539553, "sim_compute_robot_state-npc0": 0.009054064750671388, "sim_compute_robot_state-npc1": 0.008970904350280761, "sim_compute_robot_state-npc2": 0.00899127721786499, "sim_compute_robot_state-npc3": 0.008442354202270509}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1617003365566856, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.011746569683677271, "in-drivable-lane": 0, "agent_compute-ego": 0.020975351333618164, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.009799819243581672, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.004562779476768092, "sim_compute_performance-ego": 0.007048958226254112, "sim_compute_robot_state-ego": 0.009183381733141448, "sim_compute_robot_state-npc0": 0.009263026086907638, "sim_compute_robot_state-npc1": 0.007857724239951685, "sim_compute_robot_state-npc2": 0.008304031271683542, "sim_compute_robot_state-npc3": 0.008033576764558492}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700496, "sim_physics": 0.16520081520080565, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.01202341079711914, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.021865949630737305, "deviation-heading": 0.2263485117662672, "set_robot_commands": 0.00955225944519043, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.004768118858337402, "sim_compute_performance-ego": 0.007389726638793945, "sim_compute_robot_state-ego": 0.008712997436523437, "sim_compute_robot_state-npc0": 0.00843569278717041, "sim_compute_robot_state-npc1": 0.008141798973083496, "sim_compute_robot_state-npc2": 0.008154625892639161, "sim_compute_robot_state-npc3": 0.00811309814453125}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3514429441281624, "sim_physics": 0.14613999019969592, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.008276354182850231, "in-drivable-lane": 0, "agent_compute-ego": 0.01511592214757746, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.006134650923989036, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.0032943270423195577, "sim_compute_performance-ego": 0.004562432115728205, "sim_compute_robot_state-ego": 0.005897771228443493, "sim_compute_robot_state-npc0": 0.005485523830760609, "sim_compute_robot_state-npc1": 0.005381898446516557, "sim_compute_robot_state-npc2": 0.005499536340886896, "sim_compute_robot_state-npc3": 0.0053814866326072}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.18121101418320013, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.01135497677082918, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.021136123306897223, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.008438071426080197, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.004178382912460639, "sim_compute_performance-ego": 0.006415357395094268, "sim_compute_robot_state-ego": 0.008031407181097537, "sim_compute_robot_state-npc0": 0.007841733037209024, "sim_compute_robot_state-npc1": 0.007301398686000279, "sim_compute_robot_state-npc2": 0.007473585556964485, "sim_compute_robot_state-npc3": 0.00728101633032974}}
set_robot_commands_max0.010506281146296748
set_robot_commands_mean0.008884650462225547
set_robot_commands_median0.009313441530058655
set_robot_commands_min0.006094655990600586
sim_compute_performance-ego_max0.007602357864379883
sim_compute_performance-ego_mean0.00663359771833715
sim_compute_performance-ego_median0.006937360763549805
sim_compute_performance-ego_min0.004562432115728205
sim_compute_robot_state-ego_max0.009973263740539553
sim_compute_robot_state-ego_mean0.008307700166222719
sim_compute_robot_state-ego_median0.008516521453857421
sim_compute_robot_state-ego_min0.005897771228443493
sim_compute_robot_state-npc0_max0.009263026086907638
sim_compute_robot_state-npc0_mean0.008076910512134772
sim_compute_robot_state-npc0_median0.008381705284118652
sim_compute_robot_state-npc0_min0.005485523830760609
sim_compute_robot_state-npc1_max0.008970904350280761
sim_compute_robot_state-npc1_mean0.007718822153605239
sim_compute_robot_state-npc1_median0.007857724239951685
sim_compute_robot_state-npc1_min0.005381898446516557
sim_compute_robot_state-npc2_max0.00899127721786499
sim_compute_robot_state-npc2_mean0.007708930385545808
sim_compute_robot_state-npc2_median0.0081288406723424
sim_compute_robot_state-npc2_min0.0054070186614990235
sim_compute_robot_state-npc3_max0.008451410702296666
sim_compute_robot_state-npc3_mean0.007567869111176307
sim_compute_robot_state-npc3_median0.007894896253754821
sim_compute_robot_state-npc3_min0.00531698226928711
sim_compute_sim_state_max0.00534063836802607
sim_compute_sim_state_mean0.004517695054969734
sim_compute_sim_state_median0.004768118858337402
sim_compute_sim_state_min0.003282804489135742
sim_physics_max0.25979199409484866
sim_physics_mean0.175880584137839
sim_physics_median0.17230978276994494
sim_physics_min0.1286558437347412
sim_render-ego_max0.012727737426757812
sim_render-ego_mean0.011302990207590468
sim_render-ego_median0.011707930564880372
sim_render-ego_min0.008147201538085937
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
248294333Soroush Saryazdi 🇨🇦challenge-aido_LF-template-randomaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.027042244161878313
agent_compute-ego_mean0.023891114726588204
agent_compute-ego_median0.023592327214494536
agent_compute-ego_min0.02145391923409921
deviation-center-line_max0.17439134565029044
deviation-center-line_mean0.1265175655253199
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599271
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811225
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589055
driven_any_mean1.0272530755098268
driven_any_median1.0243289631429704
driven_any_min0.4119037580118985
driven_lanedir_consec_max1.2433038249708372
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708372
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.15477323532104492, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.01126537941120289, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.02145391923409921, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.009053799841139052, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004571261229338469, "sim_compute_performance-ego": 0.007032363503067581, "sim_compute_robot_state-ego": 0.009163048532274034, "sim_compute_robot_state-npc0": 0.007817683396516022, "sim_compute_robot_state-npc1": 0.007660667101542155, "sim_compute_robot_state-npc2": 0.007702319710342972, "sim_compute_robot_state-npc3": 0.007596815073931658}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.2115395450592041, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.01331131935119629, "in-drivable-lane": 0, "agent_compute-ego": 0.02391240119934082, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.010699777603149416, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.005367212295532227, "sim_compute_performance-ego": 0.007891225814819335, "sim_compute_robot_state-ego": 0.00976238250732422, "sim_compute_robot_state-npc0": 0.009210805892944336, "sim_compute_robot_state-npc1": 0.008860635757446288, "sim_compute_robot_state-npc2": 0.008877029418945312, "sim_compute_robot_state-npc3": 0.008958683013916016}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1977396983849375, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.011870145797729492, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023454681823128147, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.00998238199635556, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.004793863547475715, "sim_compute_performance-ego": 0.007272965029666298, "sim_compute_robot_state-ego": 0.008481248428947047, "sim_compute_robot_state-npc0": 0.008630159654115377, "sim_compute_robot_state-npc1": 0.007903453550840678, "sim_compute_robot_state-npc2": 0.008169986699756823, "sim_compute_robot_state-npc3": 0.0078013382459941666}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.2405616422242756, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.012718408922605876, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.023592327214494536, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.011067314992977096, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.00536285171025916, "sim_compute_performance-ego": 0.007257023944130427, "sim_compute_robot_state-ego": 0.009853172905837431, "sim_compute_robot_state-npc0": 0.009551887270770497, "sim_compute_robot_state-npc1": 0.008799613276614418, "sim_compute_robot_state-npc2": 0.009205296069760864, "sim_compute_robot_state-npc3": 0.009257769282860092}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.1838720100266593, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.013547803674425398, "in-drivable-lane": 0, "agent_compute-ego": 0.027042244161878313, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.009656020573207313, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.005429327487945557, "sim_compute_performance-ego": 0.007635133607046944, "sim_compute_robot_state-ego": 0.009532383510044642, "sim_compute_robot_state-npc0": 0.00828049864087786, "sim_compute_robot_state-npc1": 0.007871312754494804, "sim_compute_robot_state-npc2": 0.008132977145058768, "sim_compute_robot_state-npc3": 0.00842771359852382}}
set_robot_commands_max0.011067314992977096
set_robot_commands_mean0.010091859001365689
set_robot_commands_median0.00998238199635556
set_robot_commands_min0.009053799841139052
sim_compute_performance-ego_max0.007891225814819335
sim_compute_performance-ego_mean0.007417742379746117
sim_compute_performance-ego_median0.007272965029666298
sim_compute_performance-ego_min0.007032363503067581
sim_compute_robot_state-ego_max0.009853172905837431
sim_compute_robot_state-ego_mean0.009358447176885476
sim_compute_robot_state-ego_median0.009532383510044642
sim_compute_robot_state-ego_min0.008481248428947047
sim_compute_robot_state-npc0_max0.009551887270770497
sim_compute_robot_state-npc0_mean0.00869820697104482
sim_compute_robot_state-npc0_median0.008630159654115377
sim_compute_robot_state-npc0_min0.007817683396516022
sim_compute_robot_state-npc1_max0.008860635757446288
sim_compute_robot_state-npc1_mean0.00821913648818767
sim_compute_robot_state-npc1_median0.007903453550840678
sim_compute_robot_state-npc1_min0.007660667101542155
sim_compute_robot_state-npc2_max0.009205296069760864
sim_compute_robot_state-npc2_mean0.008417521808772949
sim_compute_robot_state-npc2_median0.008169986699756823
sim_compute_robot_state-npc2_min0.007702319710342972
sim_compute_robot_state-npc3_max0.009257769282860092
sim_compute_robot_state-npc3_mean0.008408463843045149
sim_compute_robot_state-npc3_median0.00842771359852382
sim_compute_robot_state-npc3_min0.007596815073931658
sim_compute_sim_state_max0.005429327487945557
sim_compute_sim_state_mean0.005104903254110225
sim_compute_sim_state_median0.00536285171025916
sim_compute_sim_state_min0.004571261229338469
sim_physics_max0.2405616422242756
sim_physics_mean0.1976972262032243
sim_physics_median0.1977396983849375
sim_physics_min0.15477323532104492
sim_render-ego_max0.013547803674425398
sim_render-ego_mean0.012542611431431988
sim_render-ego_median0.012718408922605876
sim_render-ego_min0.01126537941120289
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
248194323Riza Velioglu 🇩🇪UniBielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-45-34-104990:05:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247984341Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-45-34-104990:27:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247864330Soroush Saryazdi 🇨🇦challenge-aido_LF-template-randomaido3-LF-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.01936267923425745
agent_compute-ego_mean0.017741082958830444
agent_compute-ego_median0.018046369739607267
agent_compute-ego_min0.015079329995548023
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989765
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.6182144577009443
driven_any_mean0.861378585933269
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07394606537289089, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010372475341514304, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01936267923425745, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006270236439175076, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.00418685100696705, "sim_compute_performance-ego": 0.00611944110305221, "sim_compute_robot_state-ego": 0.0069682421507658784}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06913209428974226, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.009931358636594284, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.018046369739607267, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.006123809253468233, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.00411684372845818, "sim_compute_performance-ego": 0.005430866690242992, "sim_compute_robot_state-ego": 0.007217823290357403}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.057056553223553824, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.008516578113331515, "in-drivable-lane": 0, "agent_compute-ego": 0.015079329995548023, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0052457837497486785, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.00317995688494514, "sim_compute_performance-ego": 0.004645487841437845, "sim_compute_robot_state-ego": 0.005448677960564108}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06813798904418945, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.009264411926269532, "in-drivable-lane": 0, "agent_compute-ego": 0.01791491508483887, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.00607121467590332, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004404525756835937, "sim_compute_performance-ego": 0.005438528060913086, "sim_compute_robot_state-ego": 0.006916875839233398}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.06487457359893413, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.01000414317167258, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.018302120739900615, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.006388646137865284, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.004184750062000903, "sim_compute_performance-ego": 0.005458315716514104, "sim_compute_robot_state-ego": 0.0066837691053559505}}
set_robot_commands_max0.006388646137865284
set_robot_commands_mean0.006019938051232118
set_robot_commands_median0.006123809253468233
set_robot_commands_min0.0052457837497486785
sim_compute_performance-ego_max0.00611944110305221
sim_compute_performance-ego_mean0.005418527882432047
sim_compute_performance-ego_median0.005438528060913086
sim_compute_performance-ego_min0.004645487841437845
sim_compute_robot_state-ego_max0.007217823290357403
sim_compute_robot_state-ego_mean0.006647077669255347
sim_compute_robot_state-ego_median0.006916875839233398
sim_compute_robot_state-ego_min0.005448677960564108
sim_compute_sim_state_max0.004404525756835937
sim_compute_sim_state_mean0.004014585487841442
sim_compute_sim_state_median0.004184750062000903
sim_compute_sim_state_min0.00317995688494514
sim_physics_max0.07394606537289089
sim_physics_mean0.06662945510586211
sim_physics_median0.06813798904418945
sim_physics_min0.057056553223553824
sim_render-ego_max0.010372475341514304
sim_render-ego_mean0.009617793437876445
sim_render-ego_median0.009931358636594284
sim_render-ego_min0.008516578113331515
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
247824325Gianmarco Bernasconibaseline-IL-sim-tensorflowaido3-LF-sim-validationstep1-simulationerrornoip-172-31-45-34-104990:03:06
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247674320Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LFVI-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.023216815221877324
agent_compute-ego_mean0.02197550477793876
agent_compute-ego_median0.022683680636211505
agent_compute-ego_min0.019856325217655728
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.1354748199226606
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314912
deviation-heading_mean0.49959867397150814
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000703
driven_any_mean1.1068208197848537
driven_any_median0.9410513078477728
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.8262319453635671
driven_lanedir_consec_mean0.8047440134491037
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.8262319453635671
driven_lanedir_mean0.8048281473204828
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19775782053983665, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.012572222118136248, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.022952689400202113, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.008685600908496712, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.005053115796439255, "sim_compute_performance-ego": 0.0067879399166831484, "sim_compute_robot_state-ego": 0.008775892136972161, "sim_compute_robot_state-npc0": 0.008555605441709108, "sim_compute_robot_state-npc1": 0.007953622673131242, "sim_compute_robot_state-npc2": 0.00822886032394216, "sim_compute_robot_state-npc3": 0.007952681070641626}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.1421711700303214, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.010803512164524624, "in-drivable-lane": 0, "agent_compute-ego": 0.019856325217655728, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.007605799606868199, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.004308445113045829, "sim_compute_performance-ego": 0.006213741643088204, "sim_compute_robot_state-ego": 0.007626533508300781, "sim_compute_robot_state-npc0": 0.007200019700186593, "sim_compute_robot_state-npc1": 0.006870627403259277, "sim_compute_robot_state-npc2": 0.006902294499533517, "sim_compute_robot_state-npc3": 0.007128170558384487}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.18446572775979644, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.012561849020059829, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.022683680636211505, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.008134237770895355, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.005084961363412801, "sim_compute_performance-ego": 0.0070763444437564, "sim_compute_robot_state-ego": 0.008593489822832126, "sim_compute_robot_state-npc0": 0.008248729613220807, "sim_compute_robot_state-npc1": 0.008053633773211137, "sim_compute_robot_state-npc2": 0.008512212234793358, "sim_compute_robot_state-npc3": 0.008124974167462691}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.1647495130697886, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.01180422306060791, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.02116801341374715, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.007766246795654297, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.004814058542251587, "sim_compute_performance-ego": 0.0062809983889261884, "sim_compute_robot_state-ego": 0.007964601119359335, "sim_compute_robot_state-npc0": 0.007611855864524841, "sim_compute_robot_state-npc1": 0.007641509175300598, "sim_compute_robot_state-npc2": 0.007727444171905518, "sim_compute_robot_state-npc3": 0.007420410712560018}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20257092657543363, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0129787354242234, "in-drivable-lane": 0, "agent_compute-ego": 0.023216815221877324, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.009665693555559431, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.005432741982596261, "sim_compute_performance-ego": 0.007879790805634997, "sim_compute_robot_state-ego": 0.009407372701735724, "sim_compute_robot_state-npc0": 0.009375447318667456, "sim_compute_robot_state-npc1": 0.008709873471941267, "sim_compute_robot_state-npc2": 0.008543809254964193, "sim_compute_robot_state-npc3": 0.008765652066185362}}
set_robot_commands_max0.009665693555559431
set_robot_commands_mean0.0083715157274948
set_robot_commands_median0.008134237770895355
set_robot_commands_min0.007605799606868199
sim_compute_performance-ego_max0.007879790805634997
sim_compute_performance-ego_mean0.006847763039617788
sim_compute_performance-ego_median0.0067879399166831484
sim_compute_performance-ego_min0.006213741643088204
sim_compute_robot_state-ego_max0.009407372701735724
sim_compute_robot_state-ego_mean0.008473577857840026
sim_compute_robot_state-ego_median0.008593489822832126
sim_compute_robot_state-ego_min0.007626533508300781
sim_compute_robot_state-npc0_max0.009375447318667456
sim_compute_robot_state-npc0_mean0.00819833158766176
sim_compute_robot_state-npc0_median0.008248729613220807
sim_compute_robot_state-npc0_min0.007200019700186593
sim_compute_robot_state-npc1_max0.008709873471941267
sim_compute_robot_state-npc1_mean0.007845853299368705
sim_compute_robot_state-npc1_median0.007953622673131242
sim_compute_robot_state-npc1_min0.006870627403259277
sim_compute_robot_state-npc2_max0.008543809254964193
sim_compute_robot_state-npc2_mean0.00798292409702775
sim_compute_robot_state-npc2_median0.00822886032394216
sim_compute_robot_state-npc2_min0.006902294499533517
sim_compute_robot_state-npc3_max0.008765652066185362
sim_compute_robot_state-npc3_mean0.007878377715046837
sim_compute_robot_state-npc3_median0.007952681070641626
sim_compute_robot_state-npc3_min0.007128170558384487
sim_compute_sim_state_max0.005432741982596261
sim_compute_sim_state_mean0.004938664559549147
sim_compute_sim_state_median0.005053115796439255
sim_compute_sim_state_min0.004308445113045829
sim_physics_max0.20257092657543363
sim_physics_mean0.17834303159503534
sim_physics_median0.18446572775979644
sim_physics_min0.1421711700303214
sim_render-ego_max0.0129787354242234
sim_render-ego_mean0.012144108357510402
sim_render-ego_median0.012561849020059829
sim_render-ego_min0.010803512164524624
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
247644312Tanli Chou 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10410656449399992
error_L20.01719913747257631


No reset possible
247634311Tanli Chou 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10795162179977091
error_L20.018079709443204445


No reset possible
247604309Riza Velioglu 🇩🇪Uni Bielefeldaido3-LF-sim-validationstep1-simulationerrornoip-172-31-45-34-104990:03:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247484306Frank (Chude) Qian 🇨🇦Frank test submissionaido3-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-45-34-104990:12:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4541194076078226
survival_time_median2.0500000000000007
deviation-center-line_median0.1184981700628623
in-drivable-lane_median0


other stats
agent_compute-ego_max0.027868610317424193
agent_compute-ego_mean0.017815647360735758
agent_compute-ego_median0.015655981169806585
agent_compute-ego_min0.01519063711166382
deviation-center-line_max0.27212935355303575
deviation-center-line_mean0.12800192803639482
deviation-center-line_min0.054904029848945685
deviation-heading_max0.9814018754699168
deviation-heading_mean0.39865622452675337
deviation-heading_median0.2921306476839709
deviation-heading_min0.13989224355569133
driven_any_max2.7696546371463566
driven_any_mean1.0880644329743805
driven_any_median1.0296612854712663
driven_any_min0.37149985167138017
driven_lanedir_consec_max1.9242206205397283
driven_lanedir_consec_mean0.7675641832273904
driven_lanedir_consec_min0.33418991107979124
driven_lanedir_max1.924267585170248
driven_lanedir_mean0.7820426634438573
driven_lanedir_median0.618479321964448
driven_lanedir_min0.33418991107979124
in-drivable-lane_max1.899999999999998
in-drivable-lane_mean0.4266666666666661
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5696547037668402, "sim_physics": 0.19261529081958836, "survival_time": 2.9499999999999975, "driven_lanedir": 1.5638383114510817, "sim_render-ego": 0.011508881035497631, "in-drivable-lane": 0, "agent_compute-ego": 0.027868610317424193, "deviation-heading": 0.2528567413804248, "set_robot_commands": 0.00861582109483622, "deviation-center-line": 0.19417316650714284, "driven_lanedir_consec": 1.5636399177084477, "sim_compute_sim_state": 0.004848415568723517, "sim_compute_performance-ego": 0.006881430997686871, "sim_compute_robot_state-ego": 0.008340059700658766, "sim_compute_robot_state-npc0": 0.008060802847652112, "sim_compute_robot_state-npc1": 0.007771685972052105, "sim_compute_robot_state-npc2": 0.007951788983102573, "sim_compute_robot_state-npc3": 0.007598856748160669}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.17653865163976495, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.011656772006641737, "in-drivable-lane": 0, "agent_compute-ego": 0.02486344900998202, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.007986686446449974, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.004805348136208274, "sim_compute_performance-ego": 0.006145097992636941, "sim_compute_robot_state-ego": 0.008558771827004173, "sim_compute_robot_state-npc0": 0.007704994895241477, "sim_compute_robot_state-npc1": 0.007894743572581898, "sim_compute_robot_state-npc2": 0.008709734136408026, "sim_compute_robot_state-npc3": 0.007802594791759144}, "udem1-2-0": {"driven_any": 2.1696546375441614, "sim_physics": 0.17852237254758424, "survival_time": 3.949999999999994, "driven_lanedir": 1.7414407758715231, "sim_render-ego": 0.01150054871281491, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.026838079283509075, "deviation-heading": 0.2785063205851342, "set_robot_commands": 0.008820874781548223, "deviation-center-line": 0.22563902167216496, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.004840506783014611, "sim_compute_performance-ego": 0.00682508794567253, "sim_compute_robot_state-ego": 0.008837690836266626, "sim_compute_robot_state-npc0": 0.008966617946383319, "sim_compute_robot_state-npc1": 0.008247559583639796, "sim_compute_robot_state-npc2": 0.008221282234674767, "sim_compute_robot_state-npc3": 0.008311721343028395}, "udem1-3-0": {"driven_any": 2.7696546371463566, "sim_physics": 0.0975141284441707, "survival_time": 4.94999999999999, "driven_lanedir": 1.924267585170248, "sim_render-ego": 0.007213024177936593, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.015853746972902857, "deviation-heading": 0.2652784439875202, "set_robot_commands": 0.0045246355461351796, "deviation-center-line": 0.27212935355303575, "driven_lanedir_consec": 1.9242206205397283, "sim_compute_sim_state": 0.002859541864106149, "sim_compute_performance-ego": 0.003818225378942008, "sim_compute_robot_state-ego": 0.0049302650220466385, "sim_compute_robot_state-npc0": 0.004791161026617493, "sim_compute_robot_state-npc1": 0.004516355919115471, "sim_compute_robot_state-npc2": 0.004468809474598278, "sim_compute_robot_state-npc3": 0.0044352478451199}, "udem1-4-0": {"driven_any": 0.4010834948810282, "sim_physics": 0.09618276357650755, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38720104799654376, "sim_render-ego": 0.007037007808685302, "in-drivable-lane": 0, "agent_compute-ego": 0.01519063711166382, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.004546475410461426, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38720104799654376, "sim_compute_sim_state": 0.0027670741081237795, "sim_compute_performance-ego": 0.003726184368133545, "sim_compute_robot_state-ego": 0.004914331436157227, "sim_compute_robot_state-npc0": 0.004668259620666504, "sim_compute_robot_state-npc1": 0.004443824291229248, "sim_compute_robot_state-npc2": 0.004422414302825928, "sim_compute_robot_state-npc3": 0.004394519329071045}, "udem1-5-0": {"driven_any": 1.0596597849416796, "sim_physics": 0.09621358485448928, "survival_time": 2.1000000000000005, "driven_lanedir": 0.419433267065787, "sim_render-ego": 0.006982916877383278, "in-drivable-lane": 0.8500000000000006, "agent_compute-ego": 0.015582595552716936, "deviation-heading": 0.7002960066861377, "set_robot_commands": 0.004326689810979934, "deviation-center-line": 0.1184981700628623, "driven_lanedir_consec": 0.419433267065787, "sim_compute_sim_state": 0.0027555113747006373, "sim_compute_performance-ego": 0.003738318170819964, "sim_compute_robot_state-ego": 0.004812757174173991, "sim_compute_robot_state-npc0": 0.004629543849400112, "sim_compute_robot_state-npc1": 0.004415591557820638, "sim_compute_robot_state-npc2": 0.004373800186883835, "sim_compute_robot_state-npc3": 0.004332338060651507}, "udem1-6-0": {"driven_any": 0.8796785144013353, "sim_physics": 0.11261535353130764, "survival_time": 1.800000000000001, "driven_lanedir": 0.8770246919234508, "sim_render-ego": 0.007150842083825005, "in-drivable-lane": 0, "agent_compute-ego": 0.015655981169806585, "deviation-heading": 0.13989224355569133, "set_robot_commands": 0.004620744122399224, "deviation-center-line": 0.15455097642444732, "driven_lanedir_consec": 0.8770246919234508, "sim_compute_sim_state": 0.0028187831242879233, "sim_compute_performance-ego": 0.0037086870935228136, "sim_compute_robot_state-ego": 0.004811671045091417, "sim_compute_robot_state-npc0": 0.0046898192829555934, "sim_compute_robot_state-npc1": 0.004460182454850938, "sim_compute_robot_state-npc2": 0.004431870248582628, "sim_compute_robot_state-npc3": 0.004379067156049941}, "udem1-7-0": {"driven_any": 1.0296612854712832, "sim_physics": 0.10915323001582448, "survival_time": 2.0500000000000007, "driven_lanedir": 0.8977146610328521, "sim_render-ego": 0.007138403450570456, "in-drivable-lane": 0, "agent_compute-ego": 0.015631309369715247, "deviation-heading": 0.7301693312178688, "set_robot_commands": 0.004443087228914586, "deviation-center-line": 0.12694367940927642, "driven_lanedir_consec": 0.8807130056354433, "sim_compute_sim_state": 0.0028388151308385338, "sim_compute_performance-ego": 0.003715962898440477, "sim_compute_robot_state-ego": 0.004817270651096251, "sim_compute_robot_state-npc0": 0.004647952754323076, "sim_compute_robot_state-npc1": 0.00442376369383277, "sim_compute_robot_state-npc2": 0.004416733253292921, "sim_compute_robot_state-npc3": 0.004388053242753192}, "udem1-8-0": {"driven_any": 1.0296612854712663, "sim_physics": 0.09417348373227002, "survival_time": 2.0500000000000007, "driven_lanedir": 0.618479321964448, "sim_render-ego": 0.007105984338899938, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.015483390994188264, "deviation-heading": 0.6847850662034057, "set_robot_commands": 0.004518735699537323, "deviation-center-line": 0.13317992938688095, "driven_lanedir_consec": 0.618479321964448, "sim_compute_sim_state": 0.002765143789896151, "sim_compute_performance-ego": 0.0037406304987465462, "sim_compute_robot_state-ego": 0.004822911285772556, "sim_compute_robot_state-npc0": 0.0046353689054163495, "sim_compute_robot_state-npc1": 0.004419675687464272, "sim_compute_robot_state-npc2": 0.004420757293701172, "sim_compute_robot_state-npc3": 0.004381668276903106}, "udem1-9-0": {"driven_any": 0.4605114688305781, "sim_physics": 0.11308472806757149, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4443672320455454, "sim_render-ego": 0.007236415689641779, "in-drivable-lane": 0, "agent_compute-ego": 0.016168778592889958, "deviation-heading": 0.2921306476839709, "set_robot_commands": 0.004611318761652166, "deviation-center-line": 0.06393804025783281, "driven_lanedir_consec": 0.4443672320455454, "sim_compute_sim_state": 0.002874721180308949, "sim_compute_performance-ego": 0.003845247355374423, "sim_compute_robot_state-ego": 0.0049884752793745565, "sim_compute_robot_state-npc0": 0.004753362048755993, "sim_compute_robot_state-npc1": 0.004542491652748801, "sim_compute_robot_state-npc2": 0.004513144493103027, "sim_compute_robot_state-npc3": 0.004494504495100541}, "udem1-10-0": {"driven_any": 0.37149985167138017, "sim_physics": 0.10192290105317768, "survival_time": 0.9500000000000004, "driven_lanedir": 0.3517991142132264, "sim_render-ego": 0.007127924969321803, "in-drivable-lane": 0, "agent_compute-ego": 0.01590100087617573, "deviation-heading": 0.31076793256366336, "set_robot_commands": 0.00439981410377904, "deviation-center-line": 0.054904029848945685, "driven_lanedir_consec": 0.3517991142132264, "sim_compute_sim_state": 0.0027614769182707135, "sim_compute_performance-ego": 0.003809088154842979, "sim_compute_robot_state-ego": 0.00481968176992316, "sim_compute_robot_state-npc0": 0.00465878687406841, "sim_compute_robot_state-npc1": 0.004426880886680202, "sim_compute_robot_state-npc2": 0.00438161900168971, "sim_compute_robot_state-npc3": 0.004370990552400288}, "udem1-11-0": {"driven_any": 0.4307612897755775, "sim_physics": 0.09526511601039342, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261291824030562, "sim_render-ego": 0.006926161902291434, "in-drivable-lane": 0, "agent_compute-ego": 0.01542512575785319, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.010185003280639648, "deviation-center-line": 0.09941469755038562, "driven_lanedir_consec": 0.4261291824030562, "sim_compute_sim_state": 0.0027680624099004837, "sim_compute_performance-ego": 0.0037487802051362536, "sim_compute_robot_state-ego": 0.004863568714686802, "sim_compute_robot_state-npc0": 0.004667565936133975, "sim_compute_robot_state-npc1": 0.004421597435360863, "sim_compute_robot_state-npc2": 0.004403386797223773, "sim_compute_robot_state-npc3": 0.004379476819719587}, "udem1-12-0": {"driven_any": 1.4796547806284426, "sim_physics": 0.09909299441746304, "survival_time": 2.799999999999998, "driven_lanedir": 0.33418991107979124, "sim_render-ego": 0.007050407784325736, "in-drivable-lane": 1.899999999999998, "agent_compute-ego": 0.015662555183683122, "deviation-heading": 0.193170346576385, "set_robot_commands": 0.004341564008167812, "deviation-center-line": 0.09687090955952632, "driven_lanedir_consec": 0.33418991107979124, "sim_compute_sim_state": 0.002773761749267578, "sim_compute_performance-ego": 0.003705876214163644, "sim_compute_robot_state-ego": 0.004790429558072772, "sim_compute_robot_state-npc0": 0.00462988018989563, "sim_compute_robot_state-npc1": 0.0043709661279405865, "sim_compute_robot_state-npc2": 0.004339656659534999, "sim_compute_robot_state-npc3": 0.004348205668585641}, "udem1-13-0": {"driven_any": 0.9996632207705788, "sim_physics": 0.09698038697242736, "survival_time": 2.000000000000001, "driven_lanedir": 0.655803085926784, "sim_render-ego": 0.0070863842964172365, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.015490365028381348, "deviation-heading": 0.36443640886622947, "set_robot_commands": 0.004480111598968506, "deviation-center-line": 0.1026590609494026, "driven_lanedir_consec": 0.655803085926784, "sim_compute_sim_state": 0.0027867913246154784, "sim_compute_performance-ego": 0.003708398342132568, "sim_compute_robot_state-ego": 0.004831522703170776, "sim_compute_robot_state-npc0": 0.004651552438735962, "sim_compute_robot_state-npc1": 0.004429394006729126, "sim_compute_robot_state-npc2": 0.004372406005859375, "sim_compute_robot_state-npc3": 0.004378318786621094}, "udem1-14-0": {"driven_any": 1.2096560704846229, "sim_physics": 0.10014901262648562, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6539926832217301, "sim_render-ego": 0.0069889667186331245, "in-drivable-lane": 0.5999999999999994, "agent_compute-ego": 0.01561908519014399, "deviation-heading": 0.9814018754699168, "set_robot_commands": 0.00441849485356757, "deviation-center-line": 0.1391297767535178, "driven_lanedir_consec": 0.4541194076078226, "sim_compute_sim_state": 0.0027912931239351315, "sim_compute_performance-ego": 0.0037104880556147143, "sim_compute_robot_state-ego": 0.0048247702578280835, "sim_compute_robot_state-npc0": 0.004715468021149331, "sim_compute_robot_state-npc1": 0.004403007791397419, "sim_compute_robot_state-npc2": 0.004371191592926675, "sim_compute_robot_state-npc3": 0.004356044404050137}}
set_robot_commands_max0.010185003280639648
set_robot_commands_mean0.005656003783202455
set_robot_commands_median0.0045246355461351796
set_robot_commands_min0.004326689810979934
sim_compute_performance-ego_max0.006881430997686871
sim_compute_performance-ego_mean0.004321833578124419
sim_compute_performance-ego_median0.0037406304987465462
sim_compute_performance-ego_min0.003705876214163644
sim_compute_robot_state-ego_max0.008837690836266626
sim_compute_robot_state-ego_mean0.005597611817421587
sim_compute_robot_state-ego_median0.004831522703170776
sim_compute_robot_state-ego_min0.004790429558072772
sim_compute_robot_state-npc0_max0.008966617946383319
sim_compute_robot_state-npc0_mean0.00539140910915969
sim_compute_robot_state-npc0_median0.004668259620666504
sim_compute_robot_state-npc0_min0.004629543849400112
sim_compute_robot_state-npc1_max0.008247559583639796
sim_compute_robot_state-npc1_mean0.005145848042229608
sim_compute_robot_state-npc1_median0.004429394006729126
sim_compute_robot_state-npc1_min0.0043709661279405865
sim_compute_robot_state-npc2_max0.008709734136408026
sim_compute_robot_state-npc2_mean0.005186572977627178
sim_compute_robot_state-npc2_median0.004420757293701172
sim_compute_robot_state-npc2_min0.004339656659534999
sim_compute_robot_state-npc3_max0.008311721343028395
sim_compute_robot_state-npc3_mean0.005090107167998279
sim_compute_robot_state-npc3_median0.004381668276903106
sim_compute_robot_state-npc3_min0.004332338060651507
sim_compute_sim_state_max0.004848415568723517
sim_compute_sim_state_mean0.0032036831057465276
sim_compute_sim_state_median0.0027912931239351315
sim_compute_sim_state_min0.0027555113747006373
sim_physics_max0.19261529081958836
sim_physics_mean0.11733493322060172
sim_physics_median0.10014901262648562
sim_physics_min0.09417348373227002
sim_render-ego_max0.011656772006641737
sim_render-ego_mean0.007980709456859063
sim_render-ego_median0.007127924969321803
sim_render-ego_min0.006926161902291434
simulation-passed1
survival_time_max4.94999999999999
survival_time_mean2.1466666666666656
survival_time_min0.9500000000000004
No reset possible
247402359Andrea Censi 🇨🇭PredictorMeanaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.2835705863218022
error_L20.09686190767981552


No reset possible
247323265Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-104990:00:06
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
247242726Ashwin Ram 🇸🇬PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10161558075547077
error_L20.016085946485817324


No reset possible
247112896Masaya Kambara 🇯🇵PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.12784131928440712
error_L20.026674939450806984


No reset possible
247073264Liu Sam 🇹🇼challenge-aido_LF-template-randomaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-104990:00:04
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
246963175Ian Li 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11007208125553844
error_L20.019123974005561893


No reset possible
246853257Liu Sam 🇹🇼PredictorLastaido2-PREDstep1-simulationhost-erroryesip-172-31-45-34-104990:00:05
Error while running [...]

stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
246753178Shen Yu Chia 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10882109693888964
error_L20.01884788022537874


No reset possible
246603228Jerry SuPredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10845561919630328
error_L20.018139922806962167


No reset possible
245634298Liam Paull 🇨🇦challenge-aido_LF-template-randomaido3-LFVI-sim-testingstep1-simulationerrornoip-172-31-45-34-104990:08:10
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
245484110Renato Mintz 🇧🇷PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10703917157624118
error_L20.018298555237965763


No reset possible
245424279Liam Paull 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessyesip-172-31-45-34-104990:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1140629405997952
error_L20.021452515666610866


No reset possible
244224222Manfred DiazBaseline-IL-logs-tensorflowaido3-LF-sim-testingstep1-simulationfailednoip-172-31-45-34-104990:00:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/kernel
               || 	 [[{{node prefix/ConvNet/fc_layer_2/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 60, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/kernel
               || 	 [[node prefix/ConvNet/fc_layer_2/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/kernel/read', defined at:
               ||   File "imitation_agent.py", line 136, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 132, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 71, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 43, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/kernel
               || 	 [[node prefix/ConvNet/fc_layer_2/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
244144218Manfred DiazBaseline-IL-logs-tensorflowaido3-LFV-sim-validationstep1-simulationfailednoip-172-31-45-34-104990:02:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243754190Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido3-LFV-sim-validationstep1-simulationsuccessnoip-172-31-45-34-104990:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.5999999999999988
deviation-center-line_median0.16987818035809085
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.020810808454241072
agent_compute-ego_mean0.01934628093149083
agent_compute-ego_median0.01927076280117035
agent_compute-ego_min0.01796742408506332
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.14972083567701736
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330367
deviation-heading_mean0.4280304166285302
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829773
driven_any_max1.2972979671834337
driven_any_mean0.7173901327940223
driven_any_median0.7336463183586179
driven_any_min0.26903550091980144
driven_lanedir_consec_max0.97716132702229
driven_lanedir_consec_mean0.5227475277218055
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max0.97716132702229
driven_lanedir_mean0.5227475277218055
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2407721645627201
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.5799999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.1137412601793316, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.010299390470477897, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.020006508894369637, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.006566642035900707, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0038935130750629263, "sim_compute_performance-ego": 0.005434254525412976, "sim_compute_robot_state-ego": 0.007225117213289503, "sim_compute_robot_state-npc0": 0.006723014401717925, "sim_compute_robot_state-npc1": 0.006651945517096721, "sim_compute_robot_state-npc2": 0.006170840330526862, "sim_compute_robot_state-npc3": 0.006217415903655576}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.1161077544093132, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.009456954896450044, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01927076280117035, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.006580166518688202, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.0035579949617385864, "sim_compute_performance-ego": 0.005140334367752075, "sim_compute_robot_state-ego": 0.006491482257843018, "sim_compute_robot_state-npc0": 0.0062067508697509766, "sim_compute_robot_state-npc1": 0.005920417606830597, "sim_compute_robot_state-npc2": 0.005744867026805878, "sim_compute_robot_state-npc3": 0.005892664194107056}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.11055917464769804, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.009047948397122895, "in-drivable-lane": 0, "agent_compute-ego": 0.01867590042260977, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.005875743352449858, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.004085678320664626, "sim_compute_performance-ego": 0.00504993016903217, "sim_compute_robot_state-ego": 0.006154303367321308, "sim_compute_robot_state-npc0": 0.006094973820906419, "sim_compute_robot_state-npc1": 0.005838513374328613, "sim_compute_robot_state-npc2": 0.006138109243833101, "sim_compute_robot_state-npc3": 0.006133139133453369}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.11006182239901637, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.008975931393202914, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.01796742408506332, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.006021456051898259, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.0035806830211352276, "sim_compute_performance-ego": 0.004668558797528667, "sim_compute_robot_state-ego": 0.006167604077246881, "sim_compute_robot_state-npc0": 0.006110196472496115, "sim_compute_robot_state-npc1": 0.005769227140693254, "sim_compute_robot_state-npc2": 0.005735210193100796, "sim_compute_robot_state-npc3": 0.005670396230554068}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.11711113793509348, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.01082166035970052, "in-drivable-lane": 0, "agent_compute-ego": 0.020810808454241072, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.00697901135399228, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.003595681417556036, "sim_compute_performance-ego": 0.005959431330362956, "sim_compute_robot_state-ego": 0.007593540918259393, "sim_compute_robot_state-npc0": 0.007058597746349517, "sim_compute_robot_state-npc1": 0.007167918341500419, "sim_compute_robot_state-npc2": 0.006327288491385323, "sim_compute_robot_state-npc3": 0.006152198428199405}}
set_robot_commands_max0.00697901135399228
set_robot_commands_mean0.006404603862585861
set_robot_commands_median0.006566642035900707
set_robot_commands_min0.005875743352449858
sim_compute_performance-ego_max0.005959431330362956
sim_compute_performance-ego_mean0.005250501838017769
sim_compute_performance-ego_median0.005140334367752075
sim_compute_performance-ego_min0.004668558797528667
sim_compute_robot_state-ego_max0.007593540918259393
sim_compute_robot_state-ego_mean0.006726409566792021
sim_compute_robot_state-ego_median0.006491482257843018
sim_compute_robot_state-ego_min0.006154303367321308
sim_compute_robot_state-npc0_max0.007058597746349517
sim_compute_robot_state-npc0_mean0.006438706662244191
sim_compute_robot_state-npc0_median0.0062067508697509766
sim_compute_robot_state-npc0_min0.006094973820906419
sim_compute_robot_state-npc1_max0.007167918341500419
sim_compute_robot_state-npc1_mean0.00626960439608992
sim_compute_robot_state-npc1_median0.005920417606830597
sim_compute_robot_state-npc1_min0.005769227140693254
sim_compute_robot_state-npc2_max0.006327288491385323
sim_compute_robot_state-npc2_mean0.006023263057130393
sim_compute_robot_state-npc2_median0.006138109243833101
sim_compute_robot_state-npc2_min0.005735210193100796
sim_compute_robot_state-npc3_max0.006217415903655576
sim_compute_robot_state-npc3_mean0.006013162777993896
sim_compute_robot_state-npc3_median0.006133139133453369
sim_compute_robot_state-npc3_min0.005670396230554068
sim_compute_sim_state_max0.004085678320664626
sim_compute_sim_state_mean0.00374271015923148
sim_compute_sim_state_median0.003595681417556036
sim_compute_sim_state_min0.0035579949617385864
sim_physics_max0.11711113793509348
sim_physics_mean0.11351622991409054
sim_physics_median0.1137412601793316
sim_physics_min0.11006182239901637
sim_render-ego_max0.01082166035970052
sim_render-ego_mean0.009720377103390855
sim_render-ego_median0.009456954896450044
sim_render-ego_min0.008975931393202914
simulation-passed1
survival_time_max4.6499999999999915
survival_time_mean2.6899999999999973
survival_time_min1.0500000000000005
No reset possible
243644181Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido3-LFV-sim-testingstep1-simulationerrornoip-172-31-45-34-104990:04:02
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243534171Bhairav Mehtachallenge-aido_LF-template-pytorchaido3-LF-sim-validationstep1-simulationfailednoip-172-31-45-34-104990:03:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243434162Tanli Chou 🇹🇼challenge-aido_LF-template-randomaido3-LF-sim-testingstep1-simulationhost-errornoip-172-31-45-34-104990:12:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 641, in get_cr
    wd, aws_config, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1301, in upload_files
    aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache
  File "/project/src/duckietown_challenges_runner/runner.py", line 1555, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1611, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-testing/submission4162/step1-simulation-ip-172-31-45-34-10499-job24343/challenge-evaluation-output/episodes/ETHZ_autolab_technical_track-9-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
243394159yang yi chun 🇹🇼PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-45-34-104990:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1154404127047704
error_L20.022385306438336337


No reset possible