Duckietown Challenges Home Challenges Submissions

Evaluator 2263

ID2263
evaluatormont01-62097cce5404-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont01-62097cce5404-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success4 40858
# timeout
# failed5 40845
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4090610821Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont01-62097cce5404-10:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6785221536507686
survival_time_median14.950000000000076
deviation-center-line_median0.4893550769222022
in-drivable-lane_median2.250000000000032


other stats
agent_compute-ego_max0.021872661908467612
agent_compute-ego_mean0.018626699248949687
agent_compute-ego_median0.017776017586390178
agent_compute-ego_min0.017082099914550782
complete-iteration_max0.20914268096288044
complete-iteration_mean0.20507745424906412
complete-iteration_median0.20578858296076455
complete-iteration_min0.19958997011184693
deviation-center-line_max0.6120732791689434
deviation-center-line_mean0.4733907822032282
deviation-center-line_min0.3027796957995651
deviation-heading_max2.758948586551869
deviation-heading_mean1.946746833123502
deviation-heading_median1.7851146188805815
deviation-heading_min1.457809508180976
driven_any_max2.031187161419437
driven_any_mean2.017917257561252
driven_any_median2.022954291036302
driven_any_min1.9945732867529664
driven_lanedir_consec_max1.9663213706082412
driven_lanedir_consec_mean1.4958710432051756
driven_lanedir_consec_min0.6601184949109231
driven_lanedir_max1.9663213706082412
driven_lanedir_mean1.4958710432051756
driven_lanedir_median1.6785221536507686
driven_lanedir_min0.6601184949109231
get_duckie_state_max2.953211466471354e-06
get_duckie_state_mean2.7571121851603182e-06
get_duckie_state_median2.7147928873697917e-06
get_duckie_state_min2.6456514994303383e-06
get_robot_state_max0.01627514362335205
get_robot_state_mean0.015839904944101965
get_robot_state_median0.015986896355946856
get_robot_state_min0.01511068344116211
get_state_dump_max0.013808677196502686
get_state_dump_mean0.013737056255340576
get_state_dump_median0.013788661956787109
get_state_dump_min0.0135622239112854
get_ui_image_max0.036538341840108235
get_ui_image_mean0.03575250089168548
get_ui_image_median0.03587065855662028
get_ui_image_min0.034730344613393145
in-drivable-lane_max9.300000000000082
in-drivable-lane_mean3.4625000000000368
in-drivable-lane_min0.05000000000000071
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.031187161419437, "get_ui_image": 0.036538341840108235, "step_physics": 0.08177465756734212, "survival_time": 14.950000000000076, "driven_lanedir": 1.4043868797547043, "get_state_dump": 0.013808677196502686, "sim_render-ego": 0.006454497178395589, "get_robot_state": 0.01627514362335205, "get_duckie_state": 2.953211466471354e-06, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.01789159933725993, "deviation-heading": 1.457809508180976, "complete-iteration": 0.2068957686424255, "set_robot_commands": 0.00483287254969279, "deviation-center-line": 0.4172983206936222, "driven_lanedir_consec": 1.4043868797547043, "sim_compute_sim_state": 0.02486604849497477, "sim_compute_performance-ego": 0.004301446278889974}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.018859814958967, "get_ui_image": 0.035257866382598875, "step_physics": 0.07866394678751627, "survival_time": 14.950000000000076, "driven_lanedir": 1.952657427546833, "get_state_dump": 0.0135622239112854, "sim_render-ego": 0.006191453138987223, "get_robot_state": 0.015956414540608723, "get_duckie_state": 2.674261728922526e-06, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.017082099914550782, "deviation-heading": 2.758948586551869, "complete-iteration": 0.19958997011184693, "set_robot_commands": 0.004841176668802897, "deviation-center-line": 0.5614118331507821, "driven_lanedir_consec": 1.952657427546833, "sim_compute_sim_state": 0.02362687349319458, "sim_compute_performance-ego": 0.004256977240244548}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9945732867529664, "get_ui_image": 0.03648345073064168, "step_physics": 0.08329574664433798, "survival_time": 14.950000000000076, "driven_lanedir": 0.6601184949109231, "get_state_dump": 0.01378071943918864, "sim_render-ego": 0.0060564986864725745, "get_robot_state": 0.01511068344116211, "get_duckie_state": 2.7553240458170573e-06, "in-drivable-lane": 9.300000000000082, "agent_compute-ego": 0.017660435835520426, "deviation-heading": 1.691480408759477, "complete-iteration": 0.2046813972791036, "set_robot_commands": 0.004853766759236653, "deviation-center-line": 0.3027796957995651, "driven_lanedir_consec": 0.6601184949109231, "sim_compute_sim_state": 0.02325450579325358, "sim_compute_performance-ego": 0.0040338476498921715}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0270487671136377, "get_ui_image": 0.034730344613393145, "step_physics": 0.08159956137339273, "survival_time": 14.950000000000076, "driven_lanedir": 1.9663213706082412, "get_state_dump": 0.01379660447438558, "sim_render-ego": 0.0059111634890238445, "get_robot_state": 0.016017378171284992, "get_duckie_state": 2.6456514994303383e-06, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.021872661908467612, "deviation-heading": 1.878748829001686, "complete-iteration": 0.20914268096288044, "set_robot_commands": 0.004985448519388835, "deviation-center-line": 0.6120732791689434, "driven_lanedir_consec": 1.9663213706082412, "sim_compute_sim_state": 0.026113320191701254, "sim_compute_performance-ego": 0.003966798782348633}}
set_robot_commands_max0.004985448519388835
set_robot_commands_mean0.004878316124280294
set_robot_commands_median0.004847471714019775
set_robot_commands_min0.00483287254969279
sim_compute_performance-ego_max0.004301446278889974
sim_compute_performance-ego_mean0.004139767487843832
sim_compute_performance-ego_median0.00414541244506836
sim_compute_performance-ego_min0.003966798782348633
sim_compute_sim_state_max0.026113320191701254
sim_compute_sim_state_mean0.024465186993281048
sim_compute_sim_state_median0.024246460994084673
sim_compute_sim_state_min0.02325450579325358
sim_render-ego_max0.006454497178395589
sim_render-ego_mean0.006153403123219808
sim_render-ego_median0.006123975912729899
sim_render-ego_min0.0059111634890238445
simulation-passed1
step_physics_max0.08329574664433798
step_physics_mean0.08133347809314728
step_physics_median0.08168710947036742
step_physics_min0.07866394678751627
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
4090010823Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednomont01-62097cce5404-10:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 50 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4089610824Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednomont01-62097cce5404-10:03:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 36 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4089110826Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednomont01-62097cce5404-10:03:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 15 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4088510829Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednomont01-62097cce5404-10:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 50 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4087310837Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnomont01-62097cce5404-10:07:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8699145719393084
survival_time_median11.500000000000028
deviation-center-line_median0.2786566520229452
in-drivable-lane_median8.350000000000048


other stats
agent_compute-ego_max0.01829991704326565
agent_compute-ego_mean0.017878563794158774
agent_compute-ego_median0.017848030227099278
agent_compute-ego_min0.01751827767917088
complete-iteration_max0.21044096724931585
complete-iteration_mean0.20513771130351063
complete-iteration_median0.2053120667522862
complete-iteration_min0.1994857444601544
deviation-center-line_max0.3970975979218742
deviation-center-line_mean0.262801346731777
deviation-center-line_min0.0967944849593436
deviation-heading_max2.5304416100650418
deviation-heading_mean1.481943725662371
deviation-heading_median1.448446993993005
deviation-heading_min0.5004393045984334
driven_any_max4.070848860106681
driven_any_mean3.3051620733932765
driven_any_median3.1198088352996836
driven_any_min2.9101817628670577
driven_lanedir_consec_max1.2141840527304406
driven_lanedir_consec_mean0.8266723925529254
driven_lanedir_consec_min0.3526763736026435
driven_lanedir_max1.2141840527304406
driven_lanedir_mean0.8266723925529254
driven_lanedir_median0.8699145719393084
driven_lanedir_min0.3526763736026435
get_duckie_state_max4.147688547770183e-06
get_duckie_state_mean4.034205565787848e-06
get_duckie_state_median4.026098207777917e-06
get_duckie_state_min3.936937299825377e-06
get_robot_state_max0.016218652725219728
get_robot_state_mean0.015765629663863755
get_robot_state_median0.015758668025166303
get_robot_state_min0.015326529879902684
get_state_dump_max0.013675627708435058
get_state_dump_mean0.013586560145156416
get_state_dump_median0.01359735453641155
get_state_dump_min0.013475903799367504
get_ui_image_max0.03686116218566895
get_ui_image_mean0.03623237077882009
get_ui_image_median0.03633478143286467
get_ui_image_min0.03539875806388208
in-drivable-lane_max10.100000000000032
in-drivable-lane_mean8.425000000000038
in-drivable-lane_min6.90000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.070848860106681, "get_ui_image": 0.03686116218566895, "step_physics": 0.08427927494049073, "survival_time": 14.950000000000076, "driven_lanedir": 1.2141840527304406, "get_state_dump": 0.013675627708435058, "sim_render-ego": 0.006352294286092123, "get_robot_state": 0.016218652725219728, "get_duckie_state": 4.147688547770183e-06, "in-drivable-lane": 9.300000000000074, "agent_compute-ego": 0.017921036084493, "deviation-heading": 2.5304416100650418, "complete-iteration": 0.20993868668874105, "set_robot_commands": 0.004877057075500488, "deviation-center-line": 0.3970975979218742, "driven_lanedir_consec": 1.2141840527304406, "sim_compute_sim_state": 0.02531220595041911, "sim_compute_performance-ego": 0.00428765853246053}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0359538933413677, "get_ui_image": 0.03623667785099575, "step_physics": 0.07848125057561058, "survival_time": 11.200000000000024, "driven_lanedir": 1.0040009553451703, "get_state_dump": 0.013576546949999673, "sim_render-ego": 0.006263868084975651, "get_robot_state": 0.015894435346126556, "get_duckie_state": 4.098883696964809e-06, "in-drivable-lane": 6.90000000000003, "agent_compute-ego": 0.01751827767917088, "deviation-heading": 1.514290739789977, "complete-iteration": 0.2006854468158313, "set_robot_commands": 0.0048510730266571045, "deviation-center-line": 0.3118203012649431, "driven_lanedir_consec": 1.0040009553451703, "sim_compute_sim_state": 0.023623329188142504, "sim_compute_performance-ego": 0.0040940046310424805}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.203663777257999, "get_ui_image": 0.03539875806388208, "step_physics": 0.0777358311717793, "survival_time": 11.800000000000033, "driven_lanedir": 0.3526763736026435, "get_state_dump": 0.013618162122823425, "sim_render-ego": 0.00620810157161648, "get_robot_state": 0.015622900704206046, "get_duckie_state": 3.936937299825377e-06, "in-drivable-lane": 10.100000000000032, "agent_compute-ego": 0.01829991704326565, "deviation-heading": 0.5004393045984334, "complete-iteration": 0.1994857444601544, "set_robot_commands": 0.0049016404960115076, "deviation-center-line": 0.0967944849593436, "driven_lanedir_consec": 0.3526763736026435, "sim_compute_sim_state": 0.023449048147363177, "sim_compute_performance-ego": 0.0041021755186177915}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9101817628670577, "get_ui_image": 0.0364328850147336, "step_physics": 0.08468084335327149, "survival_time": 10.750000000000018, "driven_lanedir": 0.7358281885334464, "get_state_dump": 0.013475903799367504, "sim_render-ego": 0.006117725372314453, "get_robot_state": 0.015326529879902684, "get_duckie_state": 3.9533127185910245e-06, "in-drivable-lane": 7.400000000000021, "agent_compute-ego": 0.017775024369705555, "deviation-heading": 1.3826032481960326, "complete-iteration": 0.21044096724931585, "set_robot_commands": 0.0048872182535570725, "deviation-center-line": 0.24549300278094727, "driven_lanedir_consec": 0.7358281885334464, "sim_compute_sim_state": 0.027471747509268823, "sim_compute_performance-ego": 0.0041215863338736605}}
set_robot_commands_max0.0049016404960115076
set_robot_commands_mean0.004879247212931544
set_robot_commands_median0.004882137664528781
set_robot_commands_min0.0048510730266571045
sim_compute_performance-ego_max0.00428765853246053
sim_compute_performance-ego_mean0.004151356253998616
sim_compute_performance-ego_median0.004111880926245726
sim_compute_performance-ego_min0.0040940046310424805
sim_compute_sim_state_max0.027471747509268823
sim_compute_sim_state_mean0.024964082698798403
sim_compute_sim_state_median0.024467767569280804
sim_compute_sim_state_min0.023449048147363177
sim_render-ego_max0.006352294286092123
sim_render-ego_mean0.006235497328749676
sim_render-ego_median0.006235984828296065
sim_render-ego_min0.006117725372314453
simulation-passed1
step_physics_max0.08468084335327149
step_physics_mean0.08129430001028802
step_physics_median0.08138026275805066
step_physics_min0.0777358311717793
survival_time_max14.950000000000076
survival_time_mean12.175000000000036
survival_time_min10.750000000000018
No reset possible
4087011279Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simsuccessnomont01-62097cce5404-10:03:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6440373265804349
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.016765150530584926
agent_compute-ego_mean0.01648147331168755
agent_compute-ego_median0.016525036616663623
agent_compute-ego_min0.016110669482838024
complete-iteration_max0.2167022842349428
complete-iteration_mean0.20769552539915087
complete-iteration_median0.2106321193858277
complete-iteration_min0.19281557859000512
deviation-center-line_max0.15583868303837567
deviation-center-line_mean0.10879855071843549
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876925
driven_any_mean1.8510551780477624
driven_any_median1.998666635086524
driven_any_min0.5174263274303096
driven_lanedir_consec_max0.8904446665936326
driven_lanedir_consec_mean0.6302364342579737
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936326
driven_lanedir_mean0.6302364342579737
driven_lanedir_median0.6440373265804349
driven_lanedir_min0.3424264172773923
get_duckie_state_max2.759875673236269e-06
get_duckie_state_mean2.6464649011396245e-06
get_duckie_state_median2.6921244140548368e-06
get_duckie_state_min2.441735103212554e-06
get_robot_state_max0.01647455409421759
get_robot_state_mean0.015863495498102332
get_robot_state_median0.015809441434926
get_robot_state_min0.015360545028339731
get_state_dump_max0.014462971326076624
get_state_dump_mean0.01392047963099217
get_state_dump_median0.013834197463355912
get_state_dump_min0.013550552271180231
get_ui_image_max0.038584503634222625
get_ui_image_mean0.036285416141195806
get_ui_image_median0.03676779482902501
get_ui_image_min0.03302157127251059
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1619321797959306, "get_ui_image": 0.03302157127251059, "step_physics": 0.07480011552067126, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.013550552271180231, "sim_render-ego": 0.006159362146409892, "get_robot_state": 0.01647455409421759, "get_duckie_state": 2.6468503273139565e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.016577571125353796, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.19281557859000512, "set_robot_commands": 0.004781751309411, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.02308648723666951, "sim_compute_performance-ego": 0.004220905950513936}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303096, "get_ui_image": 0.038584503634222625, "step_physics": 0.08512322656039534, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.01373598493378738, "sim_render-ego": 0.006068912045709018, "get_robot_state": 0.015470792507303172, "get_duckie_state": 2.441735103212554e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.016765150530584926, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.21445820249360184, "set_robot_commands": 0.010510921478271484, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.023886039339262866, "sim_compute_performance-ego": 0.004166471547093885}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8354010903771174, "get_ui_image": 0.03695626612062807, "step_physics": 0.08317697842915853, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921884, "get_state_dump": 0.013932409992924444, "sim_render-ego": 0.0063864813910590275, "get_robot_state": 0.016148090362548828, "get_duckie_state": 2.7373985007957175e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.016472502107973453, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.2068060362780536, "set_robot_commands": 0.004794214389942311, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921884, "sim_compute_sim_state": 0.024568022622002497, "sim_compute_performance-ego": 0.004216377823441117}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876925, "get_ui_image": 0.03657932353742195, "step_physics": 0.09090691263025458, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936326, "get_state_dump": 0.014462971326076624, "sim_render-ego": 0.006085952123006185, "get_robot_state": 0.015360545028339731, "get_duckie_state": 2.759875673236269e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.016110669482838024, "deviation-heading": 0.976837469261332, "complete-iteration": 0.2167022842349428, "set_robot_commands": 0.0048017537955081825, "deviation-center-line": 0.15583868303837567, "driven_lanedir_consec": 0.8904446665936326, "sim_compute_sim_state": 0.02821236126350634, "sim_compute_performance-ego": 0.004030653924653025}}
set_robot_commands_max0.010510921478271484
set_robot_commands_mean0.006222160243283244
set_robot_commands_median0.004797984092725247
set_robot_commands_min0.004781751309411
sim_compute_performance-ego_max0.004220905950513936
sim_compute_performance-ego_mean0.00415860231142549
sim_compute_performance-ego_median0.004191424685267501
sim_compute_performance-ego_min0.004030653924653025
sim_compute_sim_state_max0.02821236126350634
sim_compute_sim_state_mean0.024938227615360305
sim_compute_sim_state_median0.02422703098063268
sim_compute_sim_state_min0.02308648723666951
sim_render-ego_max0.0063864813910590275
sim_render-ego_mean0.00617517692654603
sim_render-ego_median0.006122657134708038
sim_render-ego_min0.006068912045709018
simulation-passed1
step_physics_max0.09090691263025458
step_physics_mean0.08350180828511992
step_physics_median0.08415010249477693
step_physics_min0.07480011552067126
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible
4085810845Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessnomont01-62097cce5404-10:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3851547156771735
survival_time_median14.950000000000076
deviation-center-line_median0.7078786490769609
in-drivable-lane_median2.324999999999993


other stats
agent_compute-ego_max0.017532009827463252
agent_compute-ego_mean0.017497883773686593
agent_compute-ego_median0.017508148749669394
agent_compute-ego_min0.017443227767944335
complete-iteration_max0.20817200422286988
complete-iteration_mean0.204970715295402
complete-iteration_median0.20470202217723493
complete-iteration_min0.2023068126042684
deviation-center-line_max1.2243137059533291
deviation-center-line_mean0.6789161206739511
deviation-center-line_min0.07559347858855331
deviation-heading_max2.8017672301072585
deviation-heading_mean1.5497939961186973
deviation-heading_median1.4545698237870444
deviation-heading_min0.48826910679344215
driven_any_max3.311107465295265
driven_any_mean2.923617514822575
driven_any_median2.809671266783673
driven_any_min2.764020060427689
driven_lanedir_consec_max3.166961489429136
driven_lanedir_consec_mean2.1484781303133644
driven_lanedir_consec_min0.6566416004699737
driven_lanedir_max3.166961489429136
driven_lanedir_mean2.1484781303133644
driven_lanedir_median2.3851547156771735
driven_lanedir_min0.6566416004699737
get_duckie_state_max2.806981404622396e-06
get_duckie_state_mean2.7386855362053205e-06
get_duckie_state_median2.761681874593099e-06
get_duckie_state_min2.624396991012688e-06
get_robot_state_max0.016108684970023938
get_robot_state_mean0.015878327199092185
get_robot_state_median0.015874210993448892
get_robot_state_min0.01565620183944702
get_state_dump_max0.01365822712580363
get_state_dump_mean0.013592677280717624
get_state_dump_median0.013610016107559204
get_state_dump_min0.013492449781948464
get_ui_image_max0.03708215405170182
get_ui_image_mean0.03606614711290613
get_ui_image_median0.036169820229212446
get_ui_image_min0.0348427939414978
in-drivable-lane_max8.100000000000094
in-drivable-lane_mean3.18750000000002
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.311107465295265, "get_ui_image": 0.0348427939414978, "step_physics": 0.07987385749816894, "survival_time": 14.950000000000076, "driven_lanedir": 3.166961489429136, "get_state_dump": 0.01361927350362142, "sim_render-ego": 0.006375530560811361, "get_robot_state": 0.015992931524912515, "get_duckie_state": 2.756118774414062e-06, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.017491106986999513, "deviation-heading": 2.8017672301072585, "complete-iteration": 0.2023068126042684, "set_robot_commands": 0.004965883096059163, "deviation-center-line": 1.2243137059533291, "driven_lanedir_consec": 3.166961489429136, "sim_compute_sim_state": 0.02472755193710327, "sim_compute_performance-ego": 0.004266889890034994}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.7979773428051073, "get_ui_image": 0.036118664741516114, "step_physics": 0.0816122857729594, "survival_time": 14.950000000000076, "driven_lanedir": 2.7676361182762688, "get_state_dump": 0.01365822712580363, "sim_render-ego": 0.00631821076075236, "get_robot_state": 0.01565620183944702, "get_duckie_state": 2.806981404622396e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017525190512339275, "deviation-heading": 1.9614332771935672, "complete-iteration": 0.20449805577596028, "set_robot_commands": 0.0049465211232503255, "deviation-center-line": 1.121631670716066, "driven_lanedir_consec": 2.7676361182762688, "sim_compute_sim_state": 0.024245039621988932, "sim_compute_performance-ego": 0.004262852668762207}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8213651907622395, "get_ui_image": 0.03708215405170182, "step_physics": 0.08155881551871623, "survival_time": 6.649999999999984, "driven_lanedir": 0.6566416004699737, "get_state_dump": 0.013492449781948464, "sim_render-ego": 0.006273927545188961, "get_robot_state": 0.016108684970023938, "get_duckie_state": 2.624396991012688e-06, "in-drivable-lane": 4.499999999999984, "agent_compute-ego": 0.017532009827463252, "deviation-heading": 0.48826910679344215, "complete-iteration": 0.20490598857850956, "set_robot_commands": 0.005053457460905376, "deviation-center-line": 0.07559347858855331, "driven_lanedir_consec": 0.6566416004699737, "sim_compute_sim_state": 0.023464417995366835, "sim_compute_performance-ego": 0.004183315692987657}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.764020060427689, "get_ui_image": 0.03622097571690877, "step_physics": 0.0811375061670939, "survival_time": 14.950000000000076, "driven_lanedir": 2.0026733130780787, "get_state_dump": 0.013600758711496987, "sim_render-ego": 0.006280659834543864, "get_robot_state": 0.01575549046198527, "get_duckie_state": 2.7672449747721356e-06, "in-drivable-lane": 8.100000000000094, "agent_compute-ego": 0.017443227767944335, "deviation-heading": 0.9477063703805214, "complete-iteration": 0.20817200422286988, "set_robot_commands": 0.005006651878356933, "deviation-center-line": 0.29412562743785564, "driven_lanedir_consec": 2.0026733130780787, "sim_compute_sim_state": 0.028492581049601236, "sim_compute_performance-ego": 0.004079922040303548}}
set_robot_commands_max0.005053457460905376
set_robot_commands_mean0.004993128389642949
set_robot_commands_median0.004986267487208048
set_robot_commands_min0.0049465211232503255
sim_compute_performance-ego_max0.004266889890034994
sim_compute_performance-ego_mean0.004198245073022102
sim_compute_performance-ego_median0.0042230841808749316
sim_compute_performance-ego_min0.004079922040303548
sim_compute_sim_state_max0.028492581049601236
sim_compute_sim_state_mean0.025232397651015065
sim_compute_sim_state_median0.0244862957795461
sim_compute_sim_state_min0.023464417995366835
sim_render-ego_max0.006375530560811361
sim_render-ego_mean0.006312082175324137
sim_render-ego_median0.006299435297648112
sim_render-ego_min0.006273927545188961
simulation-passed1
step_physics_max0.0816122857729594
step_physics_mean0.08104561623923462
step_physics_median0.08134816084290507
step_physics_min0.07987385749816894
survival_time_max14.950000000000076
survival_time_mean12.875000000000052
survival_time_min6.649999999999984
No reset possible
4084511276Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednomont01-62097cce5404-10:06:25
The container "solut [...]
The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible