Duckietown Challenges Home Challenges Submissions

Evaluator 2281

ID2281
evaluatormont03-614c9626f856-1
ownerI don't have one πŸ˜€
machineaido-ms-7b09
processmont03-614c9626f856-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 41969
# timeout1 42015
# failed5 41976
# error2 41973
# aborted1 41998
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4201511351Anthony CourchesneΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutnomont03-614c9626f856-1----No reset possible
4200611349Frank (Chude) QianΒ πŸ‡¨πŸ‡¦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:03:15
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4200011348Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simerrornomont03-614c9626f856-11:00:43
Waited 3605 seconds [...]
Waited 3605 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4199811347Frank (Chude) QianΒ πŸ‡¨πŸ‡¦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednomont03-614c9626f856-10:08:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.723743184755552
survival_time_median12.100000000000035
deviation-center-line_median0.3561324124511754
in-drivable-lane_median3.4000000000000328


other stats
agent_compute-ego_max0.05680935899006952
agent_compute-ego_mean0.046633633992357176
agent_compute-ego_median0.0434064616578998
agent_compute-ego_min0.042912253663559594
complete-iteration_max0.22981111044736252
complete-iteration_mean0.2234538556713629
complete-iteration_median0.22267459148217825
complete-iteration_min0.2186551292737325
deviation-center-line_max0.41881190722905975
deviation-center-line_mean0.34514694317945616
deviation-center-line_min0.24951104058641405
deviation-heading_max1.5832338265579051
deviation-heading_mean1.0863093789944085
deviation-heading_median0.958505545345043
deviation-heading_min0.8449925987296425
driven_any_max3.573717888490821
driven_any_mean2.9041663676093634
driven_any_median2.876653513440365
driven_any_min2.289640555065902
driven_lanedir_consec_max2.0272323612628074
driven_lanedir_consec_mean1.6919080850354953
driven_lanedir_consec_min1.29291360936807
driven_lanedir_max2.0272323612628074
driven_lanedir_mean1.6919080850354953
driven_lanedir_median1.723743184755552
driven_lanedir_min1.29291360936807
get_duckie_state_max3.5959827013252194e-06
get_duckie_state_mean3.48250277727425e-06
get_duckie_state_median3.4845737640258656e-06
get_duckie_state_min3.364880879720052e-06
get_robot_state_max0.01566134307010115
get_robot_state_mean0.015290084609806322
get_robot_state_median0.01531227774528104
get_robot_state_min0.01487443987856206
get_state_dump_max0.01390994481803957
get_state_dump_mean0.01378753565375189
get_state_dump_median0.013762166299361132
get_state_dump_min0.01371586519824572
get_ui_image_max0.03446686563413005
get_ui_image_mean0.03398639995751285
get_ui_image_median0.03398089696004666
get_ui_image_min0.03351694027582804
in-drivable-lane_max9.000000000000044
in-drivable-lane_mean4.78750000000004
in-drivable-lane_min3.3500000000000476
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.289640555065902, "get_ui_image": 0.033746538702974616, "step_physics": 0.07241757874636306, "survival_time": 9.700000000000005, "driven_lanedir": 1.4298224617542457, "get_state_dump": 0.013807826435443052, "sim_render-ego": 0.005856015018581115, "get_robot_state": 0.01487443987856206, "get_duckie_state": 3.535722948841213e-06, "in-drivable-lane": 3.4000000000000172, "agent_compute-ego": 0.05680935899006952, "deviation-heading": 0.8449925987296425, "complete-iteration": 0.22981111044736252, "set_robot_commands": 0.005069747413556601, "deviation-center-line": 0.24951104058641405, "driven_lanedir_consec": 1.4298224617542457, "sim_compute_sim_state": 0.023011991658161597, "sim_compute_performance-ego": 0.004063439123409311}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8766520452707693, "get_ui_image": 0.0342152552171187, "step_physics": 0.0740054047797337, "survival_time": 12.100000000000035, "driven_lanedir": 2.0272323612628074, "get_state_dump": 0.01390994481803957, "sim_render-ego": 0.00605553536375692, "get_robot_state": 0.01566134307010115, "get_duckie_state": 3.5959827013252194e-06, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.042912253663559594, "deviation-heading": 1.0661915170515357, "complete-iteration": 0.21923870488631825, "set_robot_commands": 0.005091605107646343, "deviation-center-line": 0.35761369924863495, "driven_lanedir_consec": 2.0272323612628074, "sim_compute_sim_state": 0.022931017166326853, "sim_compute_performance-ego": 0.004298581564721982}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.573717888490821, "get_ui_image": 0.03351694027582804, "step_physics": 0.07354768514633178, "survival_time": 14.950000000000076, "driven_lanedir": 1.29291360936807, "get_state_dump": 0.013716506163279216, "sim_render-ego": 0.0059991709391276045, "get_robot_state": 0.015339533487955729, "get_duckie_state": 3.364880879720052e-06, "in-drivable-lane": 9.000000000000044, "agent_compute-ego": 0.04373227914174398, "deviation-heading": 1.5832338265579051, "complete-iteration": 0.2186551292737325, "set_robot_commands": 0.0049417622884114585, "deviation-center-line": 0.41881190722905975, "driven_lanedir_consec": 1.29291360936807, "sim_compute_sim_state": 0.02367689450581869, "sim_compute_performance-ego": 0.004029934406280518}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8766549816099607, "get_ui_image": 0.03446686563413005, "step_physics": 0.07849154295014941, "survival_time": 12.100000000000035, "driven_lanedir": 2.0176639077568583, "get_state_dump": 0.01371586519824572, "sim_render-ego": 0.005848483605818315, "get_robot_state": 0.015285022002606351, "get_duckie_state": 3.4334245792105177e-06, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.04308064417405562, "deviation-heading": 0.8508195736385502, "complete-iteration": 0.22611047807803825, "set_robot_commands": 0.0049548444669108745, "deviation-center-line": 0.3546511256537158, "driven_lanedir_consec": 2.0176639077568583, "sim_compute_sim_state": 0.026109713168183633, "sim_compute_performance-ego": 0.004003191782423287}}
set_robot_commands_max0.005091605107646343
set_robot_commands_mean0.005014489819131319
set_robot_commands_median0.005012295940233738
set_robot_commands_min0.0049417622884114585
sim_compute_performance-ego_max0.004298581564721982
sim_compute_performance-ego_mean0.004098786719208774
sim_compute_performance-ego_median0.004046686764844914
sim_compute_performance-ego_min0.004003191782423287
sim_compute_sim_state_max0.026109713168183633
sim_compute_sim_state_mean0.02393240412462269
sim_compute_sim_state_median0.023344443081990143
sim_compute_sim_state_min0.022931017166326853
sim_render-ego_max0.00605553536375692
sim_render-ego_mean0.005939801231820988
sim_render-ego_median0.005927592978854359
sim_render-ego_min0.005848483605818315
simulation-passed1
step_physics_max0.07849154295014941
step_physics_mean0.07461555290564449
step_physics_median0.07377654496303274
step_physics_min0.07241757874636306
survival_time_max14.950000000000076
survival_time_mean12.212500000000038
survival_time_min9.700000000000005
No reset possible
4199511345Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-pytorchaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:00:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4199111341Frank (Chude) QianΒ πŸ‡¨πŸ‡¦template-tensorflowaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1365, in _do_call
             ||     return fn(*args)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1349, in _run_fn
             ||     return self._call_tf_sessionrun(options, feed_dict, fetch_list,
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun
             ||     return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
             || tensorflow.python.framework.errors_impl.InternalError: 2 root error(s) found.
             ||   (0) Internal: Dst tensor is not initialized.
             || 	 [[{{node _arg_state_0_0}}]]
             || 	 [[Tanh/_47]]
             ||   (1) Internal: Dst tensor is not initialized.
             || 	 [[{{node _arg_state_0_0}}]]
             || 0 successful operations.
             || 0 derived errors ignored.
             ||
             || During handling of the above exception, another exception occurred:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 66, in on_received_get_commands
             ||     pwm_left, pwm_right = self.compute_action(self.current_image)
             ||   File "solution.py", line 61, in compute_action
             ||     action = self.model.predict(observation)
             ||   File "/submission/model.py", line 64, in predict
             ||     action = self.tf_session.run(self._computation_graph, feed_dict={
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 957, in run
             ||     result = self._run(None, fetches, feed_dict, options_ptr,
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1180, in _run
             ||     results = self._do_run(handle, final_targets, final_fetches,
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1358, in _do_run
             ||     return self._do_call(_run_fn, feeds, fetches, targets, options,
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1384, in _do_call
             ||     raise type(e)(node_def, op, message)
             || tensorflow.python.framework.errors_impl.InternalError: 2 root error(s) found.
             ||   (0) Internal: Dst tensor is not initialized.
             || 	 [[{{node _arg_state_0_0}}]]
             || 	 [[Tanh/_47]]
             ||   (1) Internal: Dst tensor is not initialized.
             || 	 [[{{node _arg_state_0_0}}]]
             || 0 successful operations.
             || 0 derived errors ignored.
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4198211342Frank (Chude) QianΒ πŸ‡¨πŸ‡¦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego" aborted:

error in ego |Exception while handling a message on topic "get_commands".
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
             ||     handle_message_node(parsed, receiver0, context0)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
             ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 52, in on_received_get_commands
             ||     linear, angular = self.compute_action(self.to_predictor)
             ||   File "solution.py", line 47, in compute_action
             ||     (linear, angular) = self.model.predict(observation)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper
             ||     return method(self, *args, **kwargs)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict
             ||     tmp_batch_outputs = predict_function(iterator)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__
             ||     result = self._call(*args, **kwds)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call
             ||     return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call
             ||     return self._call_flat(
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat
             ||     return self._build_call_outputs(self._inference_function.call(
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call
             ||     outputs = execute.execute(
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute
             ||     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
             || tensorflow.python.framework.errors_impl.UnknownError:  Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
             || 	 [[node FrankNet/conv2d_5/Conv2D (defined at solution.py:47) ]] [Op:__inference_predict_function_790]
             ||
             || Errors may have originated from an input operation.
             || Input Source operations connected to node FrankNet/conv2d_5/Conv2D:
             ||  FrankNet/lambda_1/truediv (defined at /submission/frankModel.py:42)
             ||
             || Function call stack:
             || predict_function
             ||
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4197611340Frank (Chude) QianΒ πŸ‡¨πŸ‡¦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simfailednomont03-614c9626f856-10:03:30
The container "solut [...]
The container "solution" exited with code 139.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4197311339Bhavya PatwaΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simerrornomont03-614c9626f856-11:00:33
Waited 3610 seconds [...]
Waited 3610 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4196911338Daniel NgΒ πŸ‡ΈπŸ‡¬template-randomaido5-LF-sim-validationLFv-simsuccessnomont03-614c9626f856-10:03:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6440373265804349
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.016976295891454666
agent_compute-ego_mean0.01660767446950711
agent_compute-ego_median0.016750702425590118
agent_compute-ego_min0.015952997135393547
complete-iteration_max0.21407107331536032
complete-iteration_mean0.20117603893752295
complete-iteration_median0.1972484615114
complete-iteration_min0.19613615941193144
deviation-center-line_max0.15583868303837567
deviation-center-line_mean0.10879855071843549
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876925
driven_any_mean1.8510551780477624
driven_any_median1.998666635086524
driven_any_min0.5174263274303096
driven_lanedir_consec_max0.8904446665936326
driven_lanedir_consec_mean0.6302364342579737
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936326
driven_lanedir_mean0.6302364342579737
driven_lanedir_median0.6440373265804349
driven_lanedir_min0.3424264172773923
get_duckie_state_max3.92772533275463e-06
get_duckie_state_mean3.832892442411718e-06
get_duckie_state_median3.893914660259272e-06
get_duckie_state_min3.6160151163736978e-06
get_robot_state_max0.01631699138217502
get_robot_state_mean0.015647339495759645
get_robot_state_median0.015550645455741
get_robot_state_min0.015171075689381568
get_state_dump_max0.014456910602116988
get_state_dump_mean0.01399856038976899
get_state_dump_median0.01387111321844236
get_state_dump_min0.013795104520074252
get_ui_image_max0.03664666233640729
get_ui_image_mean0.035411946538078935
get_ui_image_median0.03526635772880467
get_ui_image_min0.034468408358299125
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1619321797959306, "get_ui_image": 0.034468408358299125, "step_physics": 0.07629589307106148, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.014456910602116988, "sim_render-ego": 0.006174439090793416, "get_robot_state": 0.015593213550115037, "get_duckie_state": 3.923804073010461e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.016976295891454666, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.19613615941193144, "set_robot_commands": 0.004857863410044525, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.022801172935356526, "sim_compute_performance-ego": 0.004359685768515377}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303096, "get_ui_image": 0.03568756991419299, "step_physics": 0.07776310526091477, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.013795104520074252, "sim_render-ego": 0.005958277603675579, "get_robot_state": 0.015171075689381568, "get_duckie_state": 3.864025247508082e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.016952292672519027, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.1965324878692627, "set_robot_commands": 0.00470626765284045, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.022329387993648135, "sim_compute_performance-ego": 0.004017575033779802}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8354010903771174, "get_ui_image": 0.03484514554341634, "step_physics": 0.07742072387977883, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921884, "get_state_dump": 0.01392128202650282, "sim_render-ego": 0.00630221720095034, "get_robot_state": 0.01631699138217502, "get_duckie_state": 3.92772533275463e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.016549112178661205, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.19796443515353732, "set_robot_commands": 0.004850044956913701, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921884, "sim_compute_sim_state": 0.023455547403406215, "sim_compute_performance-ego": 0.004152788939299407}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876925, "get_ui_image": 0.03664666233640729, "step_physics": 0.08933554634903416, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936326, "get_state_dump": 0.013820944410381897, "sim_render-ego": 0.006186407623869, "get_robot_state": 0.015508077361366966, "get_duckie_state": 3.6160151163736978e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.015952997135393547, "deviation-heading": 0.976837469261332, "complete-iteration": 0.21407107331536032, "set_robot_commands": 0.004595787236184785, "deviation-center-line": 0.15583868303837567, "driven_lanedir_consec": 0.8904446665936326, "sim_compute_sim_state": 0.027762161962913742, "sim_compute_performance-ego": 0.004110661419955167}}
set_robot_commands_max0.004857863410044525
set_robot_commands_mean0.004752490813995865
set_robot_commands_median0.004778156304877075
set_robot_commands_min0.004595787236184785
sim_compute_performance-ego_max0.004359685768515377
sim_compute_performance-ego_mean0.004160177790387438
sim_compute_performance-ego_median0.004131725179627286
sim_compute_performance-ego_min0.004017575033779802
sim_compute_sim_state_max0.027762161962913742
sim_compute_sim_state_mean0.024087067573831156
sim_compute_sim_state_median0.02312836016938137
sim_compute_sim_state_min0.022329387993648135
sim_render-ego_max0.00630221720095034
sim_render-ego_mean0.006155335379822084
sim_render-ego_median0.006180423357331208
sim_render-ego_min0.005958277603675579
simulation-passed1
step_physics_max0.08933554634903416
step_physics_mean0.08020381714019731
step_physics_median0.07759191457034681
step_physics_min0.07629589307106148
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible