Duckietown Challenges Home Challenges Submissions

Evaluator 5102

ID5102
evaluatorgpu-production-spot-1-04
ownerI don't have one πŸ˜€
machinegpu-prod_fb1e534fbc50
processgpu-production-spot-1-04_fb1e534fbc50
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success22 65890
# timeout
# failed1 66355
# error
# aborted2 66286
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)238.2 GB
Disk (MB)969.3 GB
Disk available (MB)865.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6635514119Andrea CensiΒ πŸ‡¨πŸ‡­exercises_braitenbergmooc-BV1421failedyesgpu-production-spot-1-040:01:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 581, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/agent/solution/agent.py", line 65, in on_received_observations
              ||     context.info("received first observations", data=data)
              || TypeError: info() got an unexpected keyword argument 'data'
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method BraitenbergAgent.on_received_observations of <__main__.BraitenbergAgent object at 0x7f137b17d880>>.
              || β”‚       f: <bound method BraitenbergAgent.on_received_observations of <__main__.BraitenbergAgent object at 0x7f137b17d880>>
              || β”‚    args: dict[2]
              || β”‚          β”‚ data:
              || β”‚          β”‚ DB20Observations
              || β”‚          β”‚ β”‚ camera: JPGImage(jpg_data=53233 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF')
              || β”‚          β”‚ β”‚ odometry:
              || β”‚          β”‚ β”‚ DB20Odometry
              || β”‚          β”‚ β”‚ β”‚ resolution_rad: 0.046542113386515455
              || β”‚          β”‚ β”‚ β”‚ axis_left_rad: 0.0
              || β”‚          β”‚ β”‚ β”‚ axis_right_rad: 0.0
              || β”‚          β”‚ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f1368bc6340>
              || β”‚ argspec: <class 'inspect.FullArgSpec'>[7]
              || β”‚          #0 [self, context, data]
              || β”‚          #1 None
              || β”‚          #2 None
              || β”‚          #3 None
              || β”‚          #4 []
              || β”‚          #5 None
              || β”‚          #6 dict[2]
              || β”‚             β”‚ context: <class 'zuper_nodes_wrapper.interface.Context'>
              || β”‚             β”‚ data:
              || β”‚             β”‚ dataclass aido_schemas.schemas.DB20Observations
              || β”‚             β”‚  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
              || β”‚             β”‚                    field jpg_data : bytes
              || β”‚             β”‚                           __doc__
              || β”‚             β”‚                                             An image in JPG format.
              || β”‚             β”‚
              || β”‚             β”‚                                             jpg_data
              || β”‚             β”‚  field odometry : dataclass aido_schemas.schemas.DB20Odometry
              || β”‚             β”‚                    field resolution_rad : float
              || β”‚             β”‚                    field  axis_left_rad : float
              || β”‚             β”‚                    field axis_right_rad : float
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6634714117Jacopo Taniexercises_braitenbergmooc-BV1421successyesgpu-production-spot-1-040:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.013152173770371305
agent_compute-ego0_mean0.013152173770371305
agent_compute-ego0_median0.013152173770371305
agent_compute-ego0_min0.013152173770371305
complete-iteration_max0.19817788797467412
complete-iteration_mean0.19817788797467412
complete-iteration_median0.19817788797467412
complete-iteration_min0.19817788797467412
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max1.608600000000037
driven_any_mean1.608600000000037
driven_any_median1.608600000000037
driven_any_min1.608600000000037
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.042559469899823586
get_duckie_state_mean0.042559469899823586
get_duckie_state_median0.042559469899823586
get_duckie_state_min0.042559469899823586
get_robot_state_max0.0039584991325187
get_robot_state_mean0.0039584991325187
get_robot_state_median0.0039584991325187
get_robot_state_min0.0039584991325187
get_state_dump_max0.01176552960522286
get_state_dump_mean0.01176552960522286
get_state_dump_median0.01176552960522286
get_state_dump_min0.01176552960522286
get_ui_image_max0.02581487334330022
get_ui_image_mean0.02581487334330022
get_ui_image_median0.02581487334330022
get_ui_image_min0.02581487334330022
in-drivable-lane_max27.85000000000026
in-drivable-lane_mean27.85000000000026
in-drivable-lane_median27.85000000000026
in-drivable-lane_min27.85000000000026
per-episodes
details{"t08d20-ego0": {"driven_any": 1.608600000000037, "get_ui_image": 0.02581487334330022, "step_physics": 0.08181086278730823, "survival_time": 27.85000000000026, "driven_lanedir": 0.0, "get_state_dump": 0.01176552960522286, "get_robot_state": 0.0039584991325187, "sim_render-ego0": 0.003877638915960934, "get_duckie_state": 0.042559469899823586, "in-drivable-lane": 27.85000000000026, "deviation-heading": 0.0, "agent_compute-ego0": 0.013152173770371305, "complete-iteration": 0.19817788797467412, "set_robot_commands": 0.002312549126190951, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01077577546505945, "sim_compute_performance-ego0": 0.0020512158725424054}}
set_robot_commands_max0.002312549126190951
set_robot_commands_mean0.002312549126190951
set_robot_commands_median0.002312549126190951
set_robot_commands_min0.002312549126190951
sim_compute_performance-ego0_max0.0020512158725424054
sim_compute_performance-ego0_mean0.0020512158725424054
sim_compute_performance-ego0_median0.0020512158725424054
sim_compute_performance-ego0_min0.0020512158725424054
sim_compute_sim_state_max0.01077577546505945
sim_compute_sim_state_mean0.01077577546505945
sim_compute_sim_state_median0.01077577546505945
sim_compute_sim_state_min0.01077577546505945
sim_render-ego0_max0.003877638915960934
sim_render-ego0_mean0.003877638915960934
sim_render-ego0_median0.003877638915960934
sim_render-ego0_min0.003877638915960934
simulation-passed1
step_physics_max0.08181086278730823
step_physics_mean0.08181086278730823
step_physics_median0.08181086278730823
step_physics_min0.08181086278730823
survival_time_max27.85000000000026
survival_time_mean27.85000000000026
survival_time_median27.85000000000026
survival_time_min27.85000000000026
No reset possible
6631413939YU CHENCBC Net v2 test - added mar 31 datasetaido-LFP-sim-validationsim-1of4successnogpu-production-spot-1-040:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.7499999999999805
in-drivable-lane_median3.699999999999987
driven_lanedir_consec_median1.2454732351234088
deviation-center-line_median0.3001217680682904


other stats
agent_compute-ego0_max0.0949176977842282
agent_compute-ego0_mean0.0949176977842282
agent_compute-ego0_median0.0949176977842282
agent_compute-ego0_min0.0949176977842282
complete-iteration_max0.2714173549260849
complete-iteration_mean0.2714173549260849
complete-iteration_median0.2714173549260849
complete-iteration_min0.2714173549260849
deviation-center-line_max0.3001217680682904
deviation-center-line_mean0.3001217680682904
deviation-center-line_min0.3001217680682904
deviation-heading_max1.1754833187233278
deviation-heading_mean1.1754833187233278
deviation-heading_median1.1754833187233278
deviation-heading_min1.1754833187233278
driven_any_max2.06905620545571
driven_any_mean2.06905620545571
driven_any_median2.06905620545571
driven_any_min2.06905620545571
driven_lanedir_consec_max1.2454732351234088
driven_lanedir_consec_mean1.2454732351234088
driven_lanedir_consec_min1.2454732351234088
driven_lanedir_max1.2454732351234088
driven_lanedir_mean1.2454732351234088
driven_lanedir_median1.2454732351234088
driven_lanedir_min1.2454732351234088
get_duckie_state_max0.0044296964620932555
get_duckie_state_mean0.0044296964620932555
get_duckie_state_median0.0044296964620932555
get_duckie_state_min0.0044296964620932555
get_robot_state_max0.003908524146446815
get_robot_state_mean0.003908524146446815
get_robot_state_median0.003908524146446815
get_robot_state_min0.003908524146446815
get_state_dump_max0.0056727070074815015
get_state_dump_mean0.0056727070074815015
get_state_dump_median0.0056727070074815015
get_state_dump_min0.0056727070074815015
get_ui_image_max0.02810912101696699
get_ui_image_mean0.02810912101696699
get_ui_image_median0.02810912101696699
get_ui_image_min0.02810912101696699
in-drivable-lane_max3.699999999999987
in-drivable-lane_mean3.699999999999987
in-drivable-lane_min3.699999999999987
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 2.06905620545571, "get_ui_image": 0.02810912101696699, "step_physics": 0.11971673598656288, "survival_time": 7.7499999999999805, "driven_lanedir": 1.2454732351234088, "get_state_dump": 0.0056727070074815015, "get_robot_state": 0.003908524146446815, "sim_render-ego0": 0.003931368008638039, "get_duckie_state": 0.0044296964620932555, "in-drivable-lane": 3.699999999999987, "deviation-heading": 1.1754833187233278, "agent_compute-ego0": 0.0949176977842282, "complete-iteration": 0.2714173549260849, "set_robot_commands": 0.002422704146458552, "deviation-center-line": 0.3001217680682904, "driven_lanedir_consec": 1.2454732351234088, "sim_compute_sim_state": 0.006151767877432017, "sim_compute_performance-ego0": 0.0020604821351858284}}
set_robot_commands_max0.002422704146458552
set_robot_commands_mean0.002422704146458552
set_robot_commands_median0.002422704146458552
set_robot_commands_min0.002422704146458552
sim_compute_performance-ego0_max0.0020604821351858284
sim_compute_performance-ego0_mean0.0020604821351858284
sim_compute_performance-ego0_median0.0020604821351858284
sim_compute_performance-ego0_min0.0020604821351858284
sim_compute_sim_state_max0.006151767877432017
sim_compute_sim_state_mean0.006151767877432017
sim_compute_sim_state_median0.006151767877432017
sim_compute_sim_state_min0.006151767877432017
sim_render-ego0_max0.003931368008638039
sim_render-ego0_mean0.003931368008638039
sim_render-ego0_median0.003931368008638039
sim_render-ego0_min0.003931368008638039
simulation-passed1
step_physics_max0.11971673598656288
step_physics_mean0.11971673598656288
step_physics_median0.11971673598656288
step_physics_min0.11971673598656288
survival_time_max7.7499999999999805
survival_time_mean7.7499999999999805
survival_time_min7.7499999999999805
No reset possible
6630713912YU CHENCBC Net v2 - testaido-LFP-sim-validationsim-2of4successnogpu-production-spot-1-040:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.849999999999987
in-drivable-lane_median0.34999999999999876
driven_lanedir_consec_median2.0977623435044706
deviation-center-line_median0.4624492337574673


other stats
agent_compute-ego0_max0.09518978555323714
agent_compute-ego0_mean0.09518978555323714
agent_compute-ego0_median0.09518978555323714
agent_compute-ego0_min0.09518978555323714
complete-iteration_max0.3245592218334392
complete-iteration_mean0.3245592218334392
complete-iteration_median0.3245592218334392
complete-iteration_min0.3245592218334392
deviation-center-line_max0.4624492337574673
deviation-center-line_mean0.4624492337574673
deviation-center-line_min0.4624492337574673
deviation-heading_max1.293432697597198
deviation-heading_mean1.293432697597198
deviation-heading_median1.293432697597198
deviation-heading_min1.293432697597198
driven_any_max2.286404587024805
driven_any_mean2.286404587024805
driven_any_median2.286404587024805
driven_any_min2.286404587024805
driven_lanedir_consec_max2.0977623435044706
driven_lanedir_consec_mean2.0977623435044706
driven_lanedir_consec_min2.0977623435044706
driven_lanedir_max2.0977623435044706
driven_lanedir_mean2.0977623435044706
driven_lanedir_median2.0977623435044706
driven_lanedir_min2.0977623435044706
get_duckie_state_max0.026809221607143597
get_duckie_state_mean0.026809221607143597
get_duckie_state_median0.026809221607143597
get_duckie_state_min0.026809221607143597
get_robot_state_max0.004184151099900068
get_robot_state_mean0.004184151099900068
get_robot_state_median0.004184151099900068
get_robot_state_min0.004184151099900068
get_state_dump_max0.00988064580044504
get_state_dump_mean0.00988064580044504
get_state_dump_median0.00988064580044504
get_state_dump_min0.00988064580044504
get_ui_image_max0.03551075620166326
get_ui_image_mean0.03551075620166326
get_ui_image_median0.03551075620166326
get_ui_image_min0.03551075620166326
in-drivable-lane_max0.34999999999999876
in-drivable-lane_mean0.34999999999999876
in-drivable-lane_min0.34999999999999876
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.286404587024805, "get_ui_image": 0.03551075620166326, "step_physics": 0.13596757185661187, "survival_time": 5.849999999999987, "driven_lanedir": 2.0977623435044706, "get_state_dump": 0.00988064580044504, "get_robot_state": 0.004184151099900068, "sim_render-ego0": 0.00406128471180544, "get_duckie_state": 0.026809221607143597, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 1.293432697597198, "agent_compute-ego0": 0.09518978555323714, "complete-iteration": 0.3245592218334392, "set_robot_commands": 0.0025099414890095337, "deviation-center-line": 0.4624492337574673, "driven_lanedir_consec": 2.0977623435044706, "sim_compute_sim_state": 0.008189771134974592, "sim_compute_performance-ego0": 0.002140580597570387}}
set_robot_commands_max0.0025099414890095337
set_robot_commands_mean0.0025099414890095337
set_robot_commands_median0.0025099414890095337
set_robot_commands_min0.0025099414890095337
sim_compute_performance-ego0_max0.002140580597570387
sim_compute_performance-ego0_mean0.002140580597570387
sim_compute_performance-ego0_median0.002140580597570387
sim_compute_performance-ego0_min0.002140580597570387
sim_compute_sim_state_max0.008189771134974592
sim_compute_sim_state_mean0.008189771134974592
sim_compute_sim_state_median0.008189771134974592
sim_compute_sim_state_min0.008189771134974592
sim_render-ego0_max0.00406128471180544
sim_render-ego0_mean0.00406128471180544
sim_render-ego0_median0.00406128471180544
sim_render-ego0_min0.00406128471180544
simulation-passed1
step_physics_max0.13596757185661187
step_physics_mean0.13596757185661187
step_physics_median0.13596757185661187
step_physics_min0.13596757185661187
survival_time_max5.849999999999987
survival_time_mean5.849999999999987
survival_time_min5.849999999999987
No reset possible
6629013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-1-040:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6628613798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-1-040:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6626913694Samuel Alexandertemplate-tensorflowaido-LF-sim-validationsim-2of4successnogpu-production-spot-1-040:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20974163323638173
survival_time_median5.899999999999987
deviation-center-line_median0.08330758100913338
in-drivable-lane_median4.449999999999989


other stats
agent_compute-ego0_max0.03064762444055381
agent_compute-ego0_mean0.03064762444055381
agent_compute-ego0_median0.03064762444055381
agent_compute-ego0_min0.03064762444055381
complete-iteration_max0.18978278176123356
complete-iteration_mean0.18978278176123356
complete-iteration_median0.18978278176123356
complete-iteration_min0.18978278176123356
deviation-center-line_max0.08330758100913338
deviation-center-line_mean0.08330758100913338
deviation-center-line_min0.08330758100913338
deviation-heading_max1.061369761525336
deviation-heading_mean1.061369761525336
deviation-heading_median1.061369761525336
deviation-heading_min1.061369761525336
driven_any_max2.119516977414813
driven_any_mean2.119516977414813
driven_any_median2.119516977414813
driven_any_min2.119516977414813
driven_lanedir_consec_max0.20974163323638173
driven_lanedir_consec_mean0.20974163323638173
driven_lanedir_consec_min0.20974163323638173
driven_lanedir_max0.20974163323638173
driven_lanedir_mean0.20974163323638173
driven_lanedir_median0.20974163323638173
driven_lanedir_min0.20974163323638173
get_duckie_state_max1.2001069653935793e-06
get_duckie_state_mean1.2001069653935793e-06
get_duckie_state_median1.2001069653935793e-06
get_duckie_state_min1.2001069653935793e-06
get_robot_state_max0.003962659034408441
get_robot_state_mean0.003962659034408441
get_robot_state_median0.003962659034408441
get_robot_state_min0.003962659034408441
get_state_dump_max0.004908784096982299
get_state_dump_mean0.004908784096982299
get_state_dump_median0.004908784096982299
get_state_dump_min0.004908784096982299
get_ui_image_max0.027341421912698186
get_ui_image_mean0.027341421912698186
get_ui_image_median0.027341421912698186
get_ui_image_min0.027341421912698186
in-drivable-lane_max4.449999999999989
in-drivable-lane_mean4.449999999999989
in-drivable-lane_min4.449999999999989
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 2.119516977414813, "get_ui_image": 0.027341421912698186, "step_physics": 0.10710478430034734, "survival_time": 5.899999999999987, "driven_lanedir": 0.20974163323638173, "get_state_dump": 0.004908784096982299, "get_robot_state": 0.003962659034408441, "sim_render-ego0": 0.004200604783386744, "get_duckie_state": 1.2001069653935793e-06, "in-drivable-lane": 4.449999999999989, "deviation-heading": 1.061369761525336, "agent_compute-ego0": 0.03064762444055381, "complete-iteration": 0.18978278176123356, "set_robot_commands": 0.002617240953846138, "deviation-center-line": 0.08330758100913338, "driven_lanedir_consec": 0.20974163323638173, "sim_compute_sim_state": 0.006710499274630507, "sim_compute_performance-ego0": 0.0022023946297268907}}
set_robot_commands_max0.002617240953846138
set_robot_commands_mean0.002617240953846138
set_robot_commands_median0.002617240953846138
set_robot_commands_min0.002617240953846138
sim_compute_performance-ego0_max0.0022023946297268907
sim_compute_performance-ego0_mean0.0022023946297268907
sim_compute_performance-ego0_median0.0022023946297268907
sim_compute_performance-ego0_min0.0022023946297268907
sim_compute_sim_state_max0.006710499274630507
sim_compute_sim_state_mean0.006710499274630507
sim_compute_sim_state_median0.006710499274630507
sim_compute_sim_state_min0.006710499274630507
sim_render-ego0_max0.004200604783386744
sim_render-ego0_mean0.004200604783386744
sim_render-ego0_median0.004200604783386744
sim_render-ego0_min0.004200604783386744
simulation-passed1
step_physics_max0.10710478430034734
step_physics_mean0.10710478430034734
step_physics_median0.10710478430034734
step_physics_min0.10710478430034734
survival_time_max5.899999999999987
survival_time_mean5.899999999999987
survival_time_min5.899999999999987
No reset possible
6624213730YU CHENBC Net V2aido-LF-sim-validationsim-0of4successnogpu-production-spot-1-040:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.120576606286187
survival_time_median25.05000000000022
deviation-center-line_median1.286612871657754
in-drivable-lane_median9.100000000000096


other stats
agent_compute-ego0_max0.059960011467040775
agent_compute-ego0_mean0.059960011467040775
agent_compute-ego0_median0.059960011467040775
agent_compute-ego0_min0.059960011467040775
complete-iteration_max0.2756151986787044
complete-iteration_mean0.2756151986787044
complete-iteration_median0.2756151986787044
complete-iteration_min0.2756151986787044
deviation-center-line_max1.286612871657754
deviation-center-line_mean1.286612871657754
deviation-center-line_min1.286612871657754
deviation-heading_max3.993585369028216
deviation-heading_mean3.993585369028216
deviation-heading_median3.993585369028216
deviation-heading_min3.993585369028216
driven_any_max10.159166614020137
driven_any_mean10.159166614020137
driven_any_median10.159166614020137
driven_any_min10.159166614020137
driven_lanedir_consec_max7.120576606286187
driven_lanedir_consec_mean7.120576606286187
driven_lanedir_consec_min7.120576606286187
driven_lanedir_max7.120576606286187
driven_lanedir_mean7.120576606286187
driven_lanedir_median7.120576606286187
driven_lanedir_min7.120576606286187
get_duckie_state_max1.706450108987877e-06
get_duckie_state_mean1.706450108987877e-06
get_duckie_state_median1.706450108987877e-06
get_duckie_state_min1.706450108987877e-06
get_robot_state_max0.004255644353737394
get_robot_state_mean0.004255644353737394
get_robot_state_median0.004255644353737394
get_robot_state_min0.004255644353737394
get_state_dump_max0.005528560672623228
get_state_dump_mean0.005528560672623228
get_state_dump_median0.005528560672623228
get_state_dump_min0.005528560672623228
get_ui_image_max0.03244505935456173
get_ui_image_mean0.03244505935456173
get_ui_image_median0.03244505935456173
get_ui_image_min0.03244505935456173
in-drivable-lane_max9.100000000000096
in-drivable-lane_mean9.100000000000096
in-drivable-lane_min9.100000000000096
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.159166614020137, "get_ui_image": 0.03244505935456173, "step_physics": 0.15357432137447524, "survival_time": 25.05000000000022, "driven_lanedir": 7.120576606286187, "get_state_dump": 0.005528560672623228, "get_robot_state": 0.004255644353737394, "sim_render-ego0": 0.00443796807551289, "get_duckie_state": 1.706450108987877e-06, "in-drivable-lane": 9.100000000000096, "deviation-heading": 3.993585369028216, "agent_compute-ego0": 0.059960011467040775, "complete-iteration": 0.2756151986787044, "set_robot_commands": 0.002629565527714581, "deviation-center-line": 1.286612871657754, "driven_lanedir_consec": 7.120576606286187, "sim_compute_sim_state": 0.01031417865677184, "sim_compute_performance-ego0": 0.002367094218493458}}
set_robot_commands_max0.002629565527714581
set_robot_commands_mean0.002629565527714581
set_robot_commands_median0.002629565527714581
set_robot_commands_min0.002629565527714581
sim_compute_performance-ego0_max0.002367094218493458
sim_compute_performance-ego0_mean0.002367094218493458
sim_compute_performance-ego0_median0.002367094218493458
sim_compute_performance-ego0_min0.002367094218493458
sim_compute_sim_state_max0.01031417865677184
sim_compute_sim_state_mean0.01031417865677184
sim_compute_sim_state_median0.01031417865677184
sim_compute_sim_state_min0.01031417865677184
sim_render-ego0_max0.00443796807551289
sim_render-ego0_mean0.00443796807551289
sim_render-ego0_median0.00443796807551289
sim_render-ego0_min0.00443796807551289
simulation-passed1
step_physics_max0.15357432137447524
step_physics_mean0.15357432137447524
step_physics_median0.15357432137447524
step_physics_min0.15357432137447524
survival_time_max25.05000000000022
survival_time_mean25.05000000000022
survival_time_min25.05000000000022
No reset possible
6621313941YU CHENCBC Net v2 test - added mar 31 anomaly + mar 28 bcaido-LFP-sim-validationsim-3of4successnogpu-production-spot-1-040:10:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median50.69999999999926
in-drivable-lane_median15.899999999999736
driven_lanedir_consec_median13.89024342591542
deviation-center-line_median2.668952560017124


other stats
agent_compute-ego0_max0.0935754914589116
agent_compute-ego0_mean0.0935754914589116
agent_compute-ego0_median0.0935754914589116
agent_compute-ego0_min0.0935754914589116
complete-iteration_max0.35694976111350973
complete-iteration_mean0.35694976111350973
complete-iteration_median0.35694976111350973
complete-iteration_min0.35694976111350973
deviation-center-line_max2.668952560017124
deviation-center-line_mean2.668952560017124
deviation-center-line_min2.668952560017124
deviation-heading_max10.56613316814414
deviation-heading_mean10.56613316814414
deviation-heading_median10.56613316814414
deviation-heading_min10.56613316814414
driven_any_max21.86537032200918
driven_any_mean21.86537032200918
driven_any_median21.86537032200918
driven_any_min21.86537032200918
driven_lanedir_consec_max13.89024342591542
driven_lanedir_consec_mean13.89024342591542
driven_lanedir_consec_min13.89024342591542
driven_lanedir_max13.89024342591542
driven_lanedir_mean13.89024342591542
driven_lanedir_median13.89024342591542
driven_lanedir_min13.89024342591542
get_duckie_state_max0.02249622885229552
get_duckie_state_mean0.02249622885229552
get_duckie_state_median0.02249622885229552
get_duckie_state_min0.02249622885229552
get_robot_state_max0.004129534049574377
get_robot_state_mean0.004129534049574377
get_robot_state_median0.004129534049574377
get_robot_state_min0.004129534049574377
get_state_dump_max0.008468750075166448
get_state_dump_mean0.008468750075166448
get_state_dump_median0.008468750075166448
get_state_dump_min0.008468750075166448
get_ui_image_max0.03910774104113649
get_ui_image_mean0.03910774104113649
get_ui_image_median0.03910774104113649
get_ui_image_min0.03910774104113649
in-drivable-lane_max15.899999999999736
in-drivable-lane_mean15.899999999999736
in-drivable-lane_min15.899999999999736
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 21.86537032200918, "get_ui_image": 0.03910774104113649, "step_physics": 0.1667177735878329, "survival_time": 50.69999999999926, "driven_lanedir": 13.89024342591542, "get_state_dump": 0.008468750075166448, "get_robot_state": 0.004129534049574377, "sim_render-ego0": 0.004179090114649881, "get_duckie_state": 0.02249622885229552, "in-drivable-lane": 15.899999999999736, "deviation-heading": 10.56613316814414, "agent_compute-ego0": 0.0935754914589116, "complete-iteration": 0.35694976111350973, "set_robot_commands": 0.002593920618442479, "deviation-center-line": 2.668952560017124, "driven_lanedir_consec": 13.89024342591542, "sim_compute_sim_state": 0.013320384941664822, "sim_compute_performance-ego0": 0.0022532618104530674}}
set_robot_commands_max0.002593920618442479
set_robot_commands_mean0.002593920618442479
set_robot_commands_median0.002593920618442479
set_robot_commands_min0.002593920618442479
sim_compute_performance-ego0_max0.0022532618104530674
sim_compute_performance-ego0_mean0.0022532618104530674
sim_compute_performance-ego0_median0.0022532618104530674
sim_compute_performance-ego0_min0.0022532618104530674
sim_compute_sim_state_max0.013320384941664822
sim_compute_sim_state_mean0.013320384941664822
sim_compute_sim_state_median0.013320384941664822
sim_compute_sim_state_min0.013320384941664822
sim_render-ego0_max0.004179090114649881
sim_render-ego0_mean0.004179090114649881
sim_render-ego0_median0.004179090114649881
sim_render-ego0_min0.004179090114649881
simulation-passed1
step_physics_max0.1667177735878329
step_physics_mean0.1667177735878329
step_physics_median0.1667177735878329
step_physics_min0.1667177735878329
survival_time_max50.69999999999926
survival_time_mean50.69999999999926
survival_time_min50.69999999999926
No reset possible
6619813946YU CHENCBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1aido-LFP-sim-validationsim-2of4successnogpu-production-spot-1-040:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.699999999999984
in-drivable-lane_median1.499999999999995
driven_lanedir_consec_median1.8862341720374312
deviation-center-line_median0.39928862486221983


other stats
agent_compute-ego0_max0.1028321901957194
agent_compute-ego0_mean0.1028321901957194
agent_compute-ego0_median0.1028321901957194
agent_compute-ego0_min0.1028321901957194
complete-iteration_max0.3547862812324806
complete-iteration_mean0.3547862812324806
complete-iteration_median0.3547862812324806
complete-iteration_min0.3547862812324806
deviation-center-line_max0.39928862486221983
deviation-center-line_mean0.39928862486221983
deviation-center-line_min0.39928862486221983
deviation-heading_max1.5532450490877847
deviation-heading_mean1.5532450490877847
deviation-heading_median1.5532450490877847
deviation-heading_min1.5532450490877847
driven_any_max2.4130243568951792
driven_any_mean2.4130243568951792
driven_any_median2.4130243568951792
driven_any_min2.4130243568951792
driven_lanedir_consec_max1.8862341720374312
driven_lanedir_consec_mean1.8862341720374312
driven_lanedir_consec_min1.8862341720374312
driven_lanedir_max1.8862341720374312
driven_lanedir_mean1.8862341720374312
driven_lanedir_median1.8862341720374312
driven_lanedir_min1.8862341720374312
get_duckie_state_max0.028122101889716256
get_duckie_state_mean0.028122101889716256
get_duckie_state_median0.028122101889716256
get_duckie_state_min0.028122101889716256
get_robot_state_max0.00431627697414822
get_robot_state_mean0.00431627697414822
get_robot_state_median0.00431627697414822
get_robot_state_min0.00431627697414822
get_state_dump_max0.00988278035764341
get_state_dump_mean0.00988278035764341
get_state_dump_median0.00988278035764341
get_state_dump_min0.00988278035764341
get_ui_image_max0.03588447570800781
get_ui_image_mean0.03588447570800781
get_ui_image_median0.03588447570800781
get_ui_image_min0.03588447570800781
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean1.499999999999995
in-drivable-lane_min1.499999999999995
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.4130243568951792, "get_ui_image": 0.03588447570800781, "step_physics": 0.15576630345097295, "survival_time": 6.699999999999984, "driven_lanedir": 1.8862341720374312, "get_state_dump": 0.00988278035764341, "get_robot_state": 0.00431627697414822, "sim_render-ego0": 0.004269343835336191, "get_duckie_state": 0.028122101889716256, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.5532450490877847, "agent_compute-ego0": 0.1028321901957194, "complete-iteration": 0.3547862812324806, "set_robot_commands": 0.0025111463334825303, "deviation-center-line": 0.39928862486221983, "driven_lanedir_consec": 1.8862341720374312, "sim_compute_sim_state": 0.008821164237128363, "sim_compute_performance-ego0": 0.002266565958658854}}
set_robot_commands_max0.0025111463334825303
set_robot_commands_mean0.0025111463334825303
set_robot_commands_median0.0025111463334825303
set_robot_commands_min0.0025111463334825303
sim_compute_performance-ego0_max0.002266565958658854
sim_compute_performance-ego0_mean0.002266565958658854
sim_compute_performance-ego0_median0.002266565958658854
sim_compute_performance-ego0_min0.002266565958658854
sim_compute_sim_state_max0.008821164237128363
sim_compute_sim_state_mean0.008821164237128363
sim_compute_sim_state_median0.008821164237128363
sim_compute_sim_state_min0.008821164237128363
sim_render-ego0_max0.004269343835336191
sim_render-ego0_mean0.004269343835336191
sim_render-ego0_median0.004269343835336191
sim_render-ego0_min0.004269343835336191
simulation-passed1
step_physics_max0.15576630345097295
step_physics_mean0.15576630345097295
step_physics_median0.15576630345097295
step_physics_min0.15576630345097295
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_min6.699999999999984
No reset possible
6618413946YU CHENCBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1aido-LFP-sim-validationsim-2of4successnogpu-production-spot-1-040:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median1.949999999999993
driven_lanedir_consec_median1.8696525165556752
deviation-center-line_median0.4557592879456817


other stats
agent_compute-ego0_max0.10130477951956796
agent_compute-ego0_mean0.10130477951956796
agent_compute-ego0_median0.10130477951956796
agent_compute-ego0_min0.10130477951956796
complete-iteration_max0.35689012320725233
complete-iteration_mean0.35689012320725233
complete-iteration_median0.35689012320725233
complete-iteration_min0.35689012320725233
deviation-center-line_max0.4557592879456817
deviation-center-line_mean0.4557592879456817
deviation-center-line_min0.4557592879456817
deviation-heading_max1.7646440345978984
deviation-heading_mean1.7646440345978984
deviation-heading_median1.7646440345978984
deviation-heading_min1.7646440345978984
driven_any_max2.458968362022328
driven_any_mean2.458968362022328
driven_any_median2.458968362022328
driven_any_min2.458968362022328
driven_lanedir_consec_max1.8696525165556752
driven_lanedir_consec_mean1.8696525165556752
driven_lanedir_consec_min1.8696525165556752
driven_lanedir_max1.8696525165556752
driven_lanedir_mean1.8696525165556752
driven_lanedir_median1.8696525165556752
driven_lanedir_min1.8696525165556752
get_duckie_state_max0.027836484508914548
get_duckie_state_mean0.027836484508914548
get_duckie_state_median0.027836484508914548
get_duckie_state_min0.027836484508914548
get_robot_state_max0.0042828663245781315
get_robot_state_mean0.0042828663245781315
get_robot_state_median0.0042828663245781315
get_robot_state_min0.0042828663245781315
get_state_dump_max0.009925848954207414
get_state_dump_mean0.009925848954207414
get_state_dump_median0.009925848954207414
get_state_dump_min0.009925848954207414
get_ui_image_max0.0367564388088413
get_ui_image_mean0.0367564388088413
get_ui_image_median0.0367564388088413
get_ui_image_min0.0367564388088413
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean1.949999999999993
in-drivable-lane_min1.949999999999993
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.458968362022328, "get_ui_image": 0.0367564388088413, "step_physics": 0.15897549615873324, "survival_time": 7.099999999999983, "driven_lanedir": 1.8696525165556752, "get_state_dump": 0.009925848954207414, "get_robot_state": 0.0042828663245781315, "sim_render-ego0": 0.004269229782211197, "get_duckie_state": 0.027836484508914548, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.7646440345978984, "agent_compute-ego0": 0.10130477951956796, "complete-iteration": 0.35689012320725233, "set_robot_commands": 0.0026552643809285197, "deviation-center-line": 0.4557592879456817, "driven_lanedir_consec": 1.8696525165556752, "sim_compute_sim_state": 0.008495934359677187, "sim_compute_performance-ego0": 0.0022654566731486287}}
set_robot_commands_max0.0026552643809285197
set_robot_commands_mean0.0026552643809285197
set_robot_commands_median0.0026552643809285197
set_robot_commands_min0.0026552643809285197
sim_compute_performance-ego0_max0.0022654566731486287
sim_compute_performance-ego0_mean0.0022654566731486287
sim_compute_performance-ego0_median0.0022654566731486287
sim_compute_performance-ego0_min0.0022654566731486287
sim_compute_sim_state_max0.008495934359677187
sim_compute_sim_state_mean0.008495934359677187
sim_compute_sim_state_median0.008495934359677187
sim_compute_sim_state_min0.008495934359677187
sim_render-ego0_max0.004269229782211197
sim_render-ego0_mean0.004269229782211197
sim_render-ego0_median0.004269229782211197
sim_render-ego0_min0.004269229782211197
simulation-passed1
step_physics_max0.15897549615873324
step_physics_mean0.15897549615873324
step_physics_median0.15897549615873324
step_physics_min0.15897549615873324
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
6617313965YU CHENCBC Net v2 test - APR 3 BC TFdata + mar 28 anomalyaido-LFP-sim-validationsim-1of4successnogpu-production-spot-1-040:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.199999999999993
in-drivable-lane_median2.349999999999992
driven_lanedir_consec_median0.6081148449974982
deviation-center-line_median0.10983243218258376


other stats
agent_compute-ego0_max0.09246211332433364
agent_compute-ego0_mean0.09246211332433364
agent_compute-ego0_median0.09246211332433364
agent_compute-ego0_min0.09246211332433364
complete-iteration_max0.24556212425231932
complete-iteration_mean0.24556212425231932
complete-iteration_median0.24556212425231932
complete-iteration_min0.24556212425231932
deviation-center-line_max0.10983243218258376
deviation-center-line_mean0.10983243218258376
deviation-center-line_min0.10983243218258376
deviation-heading_max0.5047644389670692
deviation-heading_mean0.5047644389670692
deviation-heading_median0.5047644389670692
deviation-heading_min0.5047644389670692
driven_any_max1.264607973786022
driven_any_mean1.264607973786022
driven_any_median1.264607973786022
driven_any_min1.264607973786022
driven_lanedir_consec_max0.6081148449974982
driven_lanedir_consec_mean0.6081148449974982
driven_lanedir_consec_min0.6081148449974982
driven_lanedir_max0.6081148449974982
driven_lanedir_mean0.6081148449974982
driven_lanedir_median0.6081148449974982
driven_lanedir_min0.6081148449974982
get_duckie_state_max0.004488246581133675
get_duckie_state_mean0.004488246581133675
get_duckie_state_median0.004488246581133675
get_duckie_state_min0.004488246581133675
get_robot_state_max0.003867017521577723
get_robot_state_mean0.003867017521577723
get_robot_state_median0.003867017521577723
get_robot_state_min0.003867017521577723
get_state_dump_max0.005675369150498334
get_state_dump_mean0.005675369150498334
get_state_dump_median0.005675369150498334
get_state_dump_min0.005675369150498334
get_ui_image_max0.02770824712865493
get_ui_image_mean0.02770824712865493
get_ui_image_median0.02770824712865493
get_ui_image_min0.02770824712865493
in-drivable-lane_max2.349999999999992
in-drivable-lane_mean2.349999999999992
in-drivable-lane_min2.349999999999992
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 1.264607973786022, "get_ui_image": 0.02770824712865493, "step_physics": 0.0958268502179314, "survival_time": 4.199999999999993, "driven_lanedir": 0.6081148449974982, "get_state_dump": 0.005675369150498334, "get_robot_state": 0.003867017521577723, "sim_render-ego0": 0.00413219788495232, "get_duckie_state": 0.004488246581133675, "in-drivable-lane": 2.349999999999992, "deviation-heading": 0.5047644389670692, "agent_compute-ego0": 0.09246211332433364, "complete-iteration": 0.24556212425231932, "set_robot_commands": 0.0024976618149701287, "deviation-center-line": 0.10983243218258376, "driven_lanedir_consec": 0.6081148449974982, "sim_compute_sim_state": 0.0066787158741670495, "sim_compute_performance-ego0": 0.002132244671092314}}
set_robot_commands_max0.0024976618149701287
set_robot_commands_mean0.0024976618149701287
set_robot_commands_median0.0024976618149701287
set_robot_commands_min0.0024976618149701287
sim_compute_performance-ego0_max0.002132244671092314
sim_compute_performance-ego0_mean0.002132244671092314
sim_compute_performance-ego0_median0.002132244671092314
sim_compute_performance-ego0_min0.002132244671092314
sim_compute_sim_state_max0.0066787158741670495
sim_compute_sim_state_mean0.0066787158741670495
sim_compute_sim_state_median0.0066787158741670495
sim_compute_sim_state_min0.0066787158741670495
sim_render-ego0_max0.00413219788495232
sim_render-ego0_mean0.00413219788495232
sim_render-ego0_median0.00413219788495232
sim_render-ego0_min0.00413219788495232
simulation-passed1
step_physics_max0.0958268502179314
step_physics_mean0.0958268502179314
step_physics_median0.0958268502179314
step_physics_min0.0958268502179314
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
6613514034YU CHENCBC V2, mar28_apr6 bc, mar31_apr6 anomaly aido-LFP-sim-validationsim-1of4successnogpu-production-spot-1-040:06:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median37.350000000000016
in-drivable-lane_median25.749999999999964
driven_lanedir_consec_median3.1037634006005472
deviation-center-line_median0.7891638144319489


other stats
agent_compute-ego0_max0.0938663269109267
agent_compute-ego0_mean0.0938663269109267
agent_compute-ego0_median0.0938663269109267
agent_compute-ego0_min0.0938663269109267
complete-iteration_max0.28633896839172446
complete-iteration_mean0.28633896839172446
complete-iteration_median0.28633896839172446
complete-iteration_min0.28633896839172446
deviation-center-line_max0.7891638144319489
deviation-center-line_mean0.7891638144319489
deviation-center-line_min0.7891638144319489
deviation-heading_max4.5666617046959095
deviation-heading_mean4.5666617046959095
deviation-heading_median4.5666617046959095
deviation-heading_min4.5666617046959095
driven_any_max11.90278025745798
driven_any_mean11.90278025745798
driven_any_median11.90278025745798
driven_any_min11.90278025745798
driven_lanedir_consec_max3.1037634006005472
driven_lanedir_consec_mean3.1037634006005472
driven_lanedir_consec_min3.1037634006005472
driven_lanedir_max3.1037634006005472
driven_lanedir_mean3.1037634006005472
driven_lanedir_median3.1037634006005472
driven_lanedir_min3.1037634006005472
get_duckie_state_max0.004651908249778544
get_duckie_state_mean0.004651908249778544
get_duckie_state_median0.004651908249778544
get_duckie_state_min0.004651908249778544
get_robot_state_max0.00406216650723136
get_robot_state_mean0.00406216650723136
get_robot_state_median0.00406216650723136
get_robot_state_min0.00406216650723136
get_state_dump_max0.005887386633113106
get_state_dump_mean0.005887386633113106
get_state_dump_median0.005887386633113106
get_state_dump_min0.005887386633113106
get_ui_image_max0.02937826083943168
get_ui_image_mean0.02937826083943168
get_ui_image_median0.02937826083943168
get_ui_image_min0.02937826083943168
in-drivable-lane_max25.749999999999964
in-drivable-lane_mean25.749999999999964
in-drivable-lane_min25.749999999999964
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 11.90278025745798, "get_ui_image": 0.02937826083943168, "step_physics": 0.1329651777757043, "survival_time": 37.350000000000016, "driven_lanedir": 3.1037634006005472, "get_state_dump": 0.005887386633113106, "get_robot_state": 0.00406216650723136, "sim_render-ego0": 0.004137909667377166, "get_duckie_state": 0.004651908249778544, "in-drivable-lane": 25.749999999999964, "deviation-heading": 4.5666617046959095, "agent_compute-ego0": 0.0938663269109267, "complete-iteration": 0.28633896839172446, "set_robot_commands": 0.002521845427426425, "deviation-center-line": 0.7891638144319489, "driven_lanedir_consec": 3.1037634006005472, "sim_compute_sim_state": 0.006562945358255968, "sim_compute_performance-ego0": 0.0021894035492351347}}
set_robot_commands_max0.002521845427426425
set_robot_commands_mean0.002521845427426425
set_robot_commands_median0.002521845427426425
set_robot_commands_min0.002521845427426425
sim_compute_performance-ego0_max0.0021894035492351347
sim_compute_performance-ego0_mean0.0021894035492351347
sim_compute_performance-ego0_median0.0021894035492351347
sim_compute_performance-ego0_min0.0021894035492351347
sim_compute_sim_state_max0.006562945358255968
sim_compute_sim_state_mean0.006562945358255968
sim_compute_sim_state_median0.006562945358255968
sim_compute_sim_state_min0.006562945358255968
sim_render-ego0_max0.004137909667377166
sim_render-ego0_mean0.004137909667377166
sim_render-ego0_median0.004137909667377166
sim_render-ego0_min0.004137909667377166
simulation-passed1
step_physics_max0.1329651777757043
step_physics_mean0.1329651777757043
step_physics_median0.1329651777757043
step_physics_min0.1329651777757043
survival_time_max37.350000000000016
survival_time_mean37.350000000000016
survival_time_min37.350000000000016
No reset possible
6611814036YU CHENCBC V2 non dropout comparsion, mar28_apr6 bc, mar31_apr6 anomaly aido-LFP-sim-validationsim-0of4successnogpu-production-spot-1-040:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.050000000000022
in-drivable-lane_median5.100000000000011
driven_lanedir_consec_median1.6497667901243769
deviation-center-line_median0.4843491790202828


other stats
agent_compute-ego0_max0.09321114823624894
agent_compute-ego0_mean0.09321114823624894
agent_compute-ego0_median0.09321114823624894
agent_compute-ego0_min0.09321114823624894
complete-iteration_max0.35748790728079305
complete-iteration_mean0.35748790728079305
complete-iteration_median0.35748790728079305
complete-iteration_min0.35748790728079305
deviation-center-line_max0.4843491790202828
deviation-center-line_mean0.4843491790202828
deviation-center-line_min0.4843491790202828
deviation-heading_max2.1944313888932965
deviation-heading_mean2.1944313888932965
deviation-heading_median2.1944313888932965
deviation-heading_min2.1944313888932965
driven_any_max3.4785507835860545
driven_any_mean3.4785507835860545
driven_any_median3.4785507835860545
driven_any_min3.4785507835860545
driven_lanedir_consec_max1.6497667901243769
driven_lanedir_consec_mean1.6497667901243769
driven_lanedir_consec_min1.6497667901243769
driven_lanedir_max1.6497667901243769
driven_lanedir_mean1.6497667901243769
driven_lanedir_median1.6497667901243769
driven_lanedir_min1.6497667901243769
get_duckie_state_max0.02229360954181568
get_duckie_state_mean0.02229360954181568
get_duckie_state_median0.02229360954181568
get_duckie_state_min0.02229360954181568
get_robot_state_max0.004052378035880424
get_robot_state_mean0.004052378035880424
get_robot_state_median0.004052378035880424
get_robot_state_min0.004052378035880424
get_state_dump_max0.008377644392821166
get_state_dump_mean0.008377644392821166
get_state_dump_median0.008377644392821166
get_state_dump_min0.008377644392821166
get_ui_image_max0.041355109429574224
get_ui_image_mean0.041355109429574224
get_ui_image_median0.041355109429574224
get_ui_image_min0.041355109429574224
in-drivable-lane_max5.100000000000011
in-drivable-lane_mean5.100000000000011
in-drivable-lane_min5.100000000000011
per-episodes
details{"LFP-norm-zigzag-000-ego0": {"driven_any": 3.4785507835860545, "get_ui_image": 0.041355109429574224, "step_physics": 0.16749057039484247, "survival_time": 11.050000000000022, "driven_lanedir": 1.6497667901243769, "get_state_dump": 0.008377644392821166, "get_robot_state": 0.004052378035880424, "sim_render-ego0": 0.004116603920051643, "get_duckie_state": 0.02229360954181568, "in-drivable-lane": 5.100000000000011, "deviation-heading": 2.1944313888932965, "agent_compute-ego0": 0.09321114823624894, "complete-iteration": 0.35748790728079305, "set_robot_commands": 0.0025433806685714036, "deviation-center-line": 0.4843491790202828, "driven_lanedir_consec": 1.6497667901243769, "sim_compute_sim_state": 0.011779617618870091, "sim_compute_performance-ego0": 0.0021725893020629883}}
set_robot_commands_max0.0025433806685714036
set_robot_commands_mean0.0025433806685714036
set_robot_commands_median0.0025433806685714036
set_robot_commands_min0.0025433806685714036
sim_compute_performance-ego0_max0.0021725893020629883
sim_compute_performance-ego0_mean0.0021725893020629883
sim_compute_performance-ego0_median0.0021725893020629883
sim_compute_performance-ego0_min0.0021725893020629883
sim_compute_sim_state_max0.011779617618870091
sim_compute_sim_state_mean0.011779617618870091
sim_compute_sim_state_median0.011779617618870091
sim_compute_sim_state_min0.011779617618870091
sim_render-ego0_max0.004116603920051643
sim_render-ego0_mean0.004116603920051643
sim_render-ego0_median0.004116603920051643
sim_render-ego0_min0.004116603920051643
simulation-passed1
step_physics_max0.16749057039484247
step_physics_mean0.16749057039484247
step_physics_median0.16749057039484247
step_physics_min0.16749057039484247
survival_time_max11.050000000000022
survival_time_mean11.050000000000022
survival_time_min11.050000000000022
No reset possible
6608113534AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ί3090aido-LF-sim-testingsim-0of4successnogpu-production-spot-1-040:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.314937776752767
survival_time_median59.99999999999873
deviation-center-line_median2.245195352266652
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01402167674405291
agent_compute-ego0_mean0.01402167674405291
agent_compute-ego0_median0.01402167674405291
agent_compute-ego0_min0.01402167674405291
complete-iteration_max0.2228502955265982
complete-iteration_mean0.2228502955265982
complete-iteration_median0.2228502955265982
complete-iteration_min0.2228502955265982
deviation-center-line_max2.245195352266652
deviation-center-line_mean2.245195352266652
deviation-center-line_min2.245195352266652
deviation-heading_max9.892809404746949
deviation-heading_mean9.892809404746949
deviation-heading_median9.892809404746949
deviation-heading_min9.892809404746949
driven_any_max28.863090914615835
driven_any_mean28.863090914615835
driven_any_median28.863090914615835
driven_any_min28.863090914615835
driven_lanedir_consec_max28.314937776752767
driven_lanedir_consec_mean28.314937776752767
driven_lanedir_consec_min28.314937776752767
driven_lanedir_max28.314937776752767
driven_lanedir_mean28.314937776752767
driven_lanedir_median28.314937776752767
driven_lanedir_min28.314937776752767
get_duckie_state_max1.3185480452894073e-06
get_duckie_state_mean1.3185480452894073e-06
get_duckie_state_median1.3185480452894073e-06
get_duckie_state_min1.3185480452894073e-06
get_robot_state_max0.004022566900960016
get_robot_state_mean0.004022566900960016
get_robot_state_median0.004022566900960016
get_robot_state_min0.004022566900960016
get_state_dump_max0.004819586116209515
get_state_dump_mean0.004819586116209515
get_state_dump_median0.004819586116209515
get_state_dump_min0.004819586116209515
get_ui_image_max0.03065317219044148
get_ui_image_mean0.03065317219044148
get_ui_image_median0.03065317219044148
get_ui_image_min0.03065317219044148
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 28.863090914615835, "get_ui_image": 0.03065317219044148, "step_physics": 0.15095675974265424, "survival_time": 59.99999999999873, "driven_lanedir": 28.314937776752767, "get_state_dump": 0.004819586116209515, "get_robot_state": 0.004022566900960016, "sim_render-ego0": 0.004012223981401506, "get_duckie_state": 1.3185480452894073e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.892809404746949, "agent_compute-ego0": 0.01402167674405291, "complete-iteration": 0.2228502955265982, "set_robot_commands": 0.0024485071930261974, "deviation-center-line": 2.245195352266652, "driven_lanedir_consec": 28.314937776752767, "sim_compute_sim_state": 0.009679562046962614, "sim_compute_performance-ego0": 0.002153143299112312}}
set_robot_commands_max0.0024485071930261974
set_robot_commands_mean0.0024485071930261974
set_robot_commands_median0.0024485071930261974
set_robot_commands_min0.0024485071930261974
sim_compute_performance-ego0_max0.002153143299112312
sim_compute_performance-ego0_mean0.002153143299112312
sim_compute_performance-ego0_median0.002153143299112312
sim_compute_performance-ego0_min0.002153143299112312
sim_compute_sim_state_max0.009679562046962614
sim_compute_sim_state_mean0.009679562046962614
sim_compute_sim_state_median0.009679562046962614
sim_compute_sim_state_min0.009679562046962614
sim_render-ego0_max0.004012223981401506
sim_render-ego0_mean0.004012223981401506
sim_render-ego0_median0.004012223981401506
sim_render-ego0_min0.004012223981401506
simulation-passed1
step_physics_max0.15095675974265424
step_physics_mean0.15095675974265424
step_physics_median0.15095675974265424
step_physics_min0.15095675974265424
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6607413541AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ί3090aido-LFP-sim-validationsim-3of4successnogpu-production-spot-1-040:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999991
in-drivable-lane_median0.0
driven_lanedir_consec_median1.7640229437141628
deviation-center-line_median0.203328002626892


other stats
agent_compute-ego0_max0.0170104654211747
agent_compute-ego0_mean0.0170104654211747
agent_compute-ego0_median0.0170104654211747
agent_compute-ego0_min0.0170104654211747
complete-iteration_max0.3014408738989579
complete-iteration_mean0.3014408738989579
complete-iteration_median0.3014408738989579
complete-iteration_min0.3014408738989579
deviation-center-line_max0.203328002626892
deviation-center-line_mean0.203328002626892
deviation-center-line_min0.203328002626892
deviation-heading_max0.6380894623613551
deviation-heading_mean0.6380894623613551
deviation-heading_median0.6380894623613551
deviation-heading_min0.6380894623613551
driven_any_max1.78804614674032
driven_any_mean1.78804614674032
driven_any_median1.78804614674032
driven_any_min1.78804614674032
driven_lanedir_consec_max1.7640229437141628
driven_lanedir_consec_mean1.7640229437141628
driven_lanedir_consec_min1.7640229437141628
driven_lanedir_max1.7640229437141628
driven_lanedir_mean1.7640229437141628
driven_lanedir_median1.7640229437141628
driven_lanedir_min1.7640229437141628
get_duckie_state_max0.023298449265329466
get_duckie_state_mean0.023298449265329466
get_duckie_state_median0.023298449265329466
get_duckie_state_min0.023298449265329466
get_robot_state_max0.004278140319021124
get_robot_state_mean0.004278140319021124
get_robot_state_median0.004278140319021124
get_robot_state_min0.004278140319021124
get_state_dump_max0.008842781970375463
get_state_dump_mean0.008842781970375463
get_state_dump_median0.008842781970375463
get_state_dump_min0.008842781970375463
get_ui_image_max0.03877398842259457
get_ui_image_mean0.03877398842259457
get_ui_image_median0.03877398842259457
get_ui_image_min0.03877398842259457
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 1.78804614674032, "get_ui_image": 0.03877398842259457, "step_physics": 0.1860937846334357, "survival_time": 4.699999999999991, "driven_lanedir": 1.7640229437141628, "get_state_dump": 0.008842781970375463, "get_robot_state": 0.004278140319021124, "sim_render-ego0": 0.004292724007054379, "get_duckie_state": 0.023298449265329466, "in-drivable-lane": 0.0, "deviation-heading": 0.6380894623613551, "agent_compute-ego0": 0.0170104654211747, "complete-iteration": 0.3014408738989579, "set_robot_commands": 0.0025956404836554275, "deviation-center-line": 0.203328002626892, "driven_lanedir_consec": 1.7640229437141628, "sim_compute_sim_state": 0.013826297458849456, "sim_compute_performance-ego0": 0.002306007084093596}}
set_robot_commands_max0.0025956404836554275
set_robot_commands_mean0.0025956404836554275
set_robot_commands_median0.0025956404836554275
set_robot_commands_min0.0025956404836554275
sim_compute_performance-ego0_max0.002306007084093596
sim_compute_performance-ego0_mean0.002306007084093596
sim_compute_performance-ego0_median0.002306007084093596
sim_compute_performance-ego0_min0.002306007084093596
sim_compute_sim_state_max0.013826297458849456
sim_compute_sim_state_mean0.013826297458849456
sim_compute_sim_state_median0.013826297458849456
sim_compute_sim_state_min0.013826297458849456
sim_render-ego0_max0.004292724007054379
sim_render-ego0_mean0.004292724007054379
sim_render-ego0_median0.004292724007054379
sim_render-ego0_min0.004292724007054379
simulation-passed1
step_physics_max0.1860937846334357
step_physics_mean0.1860937846334357
step_physics_median0.1860937846334357
step_physics_min0.1860937846334357
survival_time_max4.699999999999991
survival_time_mean4.699999999999991
survival_time_min4.699999999999991
No reset possible
6605013572MΓ‘rton TimΒ πŸ‡­πŸ‡Ί3626aido-LFV-sim-validationsim-2of4successnogpu-production-spot-1-040:05:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.650000000000016
in-drivable-lane_median0.0
driven_lanedir_consec_median4.661639228589754
deviation-center-line_median0.5570329612797645


other stats
agent_compute-ego0_max0.04652581927932312
agent_compute-ego0_mean0.04652581927932312
agent_compute-ego0_median0.04652581927932312
agent_compute-ego0_min0.04652581927932312
agent_compute-npc0_max0.0322083769557632
agent_compute-npc0_mean0.0322083769557632
agent_compute-npc0_median0.0322083769557632
agent_compute-npc0_min0.0322083769557632
agent_compute-npc1_max0.033014316425145226
agent_compute-npc1_mean0.033014316425145226
agent_compute-npc1_median0.033014316425145226
agent_compute-npc1_min0.033014316425145226
agent_compute-npc2_max0.035932990992180655
agent_compute-npc2_mean0.035932990992180655
agent_compute-npc2_median0.035932990992180655
agent_compute-npc2_min0.035932990992180655
complete-iteration_max0.6166192883643035
complete-iteration_mean0.6166192883643035
complete-iteration_median0.6166192883643035
complete-iteration_min0.6166192883643035
deviation-center-line_max0.5570329612797645
deviation-center-line_mean0.5570329612797645
deviation-center-line_min0.5570329612797645
deviation-heading_max1.5781055796160883
deviation-heading_mean1.5781055796160883
deviation-heading_median1.5781055796160883
deviation-heading_min1.5781055796160883
driven_any_max4.746614272990423
driven_any_mean4.746614272990423
driven_any_median4.746614272990423
driven_any_min4.746614272990423
driven_lanedir_consec_max4.661639228589754
driven_lanedir_consec_mean4.661639228589754
driven_lanedir_consec_min4.661639228589754
driven_lanedir_max4.661639228589754
driven_lanedir_mean4.661639228589754
driven_lanedir_median4.661639228589754
driven_lanedir_min4.661639228589754
get_duckie_state_max1.5341232870226708e-06
get_duckie_state_mean1.5341232870226708e-06
get_duckie_state_median1.5341232870226708e-06
get_duckie_state_min1.5341232870226708e-06
get_robot_state_max0.015353779926478303
get_robot_state_mean0.015353779926478303
get_robot_state_median0.015353779926478303
get_robot_state_min0.015353779926478303
get_state_dump_max0.010360889345686013
get_state_dump_mean0.010360889345686013
get_state_dump_median0.010360889345686013
get_state_dump_min0.010360889345686013
get_ui_image_max0.04772936295126086
get_ui_image_mean0.04772936295126086
get_ui_image_median0.04772936295126086
get_ui_image_min0.04772936295126086
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 4.746614272990423, "get_ui_image": 0.04772936295126086, "step_physics": 0.333233290743605, "survival_time": 10.650000000000016, "driven_lanedir": 4.661639228589754, "get_state_dump": 0.010360889345686013, "get_robot_state": 0.015353779926478303, "sim_render-ego0": 0.004041108015541719, "sim_render-npc0": 0.003966078579982864, "sim_render-npc1": 0.004039101511518532, "sim_render-npc2": 0.004234918924135582, "get_duckie_state": 1.5341232870226708e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.5781055796160883, "agent_compute-ego0": 0.04652581927932312, "agent_compute-npc0": 0.0322083769557632, "agent_compute-npc1": 0.033014316425145226, "agent_compute-npc2": 0.035932990992180655, "complete-iteration": 0.6166192883643035, "set_robot_commands": 0.002584119823491462, "deviation-center-line": 0.5570329612797645, "driven_lanedir_consec": 4.661639228589754, "sim_compute_sim_state": 0.027210684580223583, "sim_compute_performance-ego0": 0.00220979374145793, "sim_compute_performance-npc0": 0.002086150311978064, "sim_compute_performance-npc1": 0.002167766339310976, "sim_compute_performance-npc2": 0.00224298071638446}}
set_robot_commands_max0.002584119823491462
set_robot_commands_mean0.002584119823491462
set_robot_commands_median0.002584119823491462
set_robot_commands_min0.002584119823491462
sim_compute_performance-ego0_max0.00220979374145793
sim_compute_performance-ego0_mean0.00220979374145793
sim_compute_performance-ego0_median0.00220979374145793
sim_compute_performance-ego0_min0.00220979374145793
sim_compute_performance-npc0_max0.002086150311978064
sim_compute_performance-npc0_mean0.002086150311978064
sim_compute_performance-npc0_median0.002086150311978064
sim_compute_performance-npc0_min0.002086150311978064
sim_compute_performance-npc1_max0.002167766339310976
sim_compute_performance-npc1_mean0.002167766339310976
sim_compute_performance-npc1_median0.002167766339310976
sim_compute_performance-npc1_min0.002167766339310976
sim_compute_performance-npc2_max0.00224298071638446
sim_compute_performance-npc2_mean0.00224298071638446
sim_compute_performance-npc2_median0.00224298071638446
sim_compute_performance-npc2_min0.00224298071638446
sim_compute_sim_state_max0.027210684580223583
sim_compute_sim_state_mean0.027210684580223583
sim_compute_sim_state_median0.027210684580223583
sim_compute_sim_state_min0.027210684580223583
sim_render-ego0_max0.004041108015541719
sim_render-ego0_mean0.004041108015541719
sim_render-ego0_median0.004041108015541719
sim_render-ego0_min0.004041108015541719
sim_render-npc0_max0.003966078579982864
sim_render-npc0_mean0.003966078579982864
sim_render-npc0_median0.003966078579982864
sim_render-npc0_min0.003966078579982864
sim_render-npc1_max0.004039101511518532
sim_render-npc1_mean0.004039101511518532
sim_render-npc1_median0.004039101511518532
sim_render-npc1_min0.004039101511518532
sim_render-npc2_max0.004234918924135582
sim_render-npc2_mean0.004234918924135582
sim_render-npc2_median0.004234918924135582
sim_render-npc2_min0.004234918924135582
simulation-passed1
step_physics_max0.333233290743605
step_physics_mean0.333233290743605
step_physics_median0.333233290743605
step_physics_min0.333233290743605
survival_time_max10.650000000000016
survival_time_mean10.650000000000016
survival_time_min10.650000000000016
No reset possible
6604513585Andras Beres202-1aido-LFP-sim-testingsim-2of4successnogpu-production-spot-1-040:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7500000000000009
in-drivable-lane_median0.0
driven_lanedir_consec_median0.38761234606265793
deviation-center-line_median0.11194673860424872


other stats
agent_compute-ego0_max0.019097096390194364
agent_compute-ego0_mean0.019097096390194364
agent_compute-ego0_median0.019097096390194364
agent_compute-ego0_min0.019097096390194364
complete-iteration_max0.20244498385323417
complete-iteration_mean0.20244498385323417
complete-iteration_median0.20244498385323417
complete-iteration_min0.20244498385323417
deviation-center-line_max0.11194673860424872
deviation-center-line_mean0.11194673860424872
deviation-center-line_min0.11194673860424872
deviation-heading_max0.18593020382390824
deviation-heading_mean0.18593020382390824
deviation-heading_median0.18593020382390824
deviation-heading_min0.18593020382390824
driven_any_max0.39175923747263214
driven_any_mean0.39175923747263214
driven_any_median0.39175923747263214
driven_any_min0.39175923747263214
driven_lanedir_consec_max0.38761234606265793
driven_lanedir_consec_mean0.38761234606265793
driven_lanedir_consec_min0.38761234606265793
driven_lanedir_max0.38761234606265793
driven_lanedir_mean0.38761234606265793
driven_lanedir_median0.38761234606265793
driven_lanedir_min0.38761234606265793
get_duckie_state_max0.026599360836876765
get_duckie_state_mean0.026599360836876765
get_duckie_state_median0.026599360836876765
get_duckie_state_min0.026599360836876765
get_robot_state_max0.00400490230984158
get_robot_state_mean0.00400490230984158
get_robot_state_median0.00400490230984158
get_robot_state_min0.00400490230984158
get_state_dump_max0.009252402517530654
get_state_dump_mean0.009252402517530654
get_state_dump_median0.009252402517530654
get_state_dump_min0.009252402517530654
get_ui_image_max0.03545077641805013
get_ui_image_mean0.03545077641805013
get_ui_image_median0.03545077641805013
get_ui_image_min0.03545077641805013
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.39175923747263214, "get_ui_image": 0.03545077641805013, "step_physics": 0.09339235888587104, "survival_time": 1.7500000000000009, "driven_lanedir": 0.38761234606265793, "get_state_dump": 0.009252402517530654, "get_robot_state": 0.00400490230984158, "sim_render-ego0": 0.003911018371582031, "get_duckie_state": 0.026599360836876765, "in-drivable-lane": 0.0, "deviation-heading": 0.18593020382390824, "agent_compute-ego0": 0.019097096390194364, "complete-iteration": 0.20244498385323417, "set_robot_commands": 0.002651830514272054, "deviation-center-line": 0.11194673860424872, "driven_lanedir_consec": 0.38761234606265793, "sim_compute_sim_state": 0.005893839730156792, "sim_compute_performance-ego0": 0.002096460925208198}}
set_robot_commands_max0.002651830514272054
set_robot_commands_mean0.002651830514272054
set_robot_commands_median0.002651830514272054
set_robot_commands_min0.002651830514272054
sim_compute_performance-ego0_max0.002096460925208198
sim_compute_performance-ego0_mean0.002096460925208198
sim_compute_performance-ego0_median0.002096460925208198
sim_compute_performance-ego0_min0.002096460925208198
sim_compute_sim_state_max0.005893839730156792
sim_compute_sim_state_mean0.005893839730156792
sim_compute_sim_state_median0.005893839730156792
sim_compute_sim_state_min0.005893839730156792
sim_render-ego0_max0.003911018371582031
sim_render-ego0_mean0.003911018371582031
sim_render-ego0_median0.003911018371582031
sim_render-ego0_min0.003911018371582031
simulation-passed1
step_physics_max0.09339235888587104
step_physics_mean0.09339235888587104
step_physics_median0.09339235888587104
step_physics_min0.09339235888587104
survival_time_max1.7500000000000009
survival_time_mean1.7500000000000009
survival_time_min1.7500000000000009
No reset possible
6602313964YU CHENCBC Net v2 test - APR 3 BC TFdata + mar 28 anomalyaido-LF-sim-validationsim-2of4successnogpu-production-spot-1-040:10:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.394022334427074
survival_time_median59.99999999999873
deviation-center-line_median2.450827567432979
in-drivable-lane_median30.9499999999993


other stats
agent_compute-ego0_max0.08860421458648504
agent_compute-ego0_mean0.08860421458648504
agent_compute-ego0_median0.08860421458648504
agent_compute-ego0_min0.08860421458648504
complete-iteration_max0.2717293513803855
complete-iteration_mean0.2717293513803855
complete-iteration_median0.2717293513803855
complete-iteration_min0.2717293513803855
deviation-center-line_max2.450827567432979
deviation-center-line_mean2.450827567432979
deviation-center-line_min2.450827567432979
deviation-heading_max11.62698861557886
deviation-heading_mean11.62698861557886
deviation-heading_median11.62698861557886
deviation-heading_min11.62698861557886
driven_any_max20.79788085223899
driven_any_mean20.79788085223899
driven_any_median20.79788085223899
driven_any_min20.79788085223899
driven_lanedir_consec_max10.394022334427074
driven_lanedir_consec_mean10.394022334427074
driven_lanedir_consec_min10.394022334427074
driven_lanedir_max10.394022334427074
driven_lanedir_mean10.394022334427074
driven_lanedir_median10.394022334427074
driven_lanedir_min10.394022334427074
get_duckie_state_max1.627638576231233e-06
get_duckie_state_mean1.627638576231233e-06
get_duckie_state_median1.627638576231233e-06
get_duckie_state_min1.627638576231233e-06
get_robot_state_max0.003937690680866733
get_robot_state_mean0.003937690680866733
get_robot_state_median0.003937690680866733
get_robot_state_min0.003937690680866733
get_state_dump_max0.004784775614043656
get_state_dump_mean0.004784775614043656
get_state_dump_median0.004784775614043656
get_state_dump_min0.004784775614043656
get_ui_image_max0.028403812602199582
get_ui_image_mean0.028403812602199582
get_ui_image_median0.028403812602199582
get_ui_image_min0.028403812602199582
in-drivable-lane_max30.9499999999993
in-drivable-lane_mean30.9499999999993
in-drivable-lane_min30.9499999999993
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 20.79788085223899, "get_ui_image": 0.028403812602199582, "step_physics": 0.1306902983107237, "survival_time": 59.99999999999873, "driven_lanedir": 10.394022334427074, "get_state_dump": 0.004784775614043656, "get_robot_state": 0.003937690680866733, "sim_render-ego0": 0.004002212187729707, "get_duckie_state": 1.627638576231233e-06, "in-drivable-lane": 30.9499999999993, "deviation-heading": 11.62698861557886, "agent_compute-ego0": 0.08860421458648504, "complete-iteration": 0.2717293513803855, "set_robot_commands": 0.002489816735527299, "deviation-center-line": 2.450827567432979, "driven_lanedir_consec": 10.394022334427074, "sim_compute_sim_state": 0.006621273232935668, "sim_compute_performance-ego0": 0.0021035502494920004}}
set_robot_commands_max0.002489816735527299
set_robot_commands_mean0.002489816735527299
set_robot_commands_median0.002489816735527299
set_robot_commands_min0.002489816735527299
sim_compute_performance-ego0_max0.0021035502494920004
sim_compute_performance-ego0_mean0.0021035502494920004
sim_compute_performance-ego0_median0.0021035502494920004
sim_compute_performance-ego0_min0.0021035502494920004
sim_compute_sim_state_max0.006621273232935668
sim_compute_sim_state_mean0.006621273232935668
sim_compute_sim_state_median0.006621273232935668
sim_compute_sim_state_min0.006621273232935668
sim_render-ego0_max0.004002212187729707
sim_render-ego0_mean0.004002212187729707
sim_render-ego0_median0.004002212187729707
sim_render-ego0_min0.004002212187729707
simulation-passed1
step_physics_max0.1306902983107237
step_physics_mean0.1306902983107237
step_physics_median0.1306902983107237
step_physics_min0.1306902983107237
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6601313993Frank (Chude) QianΒ πŸ‡¨πŸ‡¦CBC Net - MixTraining - Expert LF Human LFP - Best Lossaido-LF-sim-validationsim-0of4successnogpu-production-spot-1-040:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0873051403258875
survival_time_median7.94999999999998
deviation-center-line_median0.4145867246699389
in-drivable-lane_median3.2499999999999885


other stats
agent_compute-ego0_max0.057697844505310056
agent_compute-ego0_mean0.057697844505310056
agent_compute-ego0_median0.057697844505310056
agent_compute-ego0_min0.057697844505310056
complete-iteration_max0.23507903516292572
complete-iteration_mean0.23507903516292572
complete-iteration_median0.23507903516292572
complete-iteration_min0.23507903516292572
deviation-center-line_max0.4145867246699389
deviation-center-line_mean0.4145867246699389
deviation-center-line_min0.4145867246699389
deviation-heading_max1.1107262290410511
deviation-heading_mean1.1107262290410511
deviation-heading_median1.1107262290410511
deviation-heading_min1.1107262290410511
driven_any_max3.2322050632189123
driven_any_mean3.2322050632189123
driven_any_median3.2322050632189123
driven_any_min3.2322050632189123
driven_lanedir_consec_max2.0873051403258875
driven_lanedir_consec_mean2.0873051403258875
driven_lanedir_consec_min2.0873051403258875
driven_lanedir_max2.0873051403258875
driven_lanedir_mean2.0873051403258875
driven_lanedir_median2.0873051403258875
driven_lanedir_min2.0873051403258875
get_duckie_state_max1.4573335647583007e-06
get_duckie_state_mean1.4573335647583007e-06
get_duckie_state_median1.4573335647583007e-06
get_duckie_state_min1.4573335647583007e-06
get_robot_state_max0.004055635631084442
get_robot_state_mean0.004055635631084442
get_robot_state_median0.004055635631084442
get_robot_state_min0.004055635631084442
get_state_dump_max0.005145137012004852
get_state_dump_mean0.005145137012004852
get_state_dump_median0.005145137012004852
get_state_dump_min0.005145137012004852
get_ui_image_max0.03075980842113495
get_ui_image_mean0.03075980842113495
get_ui_image_median0.03075980842113495
get_ui_image_min0.03075980842113495
in-drivable-lane_max3.2499999999999885
in-drivable-lane_mean3.2499999999999885
in-drivable-lane_min3.2499999999999885
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.2322050632189123, "get_ui_image": 0.03075980842113495, "step_physics": 0.11812923997640608, "survival_time": 7.94999999999998, "driven_lanedir": 2.0873051403258875, "get_state_dump": 0.005145137012004852, "get_robot_state": 0.004055635631084442, "sim_render-ego0": 0.004105047881603241, "get_duckie_state": 1.4573335647583007e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 1.1107262290410511, "agent_compute-ego0": 0.057697844505310056, "complete-iteration": 0.23507903516292572, "set_robot_commands": 0.002662353217601776, "deviation-center-line": 0.4145867246699389, "driven_lanedir_consec": 2.0873051403258875, "sim_compute_sim_state": 0.01024792492389679, "sim_compute_performance-ego0": 0.0021768271923065185}}
set_robot_commands_max0.002662353217601776
set_robot_commands_mean0.002662353217601776
set_robot_commands_median0.002662353217601776
set_robot_commands_min0.002662353217601776
sim_compute_performance-ego0_max0.0021768271923065185
sim_compute_performance-ego0_mean0.0021768271923065185
sim_compute_performance-ego0_median0.0021768271923065185
sim_compute_performance-ego0_min0.0021768271923065185
sim_compute_sim_state_max0.01024792492389679
sim_compute_sim_state_mean0.01024792492389679
sim_compute_sim_state_median0.01024792492389679
sim_compute_sim_state_min0.01024792492389679
sim_render-ego0_max0.004105047881603241
sim_render-ego0_mean0.004105047881603241
sim_render-ego0_median0.004105047881603241
sim_render-ego0_min0.004105047881603241
simulation-passed1
step_physics_max0.11812923997640608
step_physics_mean0.11812923997640608
step_physics_median0.11812923997640608
step_physics_min0.11812923997640608
survival_time_max7.94999999999998
survival_time_mean7.94999999999998
survival_time_min7.94999999999998
No reset possible
6599613993Frank (Chude) QianΒ πŸ‡¨πŸ‡¦CBC Net - MixTraining - Expert LF Human LFP - Best Lossaido-LF-sim-validationsim-0of4successnogpu-production-spot-1-040:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1229329761960023
survival_time_median9.349999999999998
deviation-center-line_median0.6360969642861032
in-drivable-lane_median2.1500000000000155


other stats
agent_compute-ego0_max0.058215400005908725
agent_compute-ego0_mean0.058215400005908725
agent_compute-ego0_median0.058215400005908725
agent_compute-ego0_min0.058215400005908725
complete-iteration_max0.26646998080801454
complete-iteration_mean0.26646998080801454
complete-iteration_median0.26646998080801454
complete-iteration_min0.26646998080801454
deviation-center-line_max0.6360969642861032
deviation-center-line_mean0.6360969642861032
deviation-center-line_min0.6360969642861032
deviation-heading_max1.8450754066754844
deviation-heading_mean1.8450754066754844
deviation-heading_median1.8450754066754844
deviation-heading_min1.8450754066754844
driven_any_max3.890775897902667
driven_any_mean3.890775897902667
driven_any_median3.890775897902667
driven_any_min3.890775897902667
driven_lanedir_consec_max3.1229329761960023
driven_lanedir_consec_mean3.1229329761960023
driven_lanedir_consec_min3.1229329761960023
driven_lanedir_max3.1229329761960023
driven_lanedir_mean3.1229329761960023
driven_lanedir_median3.1229329761960023
driven_lanedir_min3.1229329761960023
get_duckie_state_max1.4508024175116356e-06
get_duckie_state_mean1.4508024175116356e-06
get_duckie_state_median1.4508024175116356e-06
get_duckie_state_min1.4508024175116356e-06
get_robot_state_max0.0042494712991917385
get_robot_state_mean0.0042494712991917385
get_robot_state_median0.0042494712991917385
get_robot_state_min0.0042494712991917385
get_state_dump_max0.005320666952336088
get_state_dump_mean0.005320666952336088
get_state_dump_median0.005320666952336088
get_state_dump_min0.005320666952336088
get_ui_image_max0.03266783090347939
get_ui_image_mean0.03266783090347939
get_ui_image_median0.03266783090347939
get_ui_image_min0.03266783090347939
in-drivable-lane_max2.1500000000000155
in-drivable-lane_mean2.1500000000000155
in-drivable-lane_min2.1500000000000155
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.890775897902667, "get_ui_image": 0.03266783090347939, "step_physics": 0.14542929035552005, "survival_time": 9.349999999999998, "driven_lanedir": 3.1229329761960023, "get_state_dump": 0.005320666952336088, "get_robot_state": 0.0042494712991917385, "sim_render-ego0": 0.00429468332452977, "get_duckie_state": 1.4508024175116356e-06, "in-drivable-lane": 2.1500000000000155, "deviation-heading": 1.8450754066754844, "agent_compute-ego0": 0.058215400005908725, "complete-iteration": 0.26646998080801454, "set_robot_commands": 0.0027618205293695975, "deviation-center-line": 0.6360969642861032, "driven_lanedir_consec": 3.1229329761960023, "sim_compute_sim_state": 0.01109382446776045, "sim_compute_performance-ego0": 0.0023266406769448136}}
set_robot_commands_max0.0027618205293695975
set_robot_commands_mean0.0027618205293695975
set_robot_commands_median0.0027618205293695975
set_robot_commands_min0.0027618205293695975
sim_compute_performance-ego0_max0.0023266406769448136
sim_compute_performance-ego0_mean0.0023266406769448136
sim_compute_performance-ego0_median0.0023266406769448136
sim_compute_performance-ego0_min0.0023266406769448136
sim_compute_sim_state_max0.01109382446776045
sim_compute_sim_state_mean0.01109382446776045
sim_compute_sim_state_median0.01109382446776045
sim_compute_sim_state_min0.01109382446776045
sim_render-ego0_max0.00429468332452977
sim_render-ego0_mean0.00429468332452977
sim_render-ego0_median0.00429468332452977
sim_render-ego0_min0.00429468332452977
simulation-passed1
step_physics_max0.14542929035552005
step_physics_mean0.14542929035552005
step_physics_median0.14542929035552005
step_physics_min0.14542929035552005
survival_time_max9.349999999999998
survival_time_mean9.349999999999998
survival_time_min9.349999999999998
No reset possible
6598613997Frank (Chude) QianΒ πŸ‡¨πŸ‡¦baseline-behavior-cloning New Datasetaido-LF-sim-validationsim-2of4successnogpu-production-spot-1-040:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.63481466050301
survival_time_median4.199999999999993
deviation-center-line_median0.08304260116924536
in-drivable-lane_median2.5999999999999925


other stats
agent_compute-ego0_max0.05789081629584817
agent_compute-ego0_mean0.05789081629584817
agent_compute-ego0_median0.05789081629584817
agent_compute-ego0_min0.05789081629584817
complete-iteration_max0.18319612390854775
complete-iteration_mean0.18319612390854775
complete-iteration_median0.18319612390854775
complete-iteration_min0.18319612390854775
deviation-center-line_max0.08304260116924536
deviation-center-line_mean0.08304260116924536
deviation-center-line_min0.08304260116924536
deviation-heading_max0.2579736497624691
deviation-heading_mean0.2579736497624691
deviation-heading_median0.2579736497624691
deviation-heading_min0.2579736497624691
driven_any_max1.6432800654387676
driven_any_mean1.6432800654387676
driven_any_median1.6432800654387676
driven_any_min1.6432800654387676
driven_lanedir_consec_max0.63481466050301
driven_lanedir_consec_mean0.63481466050301
driven_lanedir_consec_min0.63481466050301
driven_lanedir_max0.63481466050301
driven_lanedir_mean0.63481466050301
driven_lanedir_median0.63481466050301
driven_lanedir_min0.63481466050301
get_duckie_state_max1.4249016256893385e-06
get_duckie_state_mean1.4249016256893385e-06
get_duckie_state_median1.4249016256893385e-06
get_duckie_state_min1.4249016256893385e-06
get_robot_state_max0.004188128078685087
get_robot_state_mean0.004188128078685087
get_robot_state_median0.004188128078685087
get_robot_state_min0.004188128078685087
get_state_dump_max0.005488154467414407
get_state_dump_mean0.005488154467414407
get_state_dump_median0.005488154467414407
get_state_dump_min0.005488154467414407
get_ui_image_max0.029844281252692728
get_ui_image_mean0.029844281252692728
get_ui_image_median0.029844281252692728
get_ui_image_min0.029844281252692728
in-drivable-lane_max2.5999999999999925
in-drivable-lane_mean2.5999999999999925
in-drivable-lane_min2.5999999999999925
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 1.6432800654387676, "get_ui_image": 0.029844281252692728, "step_physics": 0.07105967858258416, "survival_time": 4.199999999999993, "driven_lanedir": 0.63481466050301, "get_state_dump": 0.005488154467414407, "get_robot_state": 0.004188128078685087, "sim_render-ego0": 0.004272937774658203, "get_duckie_state": 1.4249016256893385e-06, "in-drivable-lane": 2.5999999999999925, "deviation-heading": 0.2579736497624691, "agent_compute-ego0": 0.05789081629584817, "complete-iteration": 0.18319612390854775, "set_robot_commands": 0.0026083918178782745, "deviation-center-line": 0.08304260116924536, "driven_lanedir_consec": 0.63481466050301, "sim_compute_sim_state": 0.005483495487886317, "sim_compute_performance-ego0": 0.0022621351129868453}}
set_robot_commands_max0.0026083918178782745
set_robot_commands_mean0.0026083918178782745
set_robot_commands_median0.0026083918178782745
set_robot_commands_min0.0026083918178782745
sim_compute_performance-ego0_max0.0022621351129868453
sim_compute_performance-ego0_mean0.0022621351129868453
sim_compute_performance-ego0_median0.0022621351129868453
sim_compute_performance-ego0_min0.0022621351129868453
sim_compute_sim_state_max0.005483495487886317
sim_compute_sim_state_mean0.005483495487886317
sim_compute_sim_state_median0.005483495487886317
sim_compute_sim_state_min0.005483495487886317
sim_render-ego0_max0.004272937774658203
sim_render-ego0_mean0.004272937774658203
sim_render-ego0_median0.004272937774658203
sim_render-ego0_min0.004272937774658203
simulation-passed1
step_physics_max0.07105967858258416
step_physics_mean0.07105967858258416
step_physics_median0.07105967858258416
step_physics_min0.07105967858258416
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
6597713997Frank (Chude) QianΒ πŸ‡¨πŸ‡¦baseline-behavior-cloning New Datasetaido-LF-sim-validationsim-2of4successnogpu-production-spot-1-040:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.63481466050301
survival_time_median4.199999999999993
deviation-center-line_median0.08304260116924536
in-drivable-lane_median2.5999999999999925


other stats
agent_compute-ego0_max0.05524621851303998
agent_compute-ego0_mean0.05524621851303998
agent_compute-ego0_median0.05524621851303998
agent_compute-ego0_min0.05524621851303998
complete-iteration_max0.17751437074997845
complete-iteration_mean0.17751437074997845
complete-iteration_median0.17751437074997845
complete-iteration_min0.17751437074997845
deviation-center-line_max0.08304260116924536
deviation-center-line_mean0.08304260116924536
deviation-center-line_min0.08304260116924536
deviation-heading_max0.2579736497624691
deviation-heading_mean0.2579736497624691
deviation-heading_median0.2579736497624691
deviation-heading_min0.2579736497624691
driven_any_max1.6432800654387676
driven_any_mean1.6432800654387676
driven_any_median1.6432800654387676
driven_any_min1.6432800654387676
driven_lanedir_consec_max0.63481466050301
driven_lanedir_consec_mean0.63481466050301
driven_lanedir_consec_min0.63481466050301
driven_lanedir_max0.63481466050301
driven_lanedir_mean0.63481466050301
driven_lanedir_median0.63481466050301
driven_lanedir_min0.63481466050301
get_duckie_state_max1.2650209314682904e-06
get_duckie_state_mean1.2650209314682904e-06
get_duckie_state_median1.2650209314682904e-06
get_duckie_state_min1.2650209314682904e-06
get_robot_state_max0.004169769848094267
get_robot_state_mean0.004169769848094267
get_robot_state_median0.004169769848094267
get_robot_state_min0.004169769848094267
get_state_dump_max0.005141249824972714
get_state_dump_mean0.005141249824972714
get_state_dump_median0.005141249824972714
get_state_dump_min0.005141249824972714
get_ui_image_max0.02931475358850816
get_ui_image_mean0.02931475358850816
get_ui_image_median0.02931475358850816
get_ui_image_min0.02931475358850816
in-drivable-lane_max2.5999999999999925
in-drivable-lane_mean2.5999999999999925
in-drivable-lane_min2.5999999999999925
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 1.6432800654387676, "get_ui_image": 0.02931475358850816, "step_physics": 0.06878039977129768, "survival_time": 4.199999999999993, "driven_lanedir": 0.63481466050301, "get_state_dump": 0.005141249824972714, "get_robot_state": 0.004169769848094267, "sim_render-ego0": 0.004328194786520565, "get_duckie_state": 1.2650209314682904e-06, "in-drivable-lane": 2.5999999999999925, "deviation-heading": 0.2579736497624691, "agent_compute-ego0": 0.05524621851303998, "complete-iteration": 0.17751437074997845, "set_robot_commands": 0.002649674696080825, "deviation-center-line": 0.08304260116924536, "driven_lanedir_consec": 0.63481466050301, "sim_compute_sim_state": 0.005515112596399644, "sim_compute_performance-ego0": 0.002271239897784065}}
set_robot_commands_max0.002649674696080825
set_robot_commands_mean0.002649674696080825
set_robot_commands_median0.002649674696080825
set_robot_commands_min0.002649674696080825
sim_compute_performance-ego0_max0.002271239897784065
sim_compute_performance-ego0_mean0.002271239897784065
sim_compute_performance-ego0_median0.002271239897784065
sim_compute_performance-ego0_min0.002271239897784065
sim_compute_sim_state_max0.005515112596399644
sim_compute_sim_state_mean0.005515112596399644
sim_compute_sim_state_median0.005515112596399644
sim_compute_sim_state_min0.005515112596399644
sim_render-ego0_max0.004328194786520565
sim_render-ego0_mean0.004328194786520565
sim_render-ego0_median0.004328194786520565
sim_render-ego0_min0.004328194786520565
simulation-passed1
step_physics_max0.06878039977129768
step_physics_mean0.06878039977129768
step_physics_median0.06878039977129768
step_physics_min0.06878039977129768
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
6590813505AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ίreal-v1.0-3091-310aido-LF-sim-validationsim-3of4successnogpu-production-spot-1-040:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.462350299394725
survival_time_median59.99999999999873
deviation-center-line_median2.430244505290306
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01520986163943733
agent_compute-ego0_mean0.01520986163943733
agent_compute-ego0_median0.01520986163943733
agent_compute-ego0_min0.01520986163943733
complete-iteration_max0.30173815557303574
complete-iteration_mean0.30173815557303574
complete-iteration_median0.30173815557303574
complete-iteration_min0.30173815557303574
deviation-center-line_max2.430244505290306
deviation-center-line_mean2.430244505290306
deviation-center-line_min2.430244505290306
deviation-heading_max7.82755915012718
deviation-heading_mean7.82755915012718
deviation-heading_median7.82755915012718
deviation-heading_min7.82755915012718
driven_any_max28.81745199296233
driven_any_mean28.81745199296233
driven_any_median28.81745199296233
driven_any_min28.81745199296233
driven_lanedir_consec_max28.462350299394725
driven_lanedir_consec_mean28.462350299394725
driven_lanedir_consec_min28.462350299394725
driven_lanedir_max28.462350299394725
driven_lanedir_mean28.462350299394725
driven_lanedir_median28.462350299394725
driven_lanedir_min28.462350299394725
get_duckie_state_max1.4031161674353405e-06
get_duckie_state_mean1.4031161674353405e-06
get_duckie_state_median1.4031161674353405e-06
get_duckie_state_min1.4031161674353405e-06
get_robot_state_max0.004291338884860252
get_robot_state_mean0.004291338884860252
get_robot_state_median0.004291338884860252
get_robot_state_min0.004291338884860252
get_state_dump_max0.005256690947241231
get_state_dump_mean0.005256690947241231
get_state_dump_median0.005256690947241231
get_state_dump_min0.005256690947241231
get_ui_image_max0.041003935144505434
get_ui_image_mean0.041003935144505434
get_ui_image_median0.041003935144505434
get_ui_image_min0.041003935144505434
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 28.81745199296233, "get_ui_image": 0.041003935144505434, "step_physics": 0.21103723460093424, "survival_time": 59.99999999999873, "driven_lanedir": 28.462350299394725, "get_state_dump": 0.005256690947241231, "get_robot_state": 0.004291338884860252, "sim_render-ego0": 0.004361230467479493, "get_duckie_state": 1.4031161674353405e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.82755915012718, "agent_compute-ego0": 0.01520986163943733, "complete-iteration": 0.30173815557303574, "set_robot_commands": 0.00264332812592747, "deviation-center-line": 2.430244505290306, "driven_lanedir_consec": 28.462350299394725, "sim_compute_sim_state": 0.015439204034162103, "sim_compute_performance-ego0": 0.0023973734551524244}}
set_robot_commands_max0.00264332812592747
set_robot_commands_mean0.00264332812592747
set_robot_commands_median0.00264332812592747
set_robot_commands_min0.00264332812592747
sim_compute_performance-ego0_max0.0023973734551524244
sim_compute_performance-ego0_mean0.0023973734551524244
sim_compute_performance-ego0_median0.0023973734551524244
sim_compute_performance-ego0_min0.0023973734551524244
sim_compute_sim_state_max0.015439204034162103
sim_compute_sim_state_mean0.015439204034162103
sim_compute_sim_state_median0.015439204034162103
sim_compute_sim_state_min0.015439204034162103
sim_render-ego0_max0.004361230467479493
sim_render-ego0_mean0.004361230467479493
sim_render-ego0_median0.004361230467479493
sim_render-ego0_min0.004361230467479493
simulation-passed1
step_physics_max0.21103723460093424
step_physics_mean0.21103723460093424
step_physics_median0.21103723460093424
step_physics_min0.21103723460093424
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6589013586Andras Beres202-1aido-LFP-sim-validationsim-0of4successnogpu-production-spot-1-040:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.25
in-drivable-lane_median0.0
driven_lanedir_consec_median0.5200018956535978
deviation-center-line_median0.17619617324846062


other stats
agent_compute-ego0_max0.019278256789497707
agent_compute-ego0_mean0.019278256789497707
agent_compute-ego0_median0.019278256789497707
agent_compute-ego0_min0.019278256789497707
complete-iteration_max0.2988210087237151
complete-iteration_mean0.2988210087237151
complete-iteration_median0.2988210087237151
complete-iteration_min0.2988210087237151
deviation-center-line_max0.17619617324846062
deviation-center-line_mean0.17619617324846062
deviation-center-line_min0.17619617324846062
deviation-heading_max0.33754457039018876
deviation-heading_mean0.33754457039018876
deviation-heading_median0.33754457039018876
deviation-heading_min0.33754457039018876
driven_any_max0.5285332345080778
driven_any_mean0.5285332345080778
driven_any_median0.5285332345080778
driven_any_min0.5285332345080778
driven_lanedir_consec_max0.5200018956535978
driven_lanedir_consec_mean0.5200018956535978
driven_lanedir_consec_min0.5200018956535978
driven_lanedir_max0.5200018956535978
driven_lanedir_mean0.5200018956535978
driven_lanedir_median0.5200018956535978
driven_lanedir_min0.5200018956535978
get_duckie_state_max0.02360160972761071
get_duckie_state_mean0.02360160972761071
get_duckie_state_median0.02360160972761071
get_duckie_state_min0.02360160972761071
get_robot_state_max0.004420560339222784
get_robot_state_mean0.004420560339222784
get_robot_state_median0.004420560339222784
get_robot_state_min0.004420560339222784
get_state_dump_max0.008839088937510614
get_state_dump_mean0.008839088937510614
get_state_dump_median0.008839088937510614
get_state_dump_min0.008839088937510614
get_ui_image_max0.04436541121938954
get_ui_image_mean0.04436541121938954
get_ui_image_median0.04436541121938954
get_ui_image_min0.04436541121938954
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5285332345080778, "get_ui_image": 0.04436541121938954, "step_physics": 0.17934441566467285, "survival_time": 2.25, "driven_lanedir": 0.5200018956535978, "get_state_dump": 0.008839088937510614, "get_robot_state": 0.004420560339222784, "sim_render-ego0": 0.004137630048005477, "get_duckie_state": 0.02360160972761071, "in-drivable-lane": 0.0, "deviation-heading": 0.33754457039018876, "agent_compute-ego0": 0.019278256789497707, "complete-iteration": 0.2988210087237151, "set_robot_commands": 0.002621220505755881, "deviation-center-line": 0.17619617324846062, "driven_lanedir_consec": 0.5200018956535978, "sim_compute_sim_state": 0.009894733843596085, "sim_compute_performance-ego0": 0.002211296040078868}}
set_robot_commands_max0.002621220505755881
set_robot_commands_mean0.002621220505755881
set_robot_commands_median0.002621220505755881
set_robot_commands_min0.002621220505755881
sim_compute_performance-ego0_max0.002211296040078868
sim_compute_performance-ego0_mean0.002211296040078868
sim_compute_performance-ego0_median0.002211296040078868
sim_compute_performance-ego0_min0.002211296040078868
sim_compute_sim_state_max0.009894733843596085
sim_compute_sim_state_mean0.009894733843596085
sim_compute_sim_state_median0.009894733843596085
sim_compute_sim_state_min0.009894733843596085
sim_render-ego0_max0.004137630048005477
sim_render-ego0_mean0.004137630048005477
sim_render-ego0_median0.004137630048005477
sim_render-ego0_min0.004137630048005477
simulation-passed1
step_physics_max0.17934441566467285
step_physics_mean0.17934441566467285
step_physics_median0.17934441566467285
step_physics_min0.17934441566467285
survival_time_max2.25
survival_time_mean2.25
survival_time_min2.25
No reset possible