Duckietown Challenges Home Challenges Submissions

Evaluator 2103

ID2103
evaluatorreg02-8817ca966a31-1
ownerI don't have one 😀
machinearchimede
processreg02-8817ca966a31-1
versiond-c:6.1.15;d-c-r:6.0.48
first heard
last heard
statusinactive
# evaluating
# success2 36058
# timeout1 36068
# failed
# error2 36059
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
360689839Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simtimeoutnoreg02-8817ca966a31-11:05:09
I can see how the jo [...]
I can see how the job 36068 is timeout because passed 3909 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
360639823Bea Baselines 🐤template-pytorchaido5-LFVI-sim-testingLFVIt-simerrornoreg02-8817ca966a31-11:00:52
Waited 3604 seconds [...]
Waited 3604 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
360609822Bea Baselines 🐤template-pytorchaido5-LFVI-sim-validationLFVIv-simsuccessnoreg02-8817ca966a31-10:33:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5632801174474897
survival_time_median14.950000000000076
deviation-center-line_median0.4332647594127891
in-drivable-lane_median8.77500000000006


other stats
agent_compute-ego_max2.71747505903244
agent_compute-ego_mean2.5099041159947713
agent_compute-ego_median2.5099041159947713
agent_compute-ego_min2.3023331729571024
complete-iteration_max3.2417170214653015
complete-iteration_mean3.0276768136024472
complete-iteration_median3.0276768136024472
complete-iteration_min2.8136366057395934
deviation-center-line_max0.5052315636954462
deviation-center-line_mean0.4332647594127891
deviation-center-line_min0.361297955130132
deviation-heading_max5.614302087976403
deviation-heading_mean4.916600317065257
deviation-heading_median4.916600317065257
deviation-heading_min4.21889854615411
driven_any_max2.1877841473258295
driven_any_mean2.135295090681346
driven_any_median2.135295090681346
driven_any_min2.0828060340368624
driven_lanedir_consec_max0.7586080985989163
driven_lanedir_consec_mean0.5632801174474897
driven_lanedir_consec_min0.3679521362960632
driven_lanedir_max0.7586080985989163
driven_lanedir_mean0.5632801174474897
driven_lanedir_median0.5632801174474897
driven_lanedir_min0.3679521362960632
get_state_dump_max0.03206929842631022
get_state_dump_mean0.03201950748761495
get_state_dump_median0.03201950748761495
get_state_dump_min0.031969716548919676
get_ui_image_max0.11920722405115763
get_ui_image_mean0.11908870021502176
get_ui_image_median0.11908870021502176
get_ui_image_min0.1189701763788859
in-drivable-lane_max10.100000000000076
in-drivable-lane_mean8.77500000000006
in-drivable-lane_min7.450000000000045
per-episodes
details{"udem1-0-0-ego": {"driven_any": 2.0828060340368624, "get_ui_image": 0.1189701763788859, "step_physics": 0.2758124184608459, "survival_time": 14.950000000000076, "driven_lanedir": 0.3679521362960632, "get_state_dump": 0.03206929842631022, "sim_render-ego": 0.00820546547571818, "in-drivable-lane": 10.100000000000076, "agent_compute-ego": 2.71747505903244, "deviation-heading": 4.21889854615411, "complete-iteration": 3.2417170214653015, "set_robot_commands": 0.006210930347442627, "deviation-center-line": 0.361297955130132, "driven_lanedir_consec": 0.3679521362960632, "sim_compute_sim_state": 0.021136991182963052, "sim_compute_performance-ego": 0.0059513147672017415, "sim_compute_robot_state-ego": 0.00946995973587036, "sim_compute_robot_state-npc0": 0.009324575265248616, "sim_compute_robot_state-npc1": 0.009795639514923096, "sim_compute_robot_state-npc2": 0.009029738903045656, "sim_compute_robot_state-npc3": 0.008865667978922525, "sim_compute_robot_state-parked0": 0.009185031255086264}, "udem1-0-1-ego": {"driven_any": 2.1877841473258295, "get_ui_image": 0.11920722405115763, "step_physics": 0.263849622408549, "survival_time": 14.950000000000076, "driven_lanedir": 0.7586080985989163, "get_state_dump": 0.031969716548919676, "sim_render-ego": 0.007743732134501139, "in-drivable-lane": 7.450000000000045, "agent_compute-ego": 2.3023331729571024, "deviation-heading": 5.614302087976403, "complete-iteration": 2.8136366057395934, "set_robot_commands": 0.0061462124188741045, "deviation-center-line": 0.5052315636954462, "driven_lanedir_consec": 0.7586080985989163, "sim_compute_sim_state": 0.019791566530863444, "sim_compute_performance-ego": 0.0055155364672342935, "sim_compute_robot_state-ego": 0.009224119981129965, "sim_compute_robot_state-npc0": 0.009498830636342366, "sim_compute_robot_state-npc1": 0.011825383504231773, "sim_compute_robot_state-npc2": 0.008896548748016358, "sim_compute_robot_state-npc3": 0.008737643559773764, "sim_compute_robot_state-parked0": 0.008695220152537028}}
set_robot_commands_max0.006210930347442627
set_robot_commands_mean0.006178571383158365
set_robot_commands_median0.006178571383158365
set_robot_commands_min0.0061462124188741045
sim_compute_performance-ego_max0.0059513147672017415
sim_compute_performance-ego_mean0.0057334256172180175
sim_compute_performance-ego_median0.0057334256172180175
sim_compute_performance-ego_min0.0055155364672342935
sim_compute_robot_state-ego_max0.00946995973587036
sim_compute_robot_state-ego_mean0.009347039858500165
sim_compute_robot_state-ego_median0.009347039858500165
sim_compute_robot_state-ego_min0.009224119981129965
sim_compute_robot_state-npc0_max0.009498830636342366
sim_compute_robot_state-npc0_mean0.009411702950795492
sim_compute_robot_state-npc0_median0.009411702950795492
sim_compute_robot_state-npc0_min0.009324575265248616
sim_compute_robot_state-npc1_max0.011825383504231773
sim_compute_robot_state-npc1_mean0.010810511509577434
sim_compute_robot_state-npc1_median0.010810511509577434
sim_compute_robot_state-npc1_min0.009795639514923096
sim_compute_robot_state-npc2_max0.009029738903045656
sim_compute_robot_state-npc2_mean0.008963143825531006
sim_compute_robot_state-npc2_median0.008963143825531006
sim_compute_robot_state-npc2_min0.008896548748016358
sim_compute_robot_state-npc3_max0.008865667978922525
sim_compute_robot_state-npc3_mean0.008801655769348144
sim_compute_robot_state-npc3_median0.008801655769348144
sim_compute_robot_state-npc3_min0.008737643559773764
sim_compute_robot_state-parked0_max0.009185031255086264
sim_compute_robot_state-parked0_mean0.008940125703811645
sim_compute_robot_state-parked0_median0.008940125703811645
sim_compute_robot_state-parked0_min0.008695220152537028
sim_compute_sim_state_max0.021136991182963052
sim_compute_sim_state_mean0.020464278856913248
sim_compute_sim_state_median0.020464278856913248
sim_compute_sim_state_min0.019791566530863444
sim_render-ego_max0.00820546547571818
sim_render-ego_mean0.007974598805109659
sim_render-ego_median0.007974598805109659
sim_render-ego_min0.007743732134501139
simulation-passed1
step_physics_max0.2758124184608459
step_physics_mean0.2698310204346974
step_physics_median0.2698310204346974
step_physics_min0.263849622408549
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
360599797Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoreg02-8817ca966a31-10:01:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
│         k: observations
│        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
│             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                                field jpg_data : bytes
│                                       __doc__
│                                                         An image in JPG format.
│ 
│                                                         jpg_data
│             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│                                field resolution_rad : float
│                                field  axis_left_rad : float
│                                field axis_right_rad : float
│             field your_name : str
│             field     state : dataclass aido_schemas.schemas.DTSimState
│                                field t_effective : float
│                                field  duckiebots : Dict[str,DTSimRobotInfo]
│             field  map_data : str
│        v2: dataclass aido_schemas.schemas.DB20Observations
│             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                               field jpg_data : bytes
│                                      __doc__
│                                                        An image in JPG format.
│ 
│                                                        jpg_data
│             field odometry : dataclass aido_schemas.schemas.DB20Odometry
│                               field resolution_rad : float
│                               field  axis_left_rad : float
│                               field axis_right_rad : float
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "your_name"
│            │ |  of type <class 'str'>
│            │ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: Dict[str,type][4]
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│            │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                     field jpg_data : bytes
│            │                            __doc__
│            │                                              An image in JPG format.
│            │
│            │                                              jpg_data
│            │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                     field resolution_rad : float
│            │                     field  axis_left_rad : float
│            │                     field axis_right_rad : float
│            │  field your_name : str
│            │  field     state : dataclass aido_schemas.schemas.DTSimState
│            │                     field t_effective : float
│            │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│            │  field  map_data : str
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.
│ p2_inputs: dict[4]
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20Observations
│            │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                    field jpg_data : bytes
│            │                           __doc__
│            │                                             An image in JPG format.
│            │
│            │                                             jpg_data
│            │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                    field resolution_rad : float
│            │                    field  axis_left_rad : float
│            │                    field axis_right_rad : float
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 165, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs:
│     │ Dict[str,type][4]
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│     │ │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                     field jpg_data : bytes
│     │ │                            __doc__
│     │ │                                              An image in JPG format.
│     │ │
│     │ │                                              jpg_data
│     │ │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                     field resolution_rad : float
│     │ │                     field  axis_left_rad : float
│     │ │                     field axis_right_rad : float
│     │ │  field your_name : str
│     │ │  field     state : dataclass aido_schemas.schemas.DTSimState
│     │ │                     field t_effective : float
│     │ │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│     │ │  field  map_data : str
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ Dict[str,type][1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.Duckiebot1Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for DB20 observations and commands.
│     │ inputs:
│     │ dict[4]
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20Observations
│     │ │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                    field jpg_data : bytes
│     │ │                           __doc__
│     │ │                                             An image in JPG format.
│     │ │
│     │ │                                             jpg_data
│     │ │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                    field resolution_rad : float
│     │ │                    field  axis_left_rad : float
│     │ │                    field axis_right_rad : float
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ dict[1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.DB20Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 633, in go
    wrap(cie)
  File "experiment_manager.py", line 618, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 294, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
360589798Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simsuccessnoreg02-8817ca966a31-10:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6487073368247482
survival_time_median4.799999999999991
deviation-center-line_median0.37649387575024224
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03512077033519745
agent_compute-ego_mean0.03449869652589162
agent_compute-ego_median0.03449869652589162
agent_compute-ego_min0.03387662271658579
complete-iteration_max0.621869238714377
complete-iteration_mean0.6168033766249815
complete-iteration_median0.6168033766249815
complete-iteration_min0.611737514535586
deviation-center-line_max0.3768824240139107
deviation-center-line_mean0.37649387575024224
deviation-center-line_min0.37610532748657377
deviation-heading_max1.2989143428170355
deviation-heading_mean1.2890040765565978
deviation-heading_median1.2890040765565978
deviation-heading_min1.27909381029616
driven_any_max0.7396640148032522
driven_any_mean0.7371215789317183
driven_any_median0.7371215789317183
driven_any_min0.7345791430601845
driven_lanedir_consec_max0.6513468578527846
driven_lanedir_consec_mean0.6487073368247482
driven_lanedir_consec_min0.6460678157967119
driven_lanedir_max0.6756516862014323
driven_lanedir_mean0.6729472119385544
driven_lanedir_median0.6729472119385544
driven_lanedir_min0.6702427376756765
get_state_dump_max0.03301483144362768
get_state_dump_mean0.03196783736348152
get_state_dump_median0.03196783736348152
get_state_dump_min0.03092084328333537
get_ui_image_max0.13426768283049265
get_ui_image_mean0.13420122986038524
get_ui_image_median0.13420122986038524
get_ui_image_min0.13413477689027786
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 0.7396640148032522, "get_ui_image": 0.13426768283049265, "step_physics": 0.31096967309713364, "survival_time": 4.799999999999991, "driven_lanedir": 0.6756516862014323, "get_state_dump": 0.03092084328333537, "sim_render-ego": 0.007985944549242655, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03387662271658579, "deviation-heading": 1.27909381029616, "complete-iteration": 0.611737514535586, "set_robot_commands": 0.006353460252285004, "deviation-center-line": 0.37610532748657377, "driven_lanedir_consec": 0.6513468578527846, "sim_compute_sim_state": 0.025593869388103485, "sim_compute_performance-ego": 0.006000325083732605, "sim_compute_robot_state-ego": 0.009385491410891214, "sim_compute_robot_state-npc0": 0.009763429562250773, "sim_compute_robot_state-npc1": 0.009937132398287456, "sim_compute_robot_state-npc2": 0.009560517966747284, "sim_compute_robot_state-npc3": 0.008492745459079742, "sim_compute_robot_state-parked0": 0.008413652578989664}, "udem1-0-1-ego": {"driven_any": 0.7345791430601845, "get_ui_image": 0.13413477689027786, "step_physics": 0.31988923748334247, "survival_time": 4.799999999999991, "driven_lanedir": 0.6702427376756765, "get_state_dump": 0.03301483144362768, "sim_render-ego": 0.008715937534968058, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03512077033519745, "deviation-heading": 1.2989143428170355, "complete-iteration": 0.621869238714377, "set_robot_commands": 0.006780371069908142, "deviation-center-line": 0.3768824240139107, "driven_lanedir_consec": 0.6460678157967119, "sim_compute_sim_state": 0.02309868484735489, "sim_compute_performance-ego": 0.006138456364472707, "sim_compute_robot_state-ego": 0.009420891602834066, "sim_compute_robot_state-npc0": 0.009303438166777292, "sim_compute_robot_state-npc1": 0.009290680289268494, "sim_compute_robot_state-npc2": 0.009128021697203318, "sim_compute_robot_state-npc3": 0.009216124812761942, "sim_compute_robot_state-parked0": 0.008417335649331411}}
set_robot_commands_max0.006780371069908142
set_robot_commands_mean0.006566915661096573
set_robot_commands_median0.006566915661096573
set_robot_commands_min0.006353460252285004
sim_compute_performance-ego_max0.006138456364472707
sim_compute_performance-ego_mean0.0060693907241026555
sim_compute_performance-ego_median0.0060693907241026555
sim_compute_performance-ego_min0.006000325083732605
sim_compute_robot_state-ego_max0.009420891602834066
sim_compute_robot_state-ego_mean0.00940319150686264
sim_compute_robot_state-ego_median0.00940319150686264
sim_compute_robot_state-ego_min0.009385491410891214
sim_compute_robot_state-npc0_max0.009763429562250773
sim_compute_robot_state-npc0_mean0.009533433864514032
sim_compute_robot_state-npc0_median0.009533433864514032
sim_compute_robot_state-npc0_min0.009303438166777292
sim_compute_robot_state-npc1_max0.009937132398287456
sim_compute_robot_state-npc1_mean0.009613906343777972
sim_compute_robot_state-npc1_median0.009613906343777972
sim_compute_robot_state-npc1_min0.009290680289268494
sim_compute_robot_state-npc2_max0.009560517966747284
sim_compute_robot_state-npc2_mean0.0093442698319753
sim_compute_robot_state-npc2_median0.0093442698319753
sim_compute_robot_state-npc2_min0.009128021697203318
sim_compute_robot_state-npc3_max0.009216124812761942
sim_compute_robot_state-npc3_mean0.008854435135920841
sim_compute_robot_state-npc3_median0.008854435135920841
sim_compute_robot_state-npc3_min0.008492745459079742
sim_compute_robot_state-parked0_max0.008417335649331411
sim_compute_robot_state-parked0_mean0.008415494114160538
sim_compute_robot_state-parked0_median0.008415494114160538
sim_compute_robot_state-parked0_min0.008413652578989664
sim_compute_sim_state_max0.025593869388103485
sim_compute_sim_state_mean0.024346277117729187
sim_compute_sim_state_median0.024346277117729187
sim_compute_sim_state_min0.02309868484735489
sim_render-ego_max0.008715937534968058
sim_render-ego_mean0.008350941042105356
sim_render-ego_median0.008350941042105356
sim_render-ego_min0.007985944549242655
simulation-passed1
step_physics_max0.31988923748334247
step_physics_mean0.315429455290238
step_physics_median0.315429455290238
step_physics_min0.31096967309713364
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_min4.799999999999991
No reset possible