Duckietown Challenges Home Challenges Submissions

Evaluator 2126

ID2126
evaluatorSandy1-sandy-1
ownerAndrea Censi 🇨🇭
machinesandy
processSandy1-sandy-1
versiond-c:6.1.19;d-c-r:6.0.48
first heard
last heard
statusinactive
# evaluating
# success24 36109
# timeout
# failed3 36209
# error71 36203
# aborted7 36267
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
365179340Jerome Labonte 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9340/LFv-sim-Sandy1-sandy-1-job36517-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3651410012Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoSandy1-sandy-10:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
│         k: observations
│        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
│             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                                field jpg_data : bytes
│                                       __doc__
│                                                         An image in JPG format.
│ 
│                                                         jpg_data
│             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│                                field resolution_rad : float
│                                field  axis_left_rad : float
│                                field axis_right_rad : float
│             field your_name : str
│             field     state : dataclass aido_schemas.schemas.DTSimState
│                                field t_effective : float
│                                field  duckiebots : Dict[str,DTSimRobotInfo]
│             field  map_data : str
│        v2: dataclass aido_schemas.schemas.DB20Observations
│             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                               field jpg_data : bytes
│                                      __doc__
│                                                        An image in JPG format.
│ 
│                                                        jpg_data
│             field odometry : dataclass aido_schemas.schemas.DB20Odometry
│                               field resolution_rad : float
│                               field  axis_left_rad : float
│                               field axis_right_rad : float
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "your_name"
│            │ |  of type <class 'str'>
│            │ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: Dict[str,type][4]
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│            │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                     field jpg_data : bytes
│            │                            __doc__
│            │                                              An image in JPG format.
│            │
│            │                                              jpg_data
│            │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                     field resolution_rad : float
│            │                     field  axis_left_rad : float
│            │                     field axis_right_rad : float
│            │  field your_name : str
│            │  field     state : dataclass aido_schemas.schemas.DTSimState
│            │                     field t_effective : float
│            │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│            │  field  map_data : str
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.
│ p2_inputs: dict[4]
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20Observations
│            │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                    field jpg_data : bytes
│            │                           __doc__
│            │                                             An image in JPG format.
│            │
│            │                                             jpg_data
│            │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                    field resolution_rad : float
│            │                    field  axis_left_rad : float
│            │                    field axis_right_rad : float
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs:
│     │ Dict[str,type][4]
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│     │ │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                     field jpg_data : bytes
│     │ │                            __doc__
│     │ │                                              An image in JPG format.
│     │ │
│     │ │                                              jpg_data
│     │ │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                     field resolution_rad : float
│     │ │                     field  axis_left_rad : float
│     │ │                     field axis_right_rad : float
│     │ │  field your_name : str
│     │ │  field     state : dataclass aido_schemas.schemas.DTSimState
│     │ │                     field t_effective : float
│     │ │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│     │ │  field  map_data : str
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ Dict[str,type][1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.Duckiebot1Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for DB20 observations and commands.
│     │ inputs:
│     │ dict[4]
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20Observations
│     │ │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                    field jpg_data : bytes
│     │ │                           __doc__
│     │ │                                             An image in JPG format.
│     │ │
│     │ │                                             jpg_data
│     │ │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                    field resolution_rad : float
│     │ │                    field  axis_left_rad : float
│     │ │                    field axis_right_rad : float
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ dict[1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.DB20Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7f247ba176d0>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3651210011Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornoSandy1-sandy-10:01:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
│         k: observations
│        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
│             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                                field jpg_data : bytes
│                                       __doc__
│                                                         An image in JPG format.
│ 
│                                                         jpg_data
│             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│                                field resolution_rad : float
│                                field  axis_left_rad : float
│                                field axis_right_rad : float
│             field your_name : str
│             field     state : dataclass aido_schemas.schemas.DTSimState
│                                field t_effective : float
│                                field  duckiebots : Dict[str,DTSimRobotInfo]
│             field  map_data : str
│        v2: dataclass aido_schemas.schemas.DB20Observations
│             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                               field jpg_data : bytes
│                                      __doc__
│                                                        An image in JPG format.
│ 
│                                                        jpg_data
│             field odometry : dataclass aido_schemas.schemas.DB20Odometry
│                               field resolution_rad : float
│                               field  axis_left_rad : float
│                               field axis_right_rad : float
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "your_name"
│            │ |  of type <class 'str'>
│            │ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: Dict[str,type][4]
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│            │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                     field jpg_data : bytes
│            │                            __doc__
│            │                                              An image in JPG format.
│            │
│            │                                              jpg_data
│            │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                     field resolution_rad : float
│            │                     field  axis_left_rad : float
│            │                     field axis_right_rad : float
│            │  field your_name : str
│            │  field     state : dataclass aido_schemas.schemas.DTSimState
│            │                     field t_effective : float
│            │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│            │  field  map_data : str
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.
│ p2_inputs: dict[4]
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20Observations
│            │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                    field jpg_data : bytes
│            │                           __doc__
│            │                                             An image in JPG format.
│            │
│            │                                             jpg_data
│            │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                    field resolution_rad : float
│            │                    field  axis_left_rad : float
│            │                    field axis_right_rad : float
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 173, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs:
│     │ Dict[str,type][4]
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│     │ │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                     field jpg_data : bytes
│     │ │                            __doc__
│     │ │                                              An image in JPG format.
│     │ │
│     │ │                                              jpg_data
│     │ │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                     field resolution_rad : float
│     │ │                     field  axis_left_rad : float
│     │ │                     field axis_right_rad : float
│     │ │  field your_name : str
│     │ │  field     state : dataclass aido_schemas.schemas.DTSimState
│     │ │                     field t_effective : float
│     │ │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│     │ │  field  map_data : str
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ Dict[str,type][1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.Duckiebot1Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for DB20 observations and commands.
│     │ inputs:
│     │ dict[4]
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20Observations
│     │ │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                    field jpg_data : bytes
│     │ │                           __doc__
│     │ │                                             An image in JPG format.
│     │ │
│     │ │                                             jpg_data
│     │ │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                    field resolution_rad : float
│     │ │                    field  axis_left_rad : float
│     │ │                    field axis_right_rad : float
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ dict[1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.DB20Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 177, in main
    raise Exception(msg) from e
Exception: Could not get protocol for robot <zuper_nodes_wrapper.wrapper_outside.ComponentInterface object at 0x7fc66608ec10>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 311, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3650910010Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.202262234357202
survival_time_median14.950000000000076
deviation-center-line_median0.876167855676443
in-drivable-lane_median4.425000000000063


other stats
agent_compute-ego_max0.02252907911936442
agent_compute-ego_mean0.02105345785617828
agent_compute-ego_median0.020713512102762857
agent_compute-ego_min0.020257728099823
complete-iteration_max0.211653147538503
complete-iteration_mean0.2081595434745153
complete-iteration_median0.210462243159612
complete-iteration_min0.20006054004033408
deviation-center-line_max0.9502082973404604
deviation-center-line_mean0.7413304610566599
deviation-center-line_min0.2627778355332931
deviation-heading_max2.438077474898752
deviation-heading_mean1.4451840302082812
deviation-heading_median1.296145901805819
deviation-heading_min0.7503668423227348
driven_any_max3.267340362087674
driven_any_mean3.26465827659728
driven_any_median3.267299999329807
driven_any_min3.2566927456418315
driven_lanedir_consec_max3.1461325763107277
driven_lanedir_consec_mean2.2650847704654566
driven_lanedir_consec_min1.5096820368366957
driven_lanedir_max3.1461325763107277
driven_lanedir_mean2.2650847704654566
driven_lanedir_median2.202262234357202
driven_lanedir_min1.5096820368366957
get_state_dump_max0.016045833428700765
get_state_dump_mean0.015006539821624755
get_state_dump_median0.014847121636072791
get_state_dump_min0.014286082585652667
get_ui_image_max0.03548527956008911
get_ui_image_mean0.03424905916055044
get_ui_image_median0.03485203742980957
get_ui_image_min0.03180688222249349
in-drivable-lane_max7.400000000000084
in-drivable-lane_mean4.175000000000054
in-drivable-lane_min0.4500000000000064
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2566927456418315, "get_ui_image": 0.03544672727584839, "step_physics": 0.08836016416549683, "survival_time": 14.950000000000076, "driven_lanedir": 1.5096820368366957, "get_state_dump": 0.014286082585652667, "sim_render-ego": 0.006770798365275065, "in-drivable-lane": 7.400000000000084, "agent_compute-ego": 0.020257728099823, "deviation-heading": 1.418541148839182, "complete-iteration": 0.20972435235977172, "set_robot_commands": 0.005250527064005534, "deviation-center-line": 0.2627778355332931, "driven_lanedir_consec": 1.5096820368366957, "sim_compute_sim_state": 0.017988255818684896, "sim_compute_performance-ego": 0.004559279282887777, "sim_compute_robot_state-ego": 0.008664256731669108, "sim_compute_robot_state-parked0": 0.007984513441721599}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.267336463432932, "get_ui_image": 0.03548527956008911, "step_physics": 0.09107264359792074, "survival_time": 14.950000000000076, "driven_lanedir": 3.1461325763107277, "get_state_dump": 0.014321860472361246, "sim_render-ego": 0.006714730262756347, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.02039102792739868, "deviation-heading": 1.1737506547724557, "complete-iteration": 0.211653147538503, "set_robot_commands": 0.005234630902608236, "deviation-center-line": 0.9093397939092752, "driven_lanedir_consec": 3.1461325763107277, "sim_compute_sim_state": 0.01710077444712321, "sim_compute_performance-ego": 0.004485010306040446, "sim_compute_robot_state-ego": 0.008482271035512289, "sim_compute_robot_state-parked0": 0.008205171426137288}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.2672635352266823, "get_ui_image": 0.03180688222249349, "step_physics": 0.0807931137084961, "survival_time": 14.950000000000076, "driven_lanedir": 1.864990715487173, "get_state_dump": 0.016045833428700765, "sim_render-ego": 0.006973628203074137, "in-drivable-lane": 5.65000000000008, "agent_compute-ego": 0.02252907911936442, "deviation-heading": 2.438077474898752, "complete-iteration": 0.20006054004033408, "set_robot_commands": 0.005382471084594727, "deviation-center-line": 0.8429959174436108, "driven_lanedir_consec": 1.864990715487173, "sim_compute_sim_state": 0.014844955603281655, "sim_compute_performance-ego": 0.004641242822011312, "sim_compute_robot_state-ego": 0.008750662803649903, "sim_compute_robot_state-parked0": 0.008124823570251466}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.267340362087674, "get_ui_image": 0.034257347583770754, "step_physics": 0.08972005446751913, "survival_time": 14.950000000000076, "driven_lanedir": 2.5395337532272295, "get_state_dump": 0.015372382799784342, "sim_render-ego": 0.006868404547373454, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.021035996278127033, "deviation-heading": 0.7503668423227348, "complete-iteration": 0.2112001339594523, "set_robot_commands": 0.005234333674112955, "deviation-center-line": 0.9502082973404604, "driven_lanedir_consec": 2.5395337532272295, "sim_compute_sim_state": 0.0171500563621521, "sim_compute_performance-ego": 0.004591291745503744, "sim_compute_robot_state-ego": 0.00876609722773234, "sim_compute_robot_state-parked0": 0.008044068813323974}}
set_robot_commands_max0.005382471084594727
set_robot_commands_mean0.005275490681330363
set_robot_commands_median0.005242578983306885
set_robot_commands_min0.005234333674112955
sim_compute_performance-ego_max0.004641242822011312
sim_compute_performance-ego_mean0.00456920603911082
sim_compute_performance-ego_median0.004575285514195761
sim_compute_performance-ego_min0.004485010306040446
sim_compute_robot_state-ego_max0.00876609722773234
sim_compute_robot_state-ego_mean0.00866582194964091
sim_compute_robot_state-ego_median0.008707459767659506
sim_compute_robot_state-ego_min0.008482271035512289
sim_compute_robot_state-parked0_max0.008205171426137288
sim_compute_robot_state-parked0_mean0.008089644312858581
sim_compute_robot_state-parked0_median0.00808444619178772
sim_compute_robot_state-parked0_min0.007984513441721599
sim_compute_sim_state_max0.017988255818684896
sim_compute_sim_state_mean0.016771010557810464
sim_compute_sim_state_median0.017125415404637655
sim_compute_sim_state_min0.014844955603281655
sim_render-ego_max0.006973628203074137
sim_render-ego_mean0.0068318903446197505
sim_render-ego_median0.006819601456324259
sim_render-ego_min0.006714730262756347
simulation-passed1
step_physics_max0.09107264359792074
step_physics_mean0.08748649398485821
step_physics_median0.08904010931650798
step_physics_min0.0807931137084961
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
365016760Anthony Courchesne 🇨🇦template-rosaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-11:00:47
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364926804Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednoSandy1-sandy-10:03:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364866807Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:05:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4366244480654584
survival_time_median4.674999999999992
deviation-center-line_median0.30235620843499067
in-drivable-lane_median0.9249999999999968


other stats
agent_compute-ego_max0.021466084087596225
agent_compute-ego_mean0.020852159740878087
agent_compute-ego_median0.020947048921211096
agent_compute-ego_min0.02004845703349394
complete-iteration_max0.2025833326227525
complete-iteration_mean0.1944754828892502
complete-iteration_median0.1942489056961209
complete-iteration_min0.18682078754200657
deviation-center-line_max0.4359954898526317
deviation-center-line_mean0.3095824874105573
deviation-center-line_min0.1976220429196164
deviation-heading_max2.286581164642681
deviation-heading_mean1.1645862618115042
deviation-heading_median0.8548827100318721
deviation-heading_min0.6619984625395918
driven_any_max1.939997261048641
driven_any_mean0.87290559520545
driven_any_median0.5725844520211546
driven_any_min0.4064562157308501
driven_lanedir_consec_max0.6802395853288715
driven_lanedir_consec_mean0.4567689421819272
driven_lanedir_consec_min0.2735872872679206
driven_lanedir_max0.6802395853288715
driven_lanedir_mean0.4567689421819272
driven_lanedir_median0.4366244480654584
driven_lanedir_min0.2735872872679206
get_state_dump_max0.016319661981919233
get_state_dump_mean0.01574881134079952
get_state_dump_median0.015730056435454127
get_state_dump_min0.015215470510370591
get_ui_image_max0.03231502374013265
get_ui_image_mean0.03200166067656349
get_ui_image_median0.032008782905690814
get_ui_image_min0.03167405315473968
in-drivable-lane_max8.700000000000092
in-drivable-lane_mean2.85000000000002
in-drivable-lane_min0.849999999999997
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.5129966915856362, "get_ui_image": 0.03176627439611098, "step_physics": 0.08068974158343147, "survival_time": 4.249999999999993, "driven_lanedir": 0.3781075339199065, "get_state_dump": 0.016319661981919233, "sim_render-ego": 0.007304096221923828, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.021466084087596225, "deviation-heading": 0.8218240116725859, "complete-iteration": 0.2025833326227525, "set_robot_commands": 0.005300157210406135, "deviation-center-line": 0.25178734328466934, "driven_lanedir_consec": 0.3781075339199065, "sim_compute_sim_state": 0.016065659242517807, "sim_compute_performance-ego": 0.005034230737125172, "sim_compute_robot_state-ego": 0.010358793595257928, "sim_compute_robot_state-parked0": 0.008107774397906135}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.4064562157308501, "get_ui_image": 0.03225129141527064, "step_physics": 0.07481901435291066, "survival_time": 3.399999999999996, "driven_lanedir": 0.2735872872679206, "get_state_dump": 0.015215470510370591, "sim_render-ego": 0.006262849358951344, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02004845703349394, "deviation-heading": 0.8879414083911582, "complete-iteration": 0.18682078754200657, "set_robot_commands": 0.004494284882264978, "deviation-center-line": 0.1976220429196164, "driven_lanedir_consec": 0.2735872872679206, "sim_compute_sim_state": 0.013743134105906768, "sim_compute_performance-ego": 0.004479127771714155, "sim_compute_robot_state-ego": 0.008108335382798138, "sim_compute_robot_state-parked0": 0.007237336214850931}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939997261048641, "get_ui_image": 0.03231502374013265, "step_physics": 0.07821738958358765, "survival_time": 14.950000000000076, "driven_lanedir": 0.6802395853288715, "get_state_dump": 0.015435450871785482, "sim_render-ego": 0.006404922008514404, "in-drivable-lane": 8.700000000000092, "agent_compute-ego": 0.021382416884104413, "deviation-heading": 2.286581164642681, "complete-iteration": 0.19101865450541175, "set_robot_commands": 0.004656644662221273, "deviation-center-line": 0.4359954898526317, "driven_lanedir_consec": 0.6802395853288715, "sim_compute_sim_state": 0.013427570660909017, "sim_compute_performance-ego": 0.004192253748575846, "sim_compute_robot_state-ego": 0.007567405700683594, "sim_compute_robot_state-parked0": 0.007252785364786784}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.632172212456673, "get_ui_image": 0.03167405315473968, "step_physics": 0.08443723940381817, "survival_time": 5.09999999999999, "driven_lanedir": 0.4951413622110103, "get_state_dump": 0.01602466199912277, "sim_render-ego": 0.00655828504001393, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.020511680958317777, "deviation-heading": 0.6619984625395918, "complete-iteration": 0.19747915688683004, "set_robot_commands": 0.004591016208424288, "deviation-center-line": 0.35292507358531194, "driven_lanedir_consec": 0.4951413622110103, "sim_compute_sim_state": 0.014292242480259317, "sim_compute_performance-ego": 0.004347429556005141, "sim_compute_robot_state-ego": 0.007605905626334396, "sim_compute_robot_state-parked0": 0.007268765393425436}}
set_robot_commands_max0.005300157210406135
set_robot_commands_mean0.004760525740829169
set_robot_commands_median0.00462383043532278
set_robot_commands_min0.004494284882264978
sim_compute_performance-ego_max0.005034230737125172
sim_compute_performance-ego_mean0.004513260453355079
sim_compute_performance-ego_median0.0044132786638596475
sim_compute_performance-ego_min0.004192253748575846
sim_compute_robot_state-ego_max0.010358793595257928
sim_compute_robot_state-ego_mean0.008410110076268514
sim_compute_robot_state-ego_median0.007857120504566268
sim_compute_robot_state-ego_min0.007567405700683594
sim_compute_robot_state-parked0_max0.008107774397906135
sim_compute_robot_state-parked0_mean0.0074666653427423214
sim_compute_robot_state-parked0_median0.00726077537910611
sim_compute_robot_state-parked0_min0.007237336214850931
sim_compute_sim_state_max0.016065659242517807
sim_compute_sim_state_mean0.014382151622398226
sim_compute_sim_state_median0.01401768829308304
sim_compute_sim_state_min0.013427570660909017
sim_render-ego_max0.007304096221923828
sim_render-ego_mean0.006632538157350877
sim_render-ego_median0.0064816035242641675
sim_render-ego_min0.006262849358951344
simulation-passed1
step_physics_max0.08443723940381817
step_physics_mean0.07954084623093699
step_physics_median0.07945356558350955
step_physics_min0.07481901435291066
survival_time_max14.950000000000076
survival_time_mean6.925000000000014
survival_time_min3.399999999999996
No reset possible
364796814Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.022623581091562907
agent_compute-ego_mean0.02207673092683157
agent_compute-ego_median0.02198857585589091
agent_compute-ego_min0.021706190903981525
complete-iteration_max0.20749274889628092
complete-iteration_mean0.19796078582604723
complete-iteration_median0.1963378095626831
complete-iteration_min0.1916747752825419
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.01622326612472534
get_state_dump_mean0.015997212131818137
get_state_dump_median0.016000604232152306
get_state_dump_min0.015764373938242593
get_ui_image_max0.03204018831253052
get_ui_image_mean0.03165338218212128
get_ui_image_median0.0316992461681366
get_ui_image_min0.031174848079681395
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.031174848079681395, "step_physics": 0.0759203553199768, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.015764373938242593, "sim_render-ego": 0.006855146090189616, "in-drivable-lane": 0.0, "agent_compute-ego": 0.021706190903981525, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.1944028472900391, "set_robot_commands": 0.005604401429494222, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.015346530278523764, "sim_compute_performance-ego": 0.004739204247792562, "sim_compute_robot_state-ego": 0.009011179606119793, "sim_compute_robot_state-parked0": 0.008100781440734863}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03173638661702474, "step_physics": 0.0761028512318929, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.016067329247792562, "sim_render-ego": 0.0066478967666625975, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02185746431350708, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.1916747752825419, "set_robot_commands": 0.004967958132425944, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014087685743967692, "sim_compute_performance-ego": 0.004375096956888835, "sim_compute_robot_state-ego": 0.0076737936337788895, "sim_compute_robot_state-parked0": 0.007975516319274902}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.031662105719248455, "step_physics": 0.07901062409083048, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.015933879216512046, "sim_render-ego": 0.007312853336334229, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022623581091562907, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.19827277183532716, "set_robot_commands": 0.005897467136383057, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.012186081409454343, "sim_compute_performance-ego": 0.004888052145640055, "sim_compute_robot_state-ego": 0.010027786095937094, "sim_compute_robot_state-parked0": 0.008542679945627848}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.03204018831253052, "step_physics": 0.08779173612594604, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01622326612472534, "sim_render-ego": 0.0071256494522094725, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02211968739827474, "deviation-heading": 0.486072248607516, "complete-iteration": 0.20749274889628092, "set_robot_commands": 0.005626296997070313, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.014288547039031985, "sim_compute_performance-ego": 0.004709322452545166, "sim_compute_robot_state-ego": 0.00912009874979655, "sim_compute_robot_state-parked0": 0.008263383706410726}}
set_robot_commands_max0.005897467136383057
set_robot_commands_mean0.005524030923843385
set_robot_commands_median0.005615349213282267
set_robot_commands_min0.004967958132425944
sim_compute_performance-ego_max0.004888052145640055
sim_compute_performance-ego_mean0.004677918950716654
sim_compute_performance-ego_median0.004724263350168864
sim_compute_performance-ego_min0.004375096956888835
sim_compute_robot_state-ego_max0.010027786095937094
sim_compute_robot_state-ego_mean0.00895821452140808
sim_compute_robot_state-ego_median0.00906563917795817
sim_compute_robot_state-ego_min0.0076737936337788895
sim_compute_robot_state-parked0_max0.008542679945627848
sim_compute_robot_state-parked0_mean0.008220590353012085
sim_compute_robot_state-parked0_median0.008182082573572794
sim_compute_robot_state-parked0_min0.007975516319274902
sim_compute_sim_state_max0.015346530278523764
sim_compute_sim_state_mean0.013977211117744446
sim_compute_sim_state_median0.014188116391499837
sim_compute_sim_state_min0.012186081409454343
sim_render-ego_max0.007312853336334229
sim_render-ego_mean0.006985386411348979
sim_render-ego_median0.006990397771199544
sim_render-ego_min0.0066478967666625975
simulation-passed1
step_physics_max0.08779173612594604
step_physics_mean0.07970639169216157
step_physics_median0.0775567376613617
step_physics_min0.0759203553199768
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
3647210008Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0677827226352528
survival_time_median14.950000000000076
deviation-center-line_median0.5358849379023843
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.022373085021972657
agent_compute-ego_mean0.02234071632226308
agent_compute-ego_median0.022354707320531207
agent_compute-ego_min0.022280365626017252
complete-iteration_max0.20393612225850424
complete-iteration_mean0.1999922323226929
complete-iteration_median0.2000903844833374
complete-iteration_min0.19585203806559243
deviation-center-line_max0.6754990748292742
deviation-center-line_mean0.5504104137375232
deviation-center-line_min0.4543727043160497
deviation-heading_max2.3196475744390543
deviation-heading_mean2.0554456269078143
deviation-heading_median2.151275714569004
deviation-heading_min1.599583504054194
driven_any_max3.484244723532702
driven_any_mean2.8940867872171645
driven_any_median3.0976130841800487
driven_any_min1.8968762569758573
driven_lanedir_consec_max3.4316216937320028
driven_lanedir_consec_mean2.812045708277288
driven_lanedir_consec_min1.680995694106643
driven_lanedir_max3.4316216937320028
driven_lanedir_mean2.812045708277288
driven_lanedir_median3.0677827226352528
driven_lanedir_min1.680995694106643
get_state_dump_max0.016199541091918946
get_state_dump_mean0.016105676492055257
get_state_dump_median0.01611592769622803
get_state_dump_min0.015991309483846028
get_ui_image_max0.03295701742172241
get_ui_image_mean0.03222042044003805
get_ui_image_median0.03236042181650797
get_ui_image_min0.031203820705413814
in-drivable-lane_max2.6500000000000377
in-drivable-lane_mean0.6625000000000094
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.844034836412694, "get_ui_image": 0.031203820705413814, "step_physics": 0.07579464197158814, "survival_time": 14.950000000000076, "driven_lanedir": 2.8239595615608515, "get_state_dump": 0.015991309483846028, "sim_render-ego": 0.00673603614171346, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02234490474065145, "deviation-heading": 1.599583504054194, "complete-iteration": 0.19639538049697877, "set_robot_commands": 0.005522732734680176, "deviation-center-line": 0.5497677423081805, "driven_lanedir_consec": 2.8239595615608515, "sim_compute_sim_state": 0.017059559027353923, "sim_compute_performance-ego": 0.004567265510559082, "sim_compute_robot_state-ego": 0.008799316088358562, "sim_compute_robot_state-parked0": 0.008203677336374919}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.351191331947403, "get_ui_image": 0.03219344059626261, "step_physics": 0.0788154689470927, "survival_time": 14.950000000000076, "driven_lanedir": 3.311605883709654, "get_state_dump": 0.016199541091918946, "sim_render-ego": 0.007317275206247966, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022373085021972657, "deviation-heading": 2.070237902288363, "complete-iteration": 0.20378538846969604, "set_robot_commands": 0.006072969436645508, "deviation-center-line": 0.5220021334965882, "driven_lanedir_consec": 3.311605883709654, "sim_compute_sim_state": 0.017069242795308432, "sim_compute_performance-ego": 0.004934659004211426, "sim_compute_robot_state-ego": 0.01004217545191447, "sim_compute_robot_state-parked0": 0.00859028180440267}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.8968762569758573, "get_ui_image": 0.03295701742172241, "step_physics": 0.07890265067418416, "survival_time": 14.950000000000076, "driven_lanedir": 1.680995694106643, "get_state_dump": 0.01608268658320109, "sim_render-ego": 0.006570867697397868, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.022280365626017252, "deviation-heading": 2.3196475744390543, "complete-iteration": 0.19585203806559243, "set_robot_commands": 0.00505890687306722, "deviation-center-line": 0.4543727043160497, "driven_lanedir_consec": 1.680995694106643, "sim_compute_sim_state": 0.013709915479024252, "sim_compute_performance-ego": 0.004314615726470948, "sim_compute_robot_state-ego": 0.007794137001037597, "sim_compute_robot_state-parked0": 0.008005940914154052}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.484244723532702, "get_ui_image": 0.03252740303675334, "step_physics": 0.08134147723515829, "survival_time": 14.950000000000076, "driven_lanedir": 3.4316216937320028, "get_state_dump": 0.016149168809254964, "sim_render-ego": 0.006943056583404541, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02236450990041097, "deviation-heading": 2.2323135268496452, "complete-iteration": 0.20393612225850424, "set_robot_commands": 0.0055024234453837076, "deviation-center-line": 0.6754990748292742, "driven_lanedir_consec": 3.4316216937320028, "sim_compute_sim_state": 0.01695175647735596, "sim_compute_performance-ego": 0.004663368860880534, "sim_compute_robot_state-ego": 0.008994456926981607, "sim_compute_robot_state-parked0": 0.00832131306330363}}
set_robot_commands_max0.006072969436645508
set_robot_commands_mean0.005539258122444153
set_robot_commands_median0.005512578090031942
set_robot_commands_min0.00505890687306722
sim_compute_performance-ego_max0.004934659004211426
sim_compute_performance-ego_mean0.004619977275530498
sim_compute_performance-ego_median0.004615317185719808
sim_compute_performance-ego_min0.004314615726470948
sim_compute_robot_state-ego_max0.01004217545191447
sim_compute_robot_state-ego_mean0.008907521367073058
sim_compute_robot_state-ego_median0.008896886507670084
sim_compute_robot_state-ego_min0.007794137001037597
sim_compute_robot_state-parked0_max0.00859028180440267
sim_compute_robot_state-parked0_mean0.008280303279558818
sim_compute_robot_state-parked0_median0.008262495199839275
sim_compute_robot_state-parked0_min0.008005940914154052
sim_compute_sim_state_max0.017069242795308432
sim_compute_sim_state_mean0.016197618444760642
sim_compute_sim_state_median0.017005657752354943
sim_compute_sim_state_min0.013709915479024252
sim_render-ego_max0.007317275206247966
sim_render-ego_mean0.006891808907190959
sim_render-ego_median0.006839546362559
sim_render-ego_min0.006570867697397868
simulation-passed1
step_physics_max0.08134147723515829
step_physics_mean0.07871355970700582
step_physics_median0.07885905981063843
step_physics_min0.07579464197158814
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
364666827Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3821401994784028
survival_time_median13.525000000000055
deviation-center-line_median0.25471189903205405
in-drivable-lane_median10.275000000000045


other stats
agent_compute-ego_max0.023028688430786134
agent_compute-ego_mean0.022590352470164103
agent_compute-ego_median0.022518778731746056
agent_compute-ego_min0.022295163986378146
complete-iteration_max0.20536017417907715
complete-iteration_mean0.2004626813546583
complete-iteration_median0.20224539703892583
complete-iteration_min0.19199975716170445
deviation-center-line_max0.3055706724502006
deviation-center-line_mean0.23409920653050453
deviation-center-line_min0.12140235560770948
deviation-heading_max3.721314766119758
deviation-heading_mean2.263873510157328
deviation-heading_median1.9778923022126895
deviation-heading_min1.3783946700841747
driven_any_max4.307352494741645
driven_any_mean3.7590083007091577
driven_any_median3.948587805129565
driven_any_min2.831505097835855
driven_lanedir_consec_max0.6630860109140677
driven_lanedir_consec_mean0.410206351534365
driven_lanedir_consec_min0.2134589962665867
driven_lanedir_max0.6856010261754006
driven_lanedir_mean0.4697245869750221
driven_lanedir_median0.4200495331579197
driven_lanedir_min0.3531982554088484
get_state_dump_max0.01628135160966353
get_state_dump_mean0.015899182667645256
get_state_dump_median0.01608712862906301
get_state_dump_min0.015141121802791473
get_ui_image_max0.03285175625995923
get_ui_image_mean0.03210627793598114
get_ui_image_median0.03198739773430241
get_ui_image_min0.031598560015360516
in-drivable-lane_max12.80000000000008
in-drivable-lane_mean9.812500000000044
in-drivable-lane_min5.900000000000001
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.307352494741645, "get_ui_image": 0.031598560015360516, "step_physics": 0.08221201896667481, "survival_time": 14.950000000000076, "driven_lanedir": 0.3531982554088484, "get_state_dump": 0.016116122404734295, "sim_render-ego": 0.007365721861521403, "in-drivable-lane": 12.80000000000008, "agent_compute-ego": 0.02273520549138387, "deviation-heading": 1.3783946700841747, "complete-iteration": 0.2041577410697937, "set_robot_commands": 0.005965124766031901, "deviation-center-line": 0.12140235560770948, "driven_lanedir_consec": 0.3287942512319173, "sim_compute_sim_state": 0.015137022336324055, "sim_compute_performance-ego": 0.0048083178202311195, "sim_compute_robot_state-ego": 0.00961143970489502, "sim_compute_robot_state-parked0": 0.008428813616434733}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.098488157596127, "get_ui_image": 0.03171202919699929, "step_physics": 0.08405043515292081, "survival_time": 13.75000000000006, "driven_lanedir": 0.4570203175671588, "get_state_dump": 0.01628135160966353, "sim_render-ego": 0.007220307263461026, "in-drivable-lane": 11.000000000000057, "agent_compute-ego": 0.023028688430786134, "deviation-heading": 2.1186339420887066, "complete-iteration": 0.20536017417907715, "set_robot_commands": 0.005867971940474077, "deviation-center-line": 0.2289932250655844, "driven_lanedir_consec": 0.4354861477248883, "sim_compute_sim_state": 0.01410808043046431, "sim_compute_performance-ego": 0.0047983386299826885, "sim_compute_robot_state-ego": 0.00964707461270419, "sim_compute_robot_state-parked0": 0.00846158201044256}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.831505097835855, "get_ui_image": 0.03285175625995923, "step_physics": 0.07765970178829726, "survival_time": 9.299999999999995, "driven_lanedir": 0.6856010261754006, "get_state_dump": 0.015141121802791473, "sim_render-ego": 0.006482516565630513, "in-drivable-lane": 5.900000000000001, "agent_compute-ego": 0.02230235197210825, "deviation-heading": 1.837150662336673, "complete-iteration": 0.19199975716170445, "set_robot_commands": 0.0048213094793340214, "deviation-center-line": 0.28043057299852364, "driven_lanedir_consec": 0.6630860109140677, "sim_compute_sim_state": 0.012999638434379332, "sim_compute_performance-ego": 0.004263715077471989, "sim_compute_robot_state-ego": 0.007583246436170352, "sim_compute_robot_state-parked0": 0.007713563980594758}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.7986874526630032, "get_ui_image": 0.03226276627160553, "step_physics": 0.0804886405629323, "survival_time": 13.300000000000054, "driven_lanedir": 0.38307874874868064, "get_state_dump": 0.01605813485339172, "sim_render-ego": 0.007021438806576836, "in-drivable-lane": 9.550000000000033, "agent_compute-ego": 0.022295163986378146, "deviation-heading": 3.721314766119758, "complete-iteration": 0.200333053008058, "set_robot_commands": 0.005741293268992489, "deviation-center-line": 0.3055706724502006, "driven_lanedir_consec": 0.2134589962665867, "sim_compute_sim_state": 0.013671705597325376, "sim_compute_performance-ego": 0.0046811668496382864, "sim_compute_robot_state-ego": 0.009691142498102405, "sim_compute_robot_state-parked0": 0.008240390540961932}}
set_robot_commands_max0.005965124766031901
set_robot_commands_mean0.005598924863708122
set_robot_commands_median0.005804632604733283
set_robot_commands_min0.0048213094793340214
sim_compute_performance-ego_max0.0048083178202311195
sim_compute_performance-ego_mean0.004637884594331021
sim_compute_performance-ego_median0.004739752739810487
sim_compute_performance-ego_min0.004263715077471989
sim_compute_robot_state-ego_max0.009691142498102405
sim_compute_robot_state-ego_mean0.00913322581296799
sim_compute_robot_state-ego_median0.009629257158799604
sim_compute_robot_state-ego_min0.007583246436170352
sim_compute_robot_state-parked0_max0.00846158201044256
sim_compute_robot_state-parked0_mean0.008211087537108495
sim_compute_robot_state-parked0_median0.008334602078698333
sim_compute_robot_state-parked0_min0.007713563980594758
sim_compute_sim_state_max0.015137022336324055
sim_compute_sim_state_mean0.013979111699623268
sim_compute_sim_state_median0.013889893013894844
sim_compute_sim_state_min0.012999638434379332
sim_render-ego_max0.007365721861521403
sim_render-ego_mean0.007022496124297445
sim_render-ego_median0.007120873035018931
sim_render-ego_min0.006482516565630513
simulation-passed1
step_physics_max0.08405043515292081
step_physics_mean0.08110269911770629
step_physics_median0.08135032976480355
step_physics_min0.07765970178829726
survival_time_max14.950000000000076
survival_time_mean12.825000000000047
survival_time_min9.299999999999995
No reset possible
364586832Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:09:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median14.950000000000076
deviation-center-line_median0.3071094952840746
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.024725202719370523
agent_compute-ego_mean0.02315910339355469
agent_compute-ego_median0.023061929941177367
agent_compute-ego_min0.02178735097249349
complete-iteration_max0.2107582402229309
complete-iteration_mean0.20090180019537607
complete-iteration_median0.2008259344100952
complete-iteration_min0.19119709173838295
deviation-center-line_max0.6863069918481528
deviation-center-line_mean0.35998819605511767
deviation-center-line_min0.13942680180416853
deviation-heading_max3.7258518640401217
deviation-heading_mean1.6586762301304627
deviation-heading_median1.2113904039371066
deviation-heading_min0.486072248607516
driven_any_max1.3686924727581474e-13
driven_any_mean6.950391439969185e-14
driven_any_median7.057320516147632e-14
driven_any_min0.0
driven_lanedir_consec_max1.7821788787841797e-05
driven_lanedir_consec_mean4.455447196960449e-06
driven_lanedir_consec_min0.0
driven_lanedir_max1.7821788787841797e-05
driven_lanedir_mean4.455447196960449e-06
driven_lanedir_median0.0
driven_lanedir_min0.0
get_state_dump_max0.017711501916249595
get_state_dump_mean0.016795982321103416
get_state_dump_median0.016767252683639523
get_state_dump_min0.01593792200088501
get_ui_image_max0.031984842618306475
get_ui_image_mean0.0312480362256368
get_ui_image_median0.031255171696345015
get_ui_image_min0.0304969588915507
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.031984842618306475, "step_physics": 0.08076124986012777, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01640703280766805, "sim_render-ego": 0.007075379689534506, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022031127611796063, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.2022105352083842, "set_robot_commands": 0.005541425546010335, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01583096742630005, "sim_compute_performance-ego": 0.004818836847941081, "sim_compute_robot_state-ego": 0.009018975098927816, "sim_compute_robot_state-parked0": 0.00855812152226766}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.031854294935862226, "step_physics": 0.07920686483383178, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01593792200088501, "sim_render-ego": 0.007060388724009196, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02178735097249349, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.19944133361180624, "set_robot_commands": 0.005649922688802083, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01474814812342326, "sim_compute_performance-ego": 0.004776526292165121, "sim_compute_robot_state-ego": 0.00968273401260376, "sim_compute_robot_state-parked0": 0.008559660116831461}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.0304969588915507, "step_physics": 0.07268337885538736, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.017711501916249595, "sim_render-ego": 0.006700975100199381, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024725202719370523, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.19119709173838295, "set_robot_commands": 0.0052735328674316405, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.012715155283610028, "sim_compute_performance-ego": 0.0045083944002787275, "sim_compute_robot_state-ego": 0.00777941624323527, "sim_compute_robot_state-parked0": 0.008416271209716797}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.0306560484568278, "step_physics": 0.08671303749084473, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.017127472559611, "sim_render-ego": 0.007261853218078613, "in-drivable-lane": 0.0, "agent_compute-ego": 0.024092732270558675, "deviation-heading": 0.486072248607516, "complete-iteration": 0.2107582402229309, "set_robot_commands": 0.0060338012377421065, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01533431927363078, "sim_compute_performance-ego": 0.004854578177134196, "sim_compute_robot_state-ego": 0.009662000338236491, "sim_compute_robot_state-parked0": 0.008841092586517335}}
set_robot_commands_max0.0060338012377421065
set_robot_commands_mean0.005624670584996541
set_robot_commands_median0.005595674117406209
set_robot_commands_min0.0052735328674316405
sim_compute_performance-ego_max0.004854578177134196
sim_compute_performance-ego_mean0.004739583929379782
sim_compute_performance-ego_median0.004797681570053101
sim_compute_performance-ego_min0.0045083944002787275
sim_compute_robot_state-ego_max0.00968273401260376
sim_compute_robot_state-ego_mean0.009035781423250832
sim_compute_robot_state-ego_median0.009340487718582154
sim_compute_robot_state-ego_min0.00777941624323527
sim_compute_robot_state-parked0_max0.008841092586517335
sim_compute_robot_state-parked0_mean0.008593786358833313
sim_compute_robot_state-parked0_median0.00855889081954956
sim_compute_robot_state-parked0_min0.008416271209716797
sim_compute_sim_state_max0.01583096742630005
sim_compute_sim_state_mean0.014657147526741026
sim_compute_sim_state_median0.01504123369852702
sim_compute_sim_state_min0.012715155283610028
sim_render-ego_max0.007261853218078613
sim_render-ego_mean0.007024649182955424
sim_render-ego_median0.007067884206771851
sim_render-ego_min0.006700975100199381
simulation-passed1
step_physics_max0.08671303749084473
step_physics_mean0.07984113276004791
step_physics_median0.07998405734697978
step_physics_min0.07268337885538736
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
364506841Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3687333295268562
survival_time_median14.950000000000076
deviation-center-line_median0.5251514178573204
in-drivable-lane_median4.32500000000004


other stats
agent_compute-ego_max0.025199363231658937
agent_compute-ego_mean0.02328572948773702
agent_compute-ego_median0.023165229161580404
agent_compute-ego_min0.021613096396128337
complete-iteration_max0.20878860076268513
complete-iteration_mean0.2042272583643595
complete-iteration_median0.20288789709409075
complete-iteration_min0.20234463850657144
deviation-center-line_max1.0770760643666366
deviation-center-line_mean0.6296635559421622
deviation-center-line_min0.3912753236873716
deviation-heading_max2.79756752334694
deviation-heading_mean1.9465287937648443
deviation-heading_median1.973012366881856
deviation-heading_min1.0425229179487243
driven_any_max2.0420997447730302
driven_any_mean2.040435463434673
driven_any_median2.0420941575686573
driven_any_min2.035453793828347
driven_lanedir_consec_max1.8592155829167551
driven_lanedir_consec_mean1.306892386032072
driven_lanedir_consec_min0.6308873021578211
driven_lanedir_max1.8592155829167551
driven_lanedir_mean1.306892386032072
driven_lanedir_median1.3687333295268562
driven_lanedir_min0.6308873021578211
get_state_dump_max0.017870944341023765
get_state_dump_mean0.016827273766199746
get_state_dump_median0.01684659719467163
get_state_dump_min0.015744956334431966
get_ui_image_max0.032913587888081866
get_ui_image_mean0.03168622593084971
get_ui_image_median0.0315215524037679
get_ui_image_min0.03078821102778117
in-drivable-lane_max9.10000000000009
in-drivable-lane_mean4.737500000000047
in-drivable-lane_min1.200000000000017
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.035453793828347, "get_ui_image": 0.032074716091156, "step_physics": 0.08584664106369018, "survival_time": 14.950000000000076, "driven_lanedir": 0.913831993178361, "get_state_dump": 0.016477722326914468, "sim_render-ego": 0.007178920904795329, "in-drivable-lane": 7.15000000000006, "agent_compute-ego": 0.0221412722269694, "deviation-heading": 2.79756752334694, "complete-iteration": 0.20878860076268513, "set_robot_commands": 0.005231692790985108, "deviation-center-line": 0.6251042383195642, "driven_lanedir_consec": 0.913831993178361, "sim_compute_sim_state": 0.017580564816792807, "sim_compute_performance-ego": 0.004813786347707113, "sim_compute_robot_state-ego": 0.009073482354482016, "sim_compute_robot_state-parked0": 0.008184765974680583}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.0420997447730302, "get_ui_image": 0.032913587888081866, "step_physics": 0.08420990546544393, "survival_time": 14.950000000000076, "driven_lanedir": 1.8236346658753513, "get_state_dump": 0.015744956334431966, "sim_render-ego": 0.006617082754770915, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.021613096396128337, "deviation-heading": 1.0425229179487243, "complete-iteration": 0.2030779631932577, "set_robot_commands": 0.005250341892242431, "deviation-center-line": 1.0770760643666366, "driven_lanedir_consec": 1.8236346658753513, "sim_compute_sim_state": 0.01626989682515462, "sim_compute_performance-ego": 0.004305002689361573, "sim_compute_robot_state-ego": 0.007899836699167887, "sim_compute_robot_state-parked0": 0.008071549733479818}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.042089077761173, "get_ui_image": 0.0309683887163798, "step_physics": 0.07371174017588297, "survival_time": 14.950000000000076, "driven_lanedir": 0.6308873021578211, "get_state_dump": 0.017870944341023765, "sim_render-ego": 0.007611889839172364, "in-drivable-lane": 9.10000000000009, "agent_compute-ego": 0.025199363231658937, "deviation-heading": 2.677389399530581, "complete-iteration": 0.20234463850657144, "set_robot_commands": 0.006773567199707032, "deviation-center-line": 0.3912753236873716, "driven_lanedir_consec": 0.6308873021578211, "sim_compute_sim_state": 0.014616672992706298, "sim_compute_performance-ego": 0.005042785803476969, "sim_compute_robot_state-ego": 0.010873496532440186, "sim_compute_robot_state-parked0": 0.009481629530588788}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.0420992373761417, "get_ui_image": 0.03078821102778117, "step_physics": 0.07942358175913493, "survival_time": 14.950000000000076, "driven_lanedir": 1.8592155829167551, "get_state_dump": 0.017215472062428794, "sim_render-ego": 0.006823492050170898, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.024189186096191407, "deviation-heading": 1.2686353342331314, "complete-iteration": 0.20269783099492392, "set_robot_commands": 0.0055430094401041664, "deviation-center-line": 0.42519859739507665, "driven_lanedir_consec": 1.8592155829167551, "sim_compute_sim_state": 0.0168543807665507, "sim_compute_performance-ego": 0.004608210722605388, "sim_compute_robot_state-ego": 0.008422729969024658, "sim_compute_robot_state-parked0": 0.008637781937917073}}
set_robot_commands_max0.006773567199707032
set_robot_commands_mean0.005699652830759684
set_robot_commands_median0.005396675666173299
set_robot_commands_min0.005231692790985108
sim_compute_performance-ego_max0.005042785803476969
sim_compute_performance-ego_mean0.00469244639078776
sim_compute_performance-ego_median0.00471099853515625
sim_compute_performance-ego_min0.004305002689361573
sim_compute_robot_state-ego_max0.010873496532440186
sim_compute_robot_state-ego_mean0.009067386388778688
sim_compute_robot_state-ego_median0.008748106161753337
sim_compute_robot_state-ego_min0.007899836699167887
sim_compute_robot_state-parked0_max0.009481629530588788
sim_compute_robot_state-parked0_mean0.008593931794166565
sim_compute_robot_state-parked0_median0.008411273956298829
sim_compute_robot_state-parked0_min0.008071549733479818
sim_compute_sim_state_max0.017580564816792807
sim_compute_sim_state_mean0.016330378850301107
sim_compute_sim_state_median0.01656213879585266
sim_compute_sim_state_min0.014616672992706298
sim_render-ego_max0.007611889839172364
sim_render-ego_mean0.0070578463872273765
sim_render-ego_median0.007001206477483113
sim_render-ego_min0.006617082754770915
simulation-passed1
step_physics_max0.08584664106369018
step_physics_mean0.080797967116038
step_physics_median0.08181674361228944
step_physics_min0.07371174017588297
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
364426847Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:08:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6809969988781701
survival_time_median14.950000000000076
deviation-center-line_median0.28748807106278745
in-drivable-lane_median8.200000000000093


other stats
agent_compute-ego_max0.024414403438568114
agent_compute-ego_mean0.022981676256984745
agent_compute-ego_median0.023161030603111334
agent_compute-ego_min0.021190240383148193
complete-iteration_max0.20142870903015136
complete-iteration_mean0.19612494228447613
complete-iteration_median0.19724501927693688
complete-iteration_min0.18858102155387949
deviation-center-line_max0.38491656808337327
deviation-center-line_mean0.29283638386832805
deviation-center-line_min0.211452825264364
deviation-heading_max1.299407467393496
deviation-heading_mean1.0862983954102188
deviation-heading_median1.0369305633696009
deviation-heading_min0.9719249875081772
driven_any_max1.939978372137649
driven_any_mean1.8039719101904197
driven_any_median1.9368231011065504
driven_any_min1.4022630664109288
driven_lanedir_consec_max0.8980619694704586
driven_lanedir_consec_mean0.6561414094956353
driven_lanedir_consec_min0.36450967075574225
driven_lanedir_max0.8980619694704586
driven_lanedir_mean0.6561414094956353
driven_lanedir_median0.6809969988781701
driven_lanedir_min0.36450967075574225
get_state_dump_max0.017682397037471105
get_state_dump_mean0.016464745518993528
get_state_dump_median0.016384572585423786
get_state_dump_min0.015407439867655436
get_ui_image_max0.031790711879730225
get_ui_image_mean0.031185509358341905
get_ui_image_median0.031185117949039564
get_ui_image_min0.03058108965555827
in-drivable-lane_max11.65000000000008
in-drivable-lane_mean8.487500000000075
in-drivable-lane_min5.90000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933669124273523, "get_ui_image": 0.03151353359222412, "step_physics": 0.07826412359873454, "survival_time": 14.950000000000076, "driven_lanedir": 0.36450967075574225, "get_state_dump": 0.01551367441813151, "sim_render-ego": 0.007060123284657796, "in-drivable-lane": 11.65000000000008, "agent_compute-ego": 0.02217099189758301, "deviation-heading": 0.9719249875081772, "complete-iteration": 0.19857531468073528, "set_robot_commands": 0.005440446535746256, "deviation-center-line": 0.2124036825006055, "driven_lanedir_consec": 0.36450967075574225, "sim_compute_sim_state": 0.016383067766825358, "sim_compute_performance-ego": 0.004704329967498779, "sim_compute_robot_state-ego": 0.009219258626302084, "sim_compute_robot_state-parked0": 0.008123122056325276}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.939977077939578, "get_ui_image": 0.031790711879730225, "step_physics": 0.07785951296488444, "survival_time": 14.950000000000076, "driven_lanedir": 0.8980619694704586, "get_state_dump": 0.015407439867655436, "sim_render-ego": 0.006828378836313883, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.021190240383148193, "deviation-heading": 1.299407467393496, "complete-iteration": 0.19591472387313844, "set_robot_commands": 0.005397787094116211, "deviation-center-line": 0.38491656808337327, "driven_lanedir_consec": 0.8980619694704586, "sim_compute_sim_state": 0.015515206654866536, "sim_compute_performance-ego": 0.0046528061230977375, "sim_compute_robot_state-ego": 0.008933266798655193, "sim_compute_robot_state-parked0": 0.00815738836924235}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.4022630664109288, "get_ui_image": 0.030856702305855008, "step_physics": 0.07074358594526939, "survival_time": 10.90000000000002, "driven_lanedir": 0.5923701618075237, "get_state_dump": 0.017682397037471105, "sim_render-ego": 0.006686921513408696, "in-drivable-lane": 5.90000000000003, "agent_compute-ego": 0.024151069308639667, "deviation-heading": 1.012775337093666, "complete-iteration": 0.18858102155387949, "set_robot_commands": 0.005228629899681161, "deviation-center-line": 0.211452825264364, "driven_lanedir_consec": 0.5923701618075237, "sim_compute_sim_state": 0.012330275063120993, "sim_compute_performance-ego": 0.004499571039042341, "sim_compute_robot_state-ego": 0.00789484190284659, "sim_compute_robot_state-parked0": 0.008316154873699223}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939978372137649, "get_ui_image": 0.03058108965555827, "step_physics": 0.08058622360229492, "survival_time": 14.950000000000076, "driven_lanedir": 0.7696238359488166, "get_state_dump": 0.017255470752716065, "sim_render-ego": 0.006779670715332031, "in-drivable-lane": 8.700000000000092, "agent_compute-ego": 0.024414403438568114, "deviation-heading": 1.0610857896455357, "complete-iteration": 0.20142870903015136, "set_robot_commands": 0.005280222892761231, "deviation-center-line": 0.36257245962496937, "driven_lanedir_consec": 0.7696238359488166, "sim_compute_sim_state": 0.015526951948801677, "sim_compute_performance-ego": 0.004467544555664063, "sim_compute_robot_state-ego": 0.007976571718851725, "sim_compute_robot_state-parked0": 0.008370209534962971}}
set_robot_commands_max0.005440446535746256
set_robot_commands_mean0.005336771605576215
set_robot_commands_median0.005339004993438721
set_robot_commands_min0.005228629899681161
sim_compute_performance-ego_max0.004704329967498779
sim_compute_performance-ego_mean0.0045810629213257304
sim_compute_performance-ego_median0.0045761885810700394
sim_compute_performance-ego_min0.004467544555664063
sim_compute_robot_state-ego_max0.009219258626302084
sim_compute_robot_state-ego_mean0.008505984761663898
sim_compute_robot_state-ego_median0.008454919258753458
sim_compute_robot_state-ego_min0.00789484190284659
sim_compute_robot_state-parked0_max0.008370209534962971
sim_compute_robot_state-parked0_mean0.008241718708557456
sim_compute_robot_state-parked0_median0.008236771621470787
sim_compute_robot_state-parked0_min0.008123122056325276
sim_compute_sim_state_max0.016383067766825358
sim_compute_sim_state_mean0.01493887535840364
sim_compute_sim_state_median0.015521079301834106
sim_compute_sim_state_min0.012330275063120993
sim_render-ego_max0.007060123284657796
sim_render-ego_mean0.006838773587428102
sim_render-ego_median0.006804024775822957
sim_render-ego_min0.006686921513408696
simulation-passed1
step_physics_max0.08058622360229492
step_physics_mean0.07686336152779583
step_physics_median0.0780618182818095
step_physics_min0.07074358594526939
survival_time_max14.950000000000076
survival_time_mean13.937500000000064
survival_time_min10.90000000000002
No reset possible
364346852Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:09:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9517780447233517
survival_time_median14.275000000000068
deviation-center-line_median0.6569773329682307
in-drivable-lane_median2.0250000000000288


other stats
agent_compute-ego_max0.02399855613708496
agent_compute-ego_mean0.022811657266417627
agent_compute-ego_median0.02292224422414995
agent_compute-ego_min0.021403584480285644
complete-iteration_max0.2015270034472148
complete-iteration_mean0.19751665777743965
complete-iteration_median0.19945899790992924
complete-iteration_min0.1896216318426854
deviation-center-line_max0.9538917417135516
deviation-center-line_mean0.6662935620291478
deviation-center-line_min0.3973278404665783
deviation-heading_max2.6653846686126825
deviation-heading_mean2.0356256198571594
deviation-heading_median2.1529513376080316
deviation-heading_min1.1712151355998917
driven_any_max3.021189290730477
driven_any_mean2.811675525624768
driven_any_median2.885185085233309
driven_any_min2.4551426413019755
driven_lanedir_consec_max2.633060539975169
driven_lanedir_consec_mean1.911607079843857
driven_lanedir_consec_min1.1098116899535553
driven_lanedir_max2.633060539975169
driven_lanedir_mean2.1656730971145923
driven_lanedir_median2.3085807303462396
driven_lanedir_min1.412470387790722
get_state_dump_max0.017549107869466146
get_state_dump_mean0.016789164242567697
get_state_dump_median0.016868830715461726
get_state_dump_min0.015869887669881184
get_ui_image_max0.03192292416796965
get_ui_image_mean0.031701398984420745
get_ui_image_median0.03175293521893768
get_ui_image_min0.03137680133183797
in-drivable-lane_max6.250000000000076
in-drivable-lane_mean2.900000000000036
in-drivable-lane_min1.3000000000000087
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.749183110794648, "get_ui_image": 0.03192292416796965, "step_physics": 0.07725031060331009, "survival_time": 13.600000000000058, "driven_lanedir": 1.412470387790722, "get_state_dump": 0.016454445965149823, "sim_render-ego": 0.007158630034502815, "in-drivable-lane": 6.250000000000076, "agent_compute-ego": 0.022386187139679405, "deviation-heading": 1.1712151355998917, "complete-iteration": 0.20101498417994557, "set_robot_commands": 0.0054819347227320955, "deviation-center-line": 0.3973278404665783, "driven_lanedir_consec": 1.412470387790722, "sim_compute_sim_state": 0.017740914926809424, "sim_compute_performance-ego": 0.004793664988349466, "sim_compute_robot_state-ego": 0.009286192410132465, "sim_compute_robot_state-parked0": 0.008362111799857196}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0211870596719703, "get_ui_image": 0.031761215527852375, "step_physics": 0.07658429940541585, "survival_time": 14.950000000000076, "driven_lanedir": 2.4910857016559818, "get_state_dump": 0.015869887669881184, "sim_render-ego": 0.00700563907623291, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.021403584480285644, "deviation-heading": 2.6653846686126825, "complete-iteration": 0.19790301163991292, "set_robot_commands": 0.005797320206960042, "deviation-center-line": 0.8388636560176002, "driven_lanedir_consec": 2.4910857016559818, "sim_compute_sim_state": 0.016671707630157472, "sim_compute_performance-ego": 0.0047956395149230955, "sim_compute_robot_state-ego": 0.009534033934275307, "sim_compute_robot_state-parked0": 0.008303879896799723}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4551426413019755, "get_ui_image": 0.03174465491002299, "step_physics": 0.07216565542487034, "survival_time": 12.550000000000043, "driven_lanedir": 2.126075759036497, "get_state_dump": 0.017283215465773626, "sim_render-ego": 0.006711221786134271, "in-drivable-lane": 1.3000000000000087, "agent_compute-ego": 0.023458301308620495, "deviation-heading": 2.2954353846000366, "complete-iteration": 0.1896216318426854, "set_robot_commands": 0.005066204830944775, "deviation-center-line": 0.4750910099188611, "driven_lanedir_consec": 1.1098116899535553, "sim_compute_sim_state": 0.012235774461966586, "sim_compute_performance-ego": 0.004522547778855282, "sim_compute_robot_state-ego": 0.007932037946237511, "sim_compute_robot_state-parked0": 0.008318295991753202}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.021189290730477, "get_ui_image": 0.03137680133183797, "step_physics": 0.07881160736083985, "survival_time": 14.950000000000076, "driven_lanedir": 2.633060539975169, "get_state_dump": 0.017549107869466146, "sim_render-ego": 0.00679155429204305, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.02399855613708496, "deviation-heading": 2.0104672906160266, "complete-iteration": 0.2015270034472148, "set_robot_commands": 0.0051766578356424965, "deviation-center-line": 0.9538917417135516, "driven_lanedir_consec": 2.633060539975169, "sim_compute_sim_state": 0.016680901845296223, "sim_compute_performance-ego": 0.004467373689015707, "sim_compute_robot_state-ego": 0.008142916361490886, "sim_compute_robot_state-parked0": 0.008329832553863525}}
set_robot_commands_max0.005797320206960042
set_robot_commands_mean0.005380529399069853
set_robot_commands_median0.0053292962791872955
set_robot_commands_min0.005066204830944775
sim_compute_performance-ego_max0.0047956395149230955
sim_compute_performance-ego_mean0.004644806492785888
sim_compute_performance-ego_median0.004658106383602374
sim_compute_performance-ego_min0.004467373689015707
sim_compute_robot_state-ego_max0.009534033934275307
sim_compute_robot_state-ego_mean0.008723795163034044
sim_compute_robot_state-ego_median0.008714554385811675
sim_compute_robot_state-ego_min0.007932037946237511
sim_compute_robot_state-parked0_max0.008362111799857196
sim_compute_robot_state-parked0_mean0.008328530060568412
sim_compute_robot_state-parked0_median0.008324064272808364
sim_compute_robot_state-parked0_min0.008303879896799723
sim_compute_sim_state_max0.017740914926809424
sim_compute_sim_state_mean0.015832324716057427
sim_compute_sim_state_median0.016676304737726848
sim_compute_sim_state_min0.012235774461966586
sim_render-ego_max0.007158630034502815
sim_render-ego_mean0.0069167612972282615
sim_render-ego_median0.0068985966841379805
sim_render-ego_min0.006711221786134271
simulation-passed1
step_physics_max0.07881160736083985
step_physics_mean0.07620296819860904
step_physics_median0.07691730500436297
step_physics_min0.07216565542487034
survival_time_max14.950000000000076
survival_time_mean14.012500000000063
survival_time_min12.550000000000043
No reset possible
364339223Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9223/LFv-sim-Sandy1-sandy-1-job36433-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364329223Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9223/LFv-sim-Sandy1-sandy-1-job36432-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364299228Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9228/LFv-sim-Sandy1-sandy-1-job36429-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364289231Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9231/LFv-sim-Sandy1-sandy-1-job36428-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364259231Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9231/LFv-sim-Sandy1-sandy-1-job36425-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364239232Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9232/LFv-sim-Sandy1-sandy-1-job36423-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364199236Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9236/LFv-sim-Sandy1-sandy-1-job36419-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364169236Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9236/LFv-sim-Sandy1-sandy-1-job36416-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364129237Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9237/LFv-sim-Sandy1-sandy-1-job36412-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364119240Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9240/LFv-sim-Sandy1-sandy-1-job36411-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364089241Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9241/LFv-sim-Sandy1-sandy-1-job36408-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364079242Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9242/LFv-sim-Sandy1-sandy-1-job36407-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364059243Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9243/LFv-sim-Sandy1-sandy-1-job36405-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364039247Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9247/LFv-sim-Sandy1-sandy-1-job36403-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
364019249Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9249/LFv-sim-Sandy1-sandy-1-job36401-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363989250Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9250/LFv-sim-Sandy1-sandy-1-job36398-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363949254Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9254/LFv-sim-Sandy1-sandy-1-job36394-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363919256Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9256/LFv-sim-Sandy1-sandy-1-job36391-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363899257Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9257/LFv-sim-Sandy1-sandy-1-job36389-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363889260Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9260/LFv-sim-Sandy1-sandy-1-job36388-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363879260Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9260/LFv-sim-Sandy1-sandy-1-job36387-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363869261Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9261/LFv-sim-Sandy1-sandy-1-job36386-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363859263Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9263/LFv-sim-Sandy1-sandy-1-job36385-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363839263Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9263/LFv-sim-Sandy1-sandy-1-job36383-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363769272Liam Paull 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5387881421581096
survival_time_median2.9999999999999973
deviation-center-line_median0.2115887041334896
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.02342533831502877
agent_compute-ego_mean0.02196981072207764
agent_compute-ego_median0.02214599948847431
agent_compute-ego_min0.020161905596333164
complete-iteration_max0.20328917602698007
complete-iteration_mean0.1949607672710085
complete-iteration_median0.19669730990540743
complete-iteration_min0.18315927324623896
deviation-center-line_max0.22280075812953196
deviation-center-line_mean0.19700282922119663
deviation-center-line_min0.1420331504882753
deviation-heading_max1.2435733836541376
deviation-heading_mean0.5967115435301101
deviation-heading_median0.4294925186296136
deviation-heading_min0.28428775320707594
driven_any_max3.09493999067409
driven_any_mean1.2986340202645676
driven_any_median0.7780149893397109
driven_any_min0.543566111704759
driven_lanedir_consec_max0.5940300689017812
driven_lanedir_consec_mean0.5260388514825709
driven_lanedir_consec_min0.4325490527122835
driven_lanedir_max0.5940300689017812
driven_lanedir_mean0.5260388514825709
driven_lanedir_median0.5387881421581096
driven_lanedir_min0.4325490527122835
get_state_dump_max0.01688715096177726
get_state_dump_mean0.016280108891391278
get_state_dump_median0.016416893139773722
get_state_dump_min0.015399498324240408
get_ui_image_max0.03452491760253906
get_ui_image_mean0.03204778870413505
get_ui_image_median0.03180573532884442
get_ui_image_min0.0300547665563123
in-drivable-lane_max7.800000000000011
in-drivable-lane_mean2.362500000000001
in-drivable-lane_min0.34999999999999876
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.543566111704759, "get_ui_image": 0.03452491760253906, "step_physics": 0.079181174437205, "survival_time": 2.3999999999999995, "driven_lanedir": 0.4325490527122835, "get_state_dump": 0.016406272848447163, "sim_render-ego": 0.006776213645935059, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.021816785136858623, "deviation-heading": 0.4368439188077579, "complete-iteration": 0.20328917602698007, "set_robot_commands": 0.005642031629880269, "deviation-center-line": 0.1420331504882753, "driven_lanedir_consec": 0.4325490527122835, "sim_compute_sim_state": 0.016581545273462932, "sim_compute_performance-ego": 0.004780317346254985, "sim_compute_robot_state-ego": 0.009017551938692728, "sim_compute_robot_state-parked0": 0.008401796221733093}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.786886060822892, "get_ui_image": 0.0300547665563123, "step_physics": 0.06719433028122475, "survival_time": 2.8999999999999977, "driven_lanedir": 0.5940300689017812, "get_state_dump": 0.01688715096177726, "sim_render-ego": 0.0067451863453306, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.022475213840089995, "deviation-heading": 0.4221411184514693, "complete-iteration": 0.18315927324623896, "set_robot_commands": 0.0049382324876456425, "deviation-center-line": 0.22280075812953196, "driven_lanedir_consec": 0.5940300689017812, "sim_compute_sim_state": 0.014798411007585196, "sim_compute_performance-ego": 0.0044842218530589135, "sim_compute_robot_state-ego": 0.0076746365119671, "sim_compute_robot_state-parked0": 0.007739235614908153}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.09493999067409, "get_ui_image": 0.03145061170353609, "step_physics": 0.0748273531595866, "survival_time": 10.20000000000001, "driven_lanedir": 0.4986372495309906, "get_state_dump": 0.016427513431100285, "sim_render-ego": 0.007094525823406144, "in-drivable-lane": 7.800000000000011, "agent_compute-ego": 0.02342533831502877, "deviation-heading": 1.2435733836541376, "complete-iteration": 0.195287496435876, "set_robot_commands": 0.005495635902180392, "deviation-center-line": 0.21779672482809767, "driven_lanedir_consec": 0.4986372495309906, "sim_compute_sim_state": 0.01388477461010802, "sim_compute_performance-ego": 0.00461966266819075, "sim_compute_robot_state-ego": 0.009372050855673997, "sim_compute_robot_state-parked0": 0.008524980030807794}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.7691439178565298, "get_ui_image": 0.03216085895415275, "step_physics": 0.08281833125698951, "survival_time": 3.099999999999997, "driven_lanedir": 0.5789390347852286, "get_state_dump": 0.015399498324240408, "sim_render-ego": 0.006584517417415496, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.020161905596333164, "deviation-heading": 0.28428775320707594, "complete-iteration": 0.19810712337493896, "set_robot_commands": 0.005061418779434696, "deviation-center-line": 0.2053806834388816, "driven_lanedir_consec": 0.5789390347852286, "sim_compute_sim_state": 0.015444905527176396, "sim_compute_performance-ego": 0.004182446387506301, "sim_compute_robot_state-ego": 0.00797198280211418, "sim_compute_robot_state-parked0": 0.008157507065803773}}
set_robot_commands_max0.005642031629880269
set_robot_commands_mean0.00528432969978525
set_robot_commands_median0.0052785273408075435
set_robot_commands_min0.0049382324876456425
sim_compute_performance-ego_max0.004780317346254985
sim_compute_performance-ego_mean0.004516662063752737
sim_compute_performance-ego_median0.004551942260624832
sim_compute_performance-ego_min0.004182446387506301
sim_compute_robot_state-ego_max0.009372050855673997
sim_compute_robot_state-ego_mean0.008509055527112001
sim_compute_robot_state-ego_median0.008494767370403455
sim_compute_robot_state-ego_min0.0076746365119671
sim_compute_robot_state-parked0_max0.008524980030807794
sim_compute_robot_state-parked0_mean0.008205879733313203
sim_compute_robot_state-parked0_median0.008279651643768433
sim_compute_robot_state-parked0_min0.007739235614908153
sim_compute_sim_state_max0.016581545273462932
sim_compute_sim_state_mean0.015177409104583137
sim_compute_sim_state_median0.015121658267380798
sim_compute_sim_state_min0.01388477461010802
sim_render-ego_max0.007094525823406144
sim_render-ego_mean0.006800110808021825
sim_render-ego_median0.00676069999563283
sim_render-ego_min0.006584517417415496
simulation-passed1
step_physics_max0.08281833125698951
step_physics_mean0.07600529728375147
step_physics_median0.0770042637983958
step_physics_min0.06719433028122475
survival_time_max10.20000000000001
survival_time_mean4.650000000000001
survival_time_min2.3999999999999995
No reset possible
363739273Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9273/LFv-sim-Sandy1-sandy-1-job36373-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363709276Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9276/LFv-sim-Sandy1-sandy-1-job36370-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363679276Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9276/LFv-sim-Sandy1-sandy-1-job36367-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363659278Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9278/LFv-sim-Sandy1-sandy-1-job36365-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363649280Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9280/LFv-sim-Sandy1-sandy-1-job36364-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363609283Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9283/LFv-sim-Sandy1-sandy-1-job36360-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363579286Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9286/LFv-sim-Sandy1-sandy-1-job36357-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363559287Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9287/LFv-sim-Sandy1-sandy-1-job36355-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363539288Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9288/LFv-sim-Sandy1-sandy-1-job36353-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363519295Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9295/LFv-sim-Sandy1-sandy-1-job36351-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363499299Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9299/LFv-sim-Sandy1-sandy-1-job36349-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363449302Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9302/LFv-sim-Sandy1-sandy-1-job36344-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363439303Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9303/LFv-sim-Sandy1-sandy-1-job36343-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363419308Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9308/LFv-sim-Sandy1-sandy-1-job36341-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3633410005Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:09:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7865747753696084
survival_time_median14.950000000000076
deviation-center-line_median0.9248005845910052
in-drivable-lane_median0.15000000000000213


other stats
agent_compute-ego_max0.022534638245900473
agent_compute-ego_mean0.02215823411941529
agent_compute-ego_median0.022172316710154218
agent_compute-ego_min0.02175366481145223
complete-iteration_max0.2033998950322469
complete-iteration_mean0.20197921653588613
complete-iteration_median0.2019281776746114
complete-iteration_min0.2006606157620748
deviation-center-line_max1.03863130240961
deviation-center-line_mean0.8988203790193341
deviation-center-line_min0.7070490444857158
deviation-heading_max2.175103572991605
deviation-heading_mean1.4720053116893124
deviation-heading_median1.4431848440898956
deviation-heading_min0.8265479855858536
driven_any_max2.858917453940258
driven_any_mean2.856561923290679
driven_any_median2.8588571530972624
driven_any_min2.849615933027933
driven_lanedir_consec_max2.8434643398038215
driven_lanedir_consec_mean2.73587048287551
driven_lanedir_consec_min2.526868040959002
driven_lanedir_max2.8434643398038215
driven_lanedir_mean2.73587048287551
driven_lanedir_median2.7865747753696084
driven_lanedir_min2.526868040959002
get_state_dump_max0.01612511157989502
get_state_dump_mean0.015900956988334655
get_state_dump_median0.015908315181732177
get_state_dump_min0.01566208600997925
get_ui_image_max0.03282865285873413
get_ui_image_mean0.032632625500361126
get_ui_image_median0.032691010634104414
get_ui_image_min0.03231982787450154
in-drivable-lane_max1.3500000000000192
in-drivable-lane_mean0.41250000000000586
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.849615933027933, "get_ui_image": 0.03280263423919678, "step_physics": 0.07846295197804769, "survival_time": 14.950000000000076, "driven_lanedir": 2.839874739478641, "get_state_dump": 0.01566208600997925, "sim_render-ego": 0.0069171539942423504, "in-drivable-lane": 0.0, "agent_compute-ego": 0.022534638245900473, "deviation-heading": 0.8265479855858536, "complete-iteration": 0.20245169480641684, "set_robot_commands": 0.0058531888326009114, "deviation-center-line": 0.9807582715106468, "driven_lanedir_consec": 2.839874739478641, "sim_compute_sim_state": 0.017469252745310467, "sim_compute_performance-ego": 0.004673070112864177, "sim_compute_robot_state-ego": 0.009334911505381266, "sim_compute_robot_state-parked0": 0.008561790784200033}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.8588919297192175, "get_ui_image": 0.032579387029012044, "step_physics": 0.07942944606145223, "survival_time": 14.950000000000076, "driven_lanedir": 2.733274811260576, "get_state_dump": 0.01612511157989502, "sim_render-ego": 0.007158652941385905, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.022137343883514404, "deviation-heading": 1.988340038672055, "complete-iteration": 0.2033998950322469, "set_robot_commands": 0.005815462271372477, "deviation-center-line": 0.7070490444857158, "driven_lanedir_consec": 2.733274811260576, "sim_compute_sim_state": 0.016531070868174236, "sim_compute_performance-ego": 0.004854098161061604, "sim_compute_robot_state-ego": 0.009972469011942544, "sim_compute_robot_state-parked0": 0.008617196083068848}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8588223764753073, "get_ui_image": 0.03282865285873413, "step_physics": 0.08030722379684448, "survival_time": 14.950000000000076, "driven_lanedir": 2.526868040959002, "get_state_dump": 0.01580439805984497, "sim_render-ego": 0.007025526364644368, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.022207289536794027, "deviation-heading": 2.175103572991605, "complete-iteration": 0.2006606157620748, "set_robot_commands": 0.005611604849497478, "deviation-center-line": 0.8688428976713639, "driven_lanedir_consec": 2.526868040959002, "sim_compute_sim_state": 0.014190911451975504, "sim_compute_performance-ego": 0.0047712190945943195, "sim_compute_robot_state-ego": 0.009400169849395752, "sim_compute_robot_state-parked0": 0.008335596720377604}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.858917453940258, "get_ui_image": 0.03231982787450154, "step_physics": 0.08308620770772299, "survival_time": 14.950000000000076, "driven_lanedir": 2.8434643398038215, "get_state_dump": 0.016012232303619384, "sim_render-ego": 0.0066440327962239585, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02175366481145223, "deviation-heading": 0.8980296495077359, "complete-iteration": 0.201404660542806, "set_robot_commands": 0.005082132021586101, "deviation-center-line": 1.03863130240961, "driven_lanedir_consec": 2.8434643398038215, "sim_compute_sim_state": 0.016312048435211182, "sim_compute_performance-ego": 0.004428159395853678, "sim_compute_robot_state-ego": 0.007578561305999756, "sim_compute_robot_state-parked0": 0.0080088742574056}}
set_robot_commands_max0.0058531888326009114
set_robot_commands_mean0.005590596993764242
set_robot_commands_median0.005713533560434978
set_robot_commands_min0.005082132021586101
sim_compute_performance-ego_max0.004854098161061604
sim_compute_performance-ego_mean0.004681636691093444
sim_compute_performance-ego_median0.004722144603729248
sim_compute_performance-ego_min0.004428159395853678
sim_compute_robot_state-ego_max0.009972469011942544
sim_compute_robot_state-ego_mean0.00907152791817983
sim_compute_robot_state-ego_median0.009367540677388509
sim_compute_robot_state-ego_min0.007578561305999756
sim_compute_robot_state-parked0_max0.008617196083068848
sim_compute_robot_state-parked0_mean0.008380864461263023
sim_compute_robot_state-parked0_median0.008448693752288818
sim_compute_robot_state-parked0_min0.0080088742574056
sim_compute_sim_state_max0.017469252745310467
sim_compute_sim_state_mean0.016125820875167847
sim_compute_sim_state_median0.01642155965169271
sim_compute_sim_state_min0.014190911451975504
sim_render-ego_max0.007158652941385905
sim_render-ego_mean0.0069363415241241455
sim_render-ego_median0.006971340179443359
sim_render-ego_min0.0066440327962239585
simulation-passed1
step_physics_max0.08308620770772299
step_physics_mean0.08032145738601684
step_physics_median0.07986833492914835
step_physics_min0.07846295197804769
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
363329312Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9312/LFv-sim-Sandy1-sandy-1-job36332-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363279313Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9313/LFv-sim-Sandy1-sandy-1-job36327-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363249315Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9315/LFv-sim-Sandy1-sandy-1-job36324-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363229317Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9317/LFv-sim-Sandy1-sandy-1-job36322-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363199319Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9319/LFv-sim-Sandy1-sandy-1-job36319-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363149323Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9323/LFv-sim-Sandy1-sandy-1-job36314-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363119323Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9323/LFv-sim-Sandy1-sandy-1-job36311-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363099325Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9325/LFv-sim-Sandy1-sandy-1-job36309-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363069331Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9331/LFv-sim-Sandy1-sandy-1-job36306-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363049334Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:01:01
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9334/LFv-sim-Sandy1-sandy-1-job36304-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
363009334Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9334/LFv-sim-Sandy1-sandy-1-job36300-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362969336Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9336/LFv-sim-Sandy1-sandy-1-job36296-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362949337Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:01:06
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9337/LFv-sim-Sandy1-sandy-1-job36294-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362929338Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:01:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9338/LFv-sim-Sandy1-sandy-1-job36292-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362909339Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9339/LFv-sim-Sandy1-sandy-1-job36290-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362889340Jerome Labonte 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:01:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9340/LFv-sim-Sandy1-sandy-1-job36288-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362869342Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:01:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9342/LFv-sim-Sandy1-sandy-1-job36286-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362839349Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:59
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9349/LFv-sim-Sandy1-sandy-1-job36283-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362809354Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:58
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9354/LFv-sim-Sandy1-sandy-1-job36280-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362789358Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:57
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9358/LFv-sim-Sandy1-sandy-1-job36278-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362769359Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:58
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9359/LFv-sim-Sandy1-sandy-1-job36276-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362719360Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:01:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9360/LFv-sim-Sandy1-sandy-1-job36271-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362709362Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:46
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9362/LFv-sim-Sandy1-sandy-1-job36270-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362699363Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9363/LFv-sim-Sandy1-sandy-1-job36269-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362679363Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoSandy1-sandy-10:01:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9363/LFv-sim-Sandy1-sandy-1-job36267-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362659366Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9366/LFv-sim-Sandy1-sandy-1-job36265-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362649366Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9366/LFv-sim-Sandy1-sandy-1-job36264-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362639367Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9367/LFv-sim-Sandy1-sandy-1-job36263-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362599369Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:54
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9369/LFv-sim-Sandy1-sandy-1-job36259-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362579370Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:06:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9223926134230244
survival_time_median9.299999999999995
deviation-center-line_median0.2986156213885245
in-drivable-lane_median3.5750000000000126


other stats
agent_compute-ego_max0.02189478561991737
agent_compute-ego_mean0.02149862542614943
agent_compute-ego_median0.02178509566500532
agent_compute-ego_min0.020529524754669706
complete-iteration_max0.2273022201953906
complete-iteration_mean0.21519296666015852
complete-iteration_median0.21470248102306988
complete-iteration_min0.20406468439910372
deviation-center-line_max0.4897421930144883
deviation-center-line_mean0.2944257463289259
deviation-center-line_min0.0907295495241662
deviation-heading_max1.411993874805973
deviation-heading_mean0.6905931384280879
deviation-heading_median0.475273217389467
deviation-heading_min0.39983224412744456
driven_any_max2.85430048120387
driven_any_mean2.145175380791284
driven_any_median2.498244463752129
driven_any_min0.7299121144570085
driven_lanedir_consec_max1.7765945309447713
driven_lanedir_consec_mean1.0183206663128184
driven_lanedir_consec_min0.45190290746045303
driven_lanedir_max1.7765945309447713
driven_lanedir_mean1.0183206663128184
driven_lanedir_median0.9223926134230244
driven_lanedir_min0.45190290746045303
get_state_dump_max0.015972654966381488
get_state_dump_mean0.015372582485467207
get_state_dump_median0.015278026233092733
get_state_dump_min0.014961622509301878
get_ui_image_max0.03661430165881202
get_ui_image_mean0.035499529838735826
get_ui_image_median0.035805248239870996
get_ui_image_min0.033773321216389283
in-drivable-lane_max7.5000000000000115
in-drivable-lane_mean3.900000000000008
in-drivable-lane_min0.9499999999999966
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.240022122546936, "get_ui_image": 0.03661430165881202, "step_physics": 0.09418757898466928, "survival_time": 8.399999999999984, "driven_lanedir": 1.2140757282365449, "get_state_dump": 0.01513995159239996, "sim_render-ego": 0.006979515155156453, "in-drivable-lane": 3.6499999999999937, "agent_compute-ego": 0.02189478561991737, "deviation-heading": 0.39983224412744456, "complete-iteration": 0.2206223195507413, "set_robot_commands": 0.00561588860693432, "deviation-center-line": 0.42552031561630094, "driven_lanedir_consec": 1.2140757282365449, "sim_compute_sim_state": 0.017824583110355195, "sim_compute_performance-ego": 0.004668005875178746, "sim_compute_robot_state-ego": 0.009093479031608218, "sim_compute_robot_state-parked0": 0.008434245983759562}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.7299121144570085, "get_ui_image": 0.033773321216389283, "step_physics": 0.08640463069333869, "survival_time": 2.9499999999999975, "driven_lanedir": 0.45190290746045303, "get_state_dump": 0.015416100873785504, "sim_render-ego": 0.006469379037113513, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.020529524754669706, "deviation-heading": 0.47031223390133103, "complete-iteration": 0.20406468439910372, "set_robot_commands": 0.004901433395127119, "deviation-center-line": 0.171710927160748, "driven_lanedir_consec": 0.45190290746045303, "sim_compute_sim_state": 0.016254291696063544, "sim_compute_performance-ego": 0.004355180061469644, "sim_compute_robot_state-ego": 0.007727202722581767, "sim_compute_robot_state-parked0": 0.008066460237664691}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7564668049573218, "get_ui_image": 0.035013964363172945, "step_physics": 0.08845025651595172, "survival_time": 10.20000000000001, "driven_lanedir": 0.6307094986095041, "get_state_dump": 0.014961622509301878, "sim_render-ego": 0.007044954627167945, "in-drivable-lane": 7.5000000000000115, "agent_compute-ego": 0.02177802020428227, "deviation-heading": 0.48023420087760293, "complete-iteration": 0.20878264249539844, "set_robot_commands": 0.0058317231196983186, "deviation-center-line": 0.0907295495241662, "driven_lanedir_consec": 0.6307094986095041, "sim_compute_sim_state": 0.012795595561756808, "sim_compute_performance-ego": 0.004643574649212407, "sim_compute_robot_state-ego": 0.009654909956688974, "sim_compute_robot_state-parked0": 0.008437722337012198}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.85430048120387, "get_ui_image": 0.03659653211656905, "step_physics": 0.10058003014297846, "survival_time": 10.550000000000017, "driven_lanedir": 1.7765945309447713, "get_state_dump": 0.015972654966381488, "sim_render-ego": 0.006873956788772655, "in-drivable-lane": 3.500000000000032, "agent_compute-ego": 0.02179217112572837, "deviation-heading": 1.411993874805973, "complete-iteration": 0.2273022201953906, "set_robot_commands": 0.0054701086469171175, "deviation-center-line": 0.4897421930144883, "driven_lanedir_consec": 1.7765945309447713, "sim_compute_sim_state": 0.01828041460841753, "sim_compute_performance-ego": 0.004492971004468005, "sim_compute_robot_state-ego": 0.008554135453644522, "sim_compute_robot_state-parked0": 0.008518168146576362}}
set_robot_commands_max0.0058317231196983186
set_robot_commands_mean0.005454788442169219
set_robot_commands_median0.005542998626925718
set_robot_commands_min0.004901433395127119
sim_compute_performance-ego_max0.004668005875178746
sim_compute_performance-ego_mean0.0045399328975822
sim_compute_performance-ego_median0.004568272826840206
sim_compute_performance-ego_min0.004355180061469644
sim_compute_robot_state-ego_max0.009654909956688974
sim_compute_robot_state-ego_mean0.00875743179113087
sim_compute_robot_state-ego_median0.00882380724262637
sim_compute_robot_state-ego_min0.007727202722581767
sim_compute_robot_state-parked0_max0.008518168146576362
sim_compute_robot_state-parked0_mean0.008364149176253203
sim_compute_robot_state-parked0_median0.008435984160385879
sim_compute_robot_state-parked0_min0.008066460237664691
sim_compute_sim_state_max0.01828041460841753
sim_compute_sim_state_mean0.01628872124414827
sim_compute_sim_state_median0.01703943740320937
sim_compute_sim_state_min0.012795595561756808
sim_render-ego_max0.007044954627167945
sim_render-ego_mean0.006841951402052642
sim_render-ego_median0.006926735971964554
sim_render-ego_min0.006469379037113513
simulation-passed1
step_physics_max0.10058003014297846
step_physics_mean0.09240562408423451
step_physics_median0.0913189177503105
step_physics_min0.08640463069333869
survival_time_max10.550000000000017
survival_time_mean8.025000000000002
survival_time_min2.9499999999999975
No reset possible
362529374Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3889619657238377
survival_time_median11.200000000000024
deviation-center-line_median0.5223249093904182
in-drivable-lane_median4.350000000000032


other stats
agent_compute-ego_max0.023395058929279285
agent_compute-ego_mean0.022289305880505553
agent_compute-ego_median0.022270808617273964
agent_compute-ego_min0.021220547358194987
complete-iteration_max0.20596336666494608
complete-iteration_mean0.19992176116844737
complete-iteration_median0.1992608303328355
complete-iteration_min0.19520201734317247
deviation-center-line_max0.5903729422069608
deviation-center-line_mean0.4893127778246304
deviation-center-line_min0.32222835031072444
deviation-heading_max3.5054252681168174
deviation-heading_mean2.2518887196269697
deviation-heading_median2.075582226696658
deviation-heading_min1.3509651569977443
driven_any_max2.8724933149839016
driven_any_mean2.44028489473357
driven_any_median2.4865812598574513
driven_any_min1.915483744235476
driven_lanedir_consec_max1.9221101621193033
driven_lanedir_consec_mean1.5104214637641182
driven_lanedir_consec_min1.3416517614894952
driven_lanedir_max1.9221101621193033
driven_lanedir_mean1.5104214637641182
driven_lanedir_median1.3889619657238377
driven_lanedir_min1.3416517614894952
get_state_dump_max0.017482528122522496
get_state_dump_mean0.01643033561477017
get_state_dump_median0.016315347980707884
get_state_dump_min0.015608118375142416
get_ui_image_max0.03291164835294088
get_ui_image_mean0.03178468690684406
get_ui_image_median0.03214584017793337
get_ui_image_min0.0299354189185686
in-drivable-lane_max8.350000000000072
in-drivable-lane_mean4.725000000000038
in-drivable-lane_min1.8500000000000156
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.915483744235476, "get_ui_image": 0.03291164835294088, "step_physics": 0.0778675302863121, "survival_time": 9.6, "driven_lanedir": 1.4244041537956134, "get_state_dump": 0.01572844386100769, "sim_render-ego": 0.0068998026351133985, "in-drivable-lane": 3.750000000000014, "agent_compute-ego": 0.02135964234670003, "deviation-heading": 1.3509651569977443, "complete-iteration": 0.19897937029600143, "set_robot_commands": 0.0053970540563265485, "deviation-center-line": 0.32222835031072444, "driven_lanedir_consec": 1.4244041537956134, "sim_compute_sim_state": 0.017029458036025364, "sim_compute_performance-ego": 0.004652416954437892, "sim_compute_robot_state-ego": 0.008744001388549805, "sim_compute_robot_state-parked0": 0.008222228537003199}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.7168632438818947, "get_ui_image": 0.032731088002522786, "step_physics": 0.07934647878011068, "survival_time": 14.950000000000076, "driven_lanedir": 1.353519777652061, "get_state_dump": 0.015608118375142416, "sim_render-ego": 0.0067797962824503585, "in-drivable-lane": 8.350000000000072, "agent_compute-ego": 0.021220547358194987, "deviation-heading": 2.635117699579951, "complete-iteration": 0.1995422903696696, "set_robot_commands": 0.005261929035186768, "deviation-center-line": 0.5903729422069608, "driven_lanedir_consec": 1.353519777652061, "sim_compute_sim_state": 0.01678256114323934, "sim_compute_performance-ego": 0.004546017646789551, "sim_compute_robot_state-ego": 0.008960614999135336, "sim_compute_robot_state-parked0": 0.008135986328125}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8724933149839016, "get_ui_image": 0.031560592353343964, "step_physics": 0.08146301750093699, "survival_time": 12.800000000000049, "driven_lanedir": 1.3416517614894952, "get_state_dump": 0.016902252100408077, "sim_render-ego": 0.007345878519117832, "in-drivable-lane": 4.950000000000049, "agent_compute-ego": 0.0231819748878479, "deviation-heading": 3.5054252681168174, "complete-iteration": 0.20596336666494608, "set_robot_commands": 0.006387028843164444, "deviation-center-line": 0.5850233675627299, "driven_lanedir_consec": 1.3416517614894952, "sim_compute_sim_state": 0.014380725100636482, "sim_compute_performance-ego": 0.005022932775318623, "sim_compute_robot_state-ego": 0.010587554425001144, "sim_compute_robot_state-parked0": 0.008955610916018486}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.256299275833008, "get_ui_image": 0.0299354189185686, "step_physics": 0.07558470259430589, "survival_time": 9.299999999999995, "driven_lanedir": 1.9221101621193033, "get_state_dump": 0.017482528122522496, "sim_render-ego": 0.006653892096652779, "in-drivable-lane": 1.8500000000000156, "agent_compute-ego": 0.023395058929279285, "deviation-heading": 1.5160467538133653, "complete-iteration": 0.19520201734317247, "set_robot_commands": 0.005089367589642925, "deviation-center-line": 0.4596264512181066, "driven_lanedir_consec": 1.9221101621193033, "sim_compute_sim_state": 0.01638230841646912, "sim_compute_performance-ego": 0.00445474604124664, "sim_compute_robot_state-ego": 0.007749961268517279, "sim_compute_robot_state-parked0": 0.00829596673288653}}
set_robot_commands_max0.006387028843164444
set_robot_commands_mean0.005533844881080171
set_robot_commands_median0.005329491545756658
set_robot_commands_min0.005089367589642925
sim_compute_performance-ego_max0.005022932775318623
sim_compute_performance-ego_mean0.004669028354448176
sim_compute_performance-ego_median0.0045992173006137215
sim_compute_performance-ego_min0.00445474604124664
sim_compute_robot_state-ego_max0.010587554425001144
sim_compute_robot_state-ego_mean0.00901053302030089
sim_compute_robot_state-ego_median0.00885230819384257
sim_compute_robot_state-ego_min0.007749961268517279
sim_compute_robot_state-parked0_max0.008955610916018486
sim_compute_robot_state-parked0_mean0.008402448128508305
sim_compute_robot_state-parked0_median0.008259097634944864
sim_compute_robot_state-parked0_min0.008135986328125
sim_compute_sim_state_max0.017029458036025364
sim_compute_sim_state_mean0.016143763174092576
sim_compute_sim_state_median0.01658243477985423
sim_compute_sim_state_min0.014380725100636482
sim_render-ego_max0.007345878519117832
sim_render-ego_mean0.006919842383333591
sim_render-ego_median0.0068397994587818785
sim_render-ego_min0.006653892096652779
simulation-passed1
step_physics_max0.08146301750093699
step_physics_mean0.07856543229041642
step_physics_median0.0786070045332114
step_physics_min0.07558470259430589
survival_time_max14.950000000000076
survival_time_mean11.66250000000003
survival_time_min9.299999999999995
No reset possible
362459381Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:10:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4160044882463345
survival_time_median14.950000000000076
deviation-center-line_median0.38066486794549614
in-drivable-lane_median2.325000000000033


other stats
agent_compute-ego_max0.02268853743871053
agent_compute-ego_mean0.022408174872398375
agent_compute-ego_median0.022440407276153564
agent_compute-ego_min0.022063347498575848
complete-iteration_max0.2153352355957031
complete-iteration_mean0.20965424100557967
complete-iteration_median0.21054379026095071
complete-iteration_min0.20219414790471396
deviation-center-line_max0.590884642190142
deviation-center-line_mean0.40277838713222824
deviation-center-line_min0.25889917044777866
deviation-heading_max3.162137950908946
deviation-heading_mean1.9585260308553183
deviation-heading_median1.7470426430209371
deviation-heading_min1.1778808864704533
driven_any_max2.9373464071326567
driven_any_mean2.837545250278557
driven_any_median2.833741778511947
driven_any_min2.745351036957677
driven_lanedir_consec_max2.915930925085552
driven_lanedir_consec_mean2.1033464241415074
driven_lanedir_consec_min0.6654457949878094
driven_lanedir_max2.915930925085552
driven_lanedir_mean2.139095668317427
driven_lanedir_median2.4160044882463345
driven_lanedir_min0.8084427716914862
get_state_dump_max0.016469122568766276
get_state_dump_mean0.01598925471305847
get_state_dump_median0.01604003667831421
get_state_dump_min0.015407822926839192
get_ui_image_max0.033147992293039955
get_ui_image_mean0.032439964016278584
get_ui_image_median0.03224477608998617
get_ui_image_min0.03212231159210205
in-drivable-lane_max8.950000000000092
in-drivable-lane_mean3.400000000000039
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8732164545781855, "get_ui_image": 0.03219881375630697, "step_physics": 0.0887939437230428, "survival_time": 14.950000000000076, "driven_lanedir": 2.8370665571689866, "get_state_dump": 0.016469122568766276, "sim_render-ego": 0.007327994505564372, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02268853743871053, "deviation-heading": 1.918867129468604, "complete-iteration": 0.2153352355957031, "set_robot_commands": 0.005830385684967041, "deviation-center-line": 0.590884642190142, "driven_lanedir_consec": 2.8370665571689866, "sim_compute_sim_state": 0.018187509377797444, "sim_compute_performance-ego": 0.004870701630910238, "sim_compute_robot_state-ego": 0.010123863220214843, "sim_compute_robot_state-parked0": 0.008656484285990397}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9373464071326567, "get_ui_image": 0.03212231159210205, "step_physics": 0.08576703945795695, "survival_time": 14.950000000000076, "driven_lanedir": 2.915930925085552, "get_state_dump": 0.01612668514251709, "sim_render-ego": 0.007292914390563965, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02236848831176758, "deviation-heading": 1.5752181565732704, "complete-iteration": 0.21088205099105836, "set_robot_commands": 0.005951038201649984, "deviation-center-line": 0.3913810020141544, "driven_lanedir_consec": 2.915930925085552, "sim_compute_sim_state": 0.0173232897122701, "sim_compute_performance-ego": 0.004882647196451823, "sim_compute_robot_state-ego": 0.0101357897122701, "sim_compute_robot_state-parked0": 0.008723799387613933}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.745351036957677, "get_ui_image": 0.033147992293039955, "step_physics": 0.08385015964508057, "survival_time": 14.950000000000076, "driven_lanedir": 0.8084427716914862, "get_state_dump": 0.015407822926839192, "sim_render-ego": 0.006974365711212158, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.022063347498575848, "deviation-heading": 3.162137950908946, "complete-iteration": 0.20219414790471396, "set_robot_commands": 0.005513323942820231, "deviation-center-line": 0.3699487338768379, "driven_lanedir_consec": 0.6654457949878094, "sim_compute_sim_state": 0.012903660933176676, "sim_compute_performance-ego": 0.004597251415252686, "sim_compute_robot_state-ego": 0.00908321221669515, "sim_compute_robot_state-parked0": 0.008468240102132162}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7942671024457084, "get_ui_image": 0.032290738423665366, "step_physics": 0.08512752374013265, "survival_time": 14.950000000000076, "driven_lanedir": 1.9949424193236824, "get_state_dump": 0.015953388214111328, "sim_render-ego": 0.007160968780517578, "in-drivable-lane": 4.650000000000066, "agent_compute-ego": 0.02251232624053955, "deviation-heading": 1.1778808864704533, "complete-iteration": 0.2102055295308431, "set_robot_commands": 0.006058313846588135, "deviation-center-line": 0.25889917044777866, "driven_lanedir_consec": 1.9949424193236824, "sim_compute_sim_state": 0.0173444660504659, "sim_compute_performance-ego": 0.0047880268096923825, "sim_compute_robot_state-ego": 0.009935585657755534, "sim_compute_robot_state-parked0": 0.00884828249613444}}
set_robot_commands_max0.006058313846588135
set_robot_commands_mean0.005838265419006348
set_robot_commands_median0.005890711943308513
set_robot_commands_min0.005513323942820231
sim_compute_performance-ego_max0.004882647196451823
sim_compute_performance-ego_mean0.004784656763076782
sim_compute_performance-ego_median0.00482936422030131
sim_compute_performance-ego_min0.004597251415252686
sim_compute_robot_state-ego_max0.0101357897122701
sim_compute_robot_state-ego_mean0.009819612701733907
sim_compute_robot_state-ego_median0.010029724438985189
sim_compute_robot_state-ego_min0.00908321221669515
sim_compute_robot_state-parked0_max0.00884828249613444
sim_compute_robot_state-parked0_mean0.008674201567967733
sim_compute_robot_state-parked0_median0.008690141836802164
sim_compute_robot_state-parked0_min0.008468240102132162
sim_compute_sim_state_max0.018187509377797444
sim_compute_sim_state_mean0.01643973151842753
sim_compute_sim_state_median0.017333877881368
sim_compute_sim_state_min0.012903660933176676
sim_render-ego_max0.007327994505564372
sim_render-ego_mean0.007189060846964518
sim_render-ego_median0.007226941585540771
sim_render-ego_min0.006974365711212158
simulation-passed1
step_physics_max0.0887939437230428
step_physics_mean0.08588466664155325
step_physics_median0.0854472815990448
step_physics_min0.08385015964508057
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
362429382Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9382/LFv-sim-Sandy1-sandy-1-job36242-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362409383Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9383/LFv-sim-Sandy1-sandy-1-job36240-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362389384Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:57
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9384/LFv-sim-Sandy1-sandy-1-job36238-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362369385Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:53
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9385/LFv-sim-Sandy1-sandy-1-job36236-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362359385Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9385/LFv-sim-Sandy1-sandy-1-job36235-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362319386Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:00:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9386/LFv-sim-Sandy1-sandy-1-job36231-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362259391Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5053331626981743
survival_time_median14.950000000000076
deviation-center-line_median0.31607047346603856
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.023996453285217285
agent_compute-ego_mean0.02279138724009196
agent_compute-ego_median0.02252484877904256
agent_compute-ego_min0.02211939811706543
complete-iteration_max0.21623337904612225
complete-iteration_mean0.2043038604656855
complete-iteration_median0.20291433652242025
complete-iteration_min0.19515338977177937
deviation-center-line_max0.5765961548091494
deviation-center-line_mean0.3531686827595348
deviation-center-line_min0.20393762929691267
deviation-heading_max2.5922544208453164
deviation-heading_mean1.718549300269167
deviation-heading_median1.73883353761524
deviation-heading_min0.8042757050008715
driven_any_max1.531574882994083
driven_any_mean1.5289463991807517
driven_any_median1.5315621441410403
driven_any_min1.521086425446842
driven_lanedir_consec_max1.527220593957919
driven_lanedir_consec_mean1.4808850277108792
driven_lanedir_consec_min1.3856531914892485
driven_lanedir_max1.527220593957919
driven_lanedir_mean1.4808850277108792
driven_lanedir_median1.5053331626981743
driven_lanedir_min1.3856531914892485
get_state_dump_max0.017638463973999024
get_state_dump_mean0.01634498178958893
get_state_dump_median0.01602365891138713
get_state_dump_min0.015694145361582437
get_ui_image_max0.03350086450576782
get_ui_image_mean0.03242140611012777
get_ui_image_median0.032480401595433556
get_ui_image_min0.03122395674387614
in-drivable-lane_max0.9500000000000136
in-drivable-lane_mean0.23750000000000335
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.521086425446842, "get_ui_image": 0.033117934862772626, "step_physics": 0.07960048198699951, "survival_time": 14.950000000000076, "driven_lanedir": 1.3856531914892485, "get_state_dump": 0.015694145361582437, "sim_render-ego": 0.006577974955240886, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.0221345845858256, "deviation-heading": 2.268764821588572, "complete-iteration": 0.19920164585113528, "set_robot_commands": 0.004914627075195312, "deviation-center-line": 0.3659553206326684, "driven_lanedir_consec": 1.3856531914892485, "sim_compute_sim_state": 0.016672725677490233, "sim_compute_performance-ego": 0.0043903128306070965, "sim_compute_robot_state-ego": 0.0077468609809875485, "sim_compute_robot_state-parked0": 0.008173718452453613}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.5315692862913868, "get_ui_image": 0.03122395674387614, "step_physics": 0.07401623328526814, "survival_time": 14.950000000000076, "driven_lanedir": 1.5249629061650276, "get_state_dump": 0.017638463973999024, "sim_render-ego": 0.006550357341766357, "in-drivable-lane": 0.0, "agent_compute-ego": 0.023996453285217285, "deviation-heading": 1.208902253641908, "complete-iteration": 0.19515338977177937, "set_robot_commands": 0.0052715245882670085, "deviation-center-line": 0.20393762929691267, "driven_lanedir_consec": 1.5249629061650276, "sim_compute_sim_state": 0.015727553367614746, "sim_compute_performance-ego": 0.004406322638193766, "sim_compute_robot_state-ego": 0.007727965513865153, "sim_compute_robot_state-parked0": 0.008406322797139485}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.5315550019906938, "get_ui_image": 0.031842868328094485, "step_physics": 0.0853961181640625, "survival_time": 14.950000000000076, "driven_lanedir": 1.4857034192313212, "get_state_dump": 0.01629271666208903, "sim_render-ego": 0.007060973644256592, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02291511297225952, "deviation-heading": 2.5922544208453164, "complete-iteration": 0.20662702719370524, "set_robot_commands": 0.00600700855255127, "deviation-center-line": 0.5765961548091494, "driven_lanedir_consec": 1.4857034192313212, "sim_compute_sim_state": 0.01347315231959025, "sim_compute_performance-ego": 0.004764159520467122, "sim_compute_robot_state-ego": 0.009888128439585368, "sim_compute_robot_state-parked0": 0.008805070718129476}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.531574882994083, "get_ui_image": 0.03350086450576782, "step_physics": 0.09178293387095134, "survival_time": 14.950000000000076, "driven_lanedir": 1.527220593957919, "get_state_dump": 0.015754601160685222, "sim_render-ego": 0.007171872456868489, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02211939811706543, "deviation-heading": 0.8042757050008715, "complete-iteration": 0.21623337904612225, "set_robot_commands": 0.0060082451502482094, "deviation-center-line": 0.2661856262994087, "driven_lanedir_consec": 1.527220593957919, "sim_compute_sim_state": 0.016293954054514566, "sim_compute_performance-ego": 0.004847515424092611, "sim_compute_robot_state-ego": 0.009958253701527914, "sim_compute_robot_state-parked0": 0.008612359364827474}}
set_robot_commands_max0.0060082451502482094
set_robot_commands_mean0.00555035134156545
set_robot_commands_median0.005639266570409139
set_robot_commands_min0.004914627075195312
sim_compute_performance-ego_max0.004847515424092611
sim_compute_performance-ego_mean0.004602077603340149
sim_compute_performance-ego_median0.004585241079330444
sim_compute_performance-ego_min0.0043903128306070965
sim_compute_robot_state-ego_max0.009958253701527914
sim_compute_robot_state-ego_mean0.008830302158991495
sim_compute_robot_state-ego_median0.008817494710286458
sim_compute_robot_state-ego_min0.007727965513865153
sim_compute_robot_state-parked0_max0.008805070718129476
sim_compute_robot_state-parked0_mean0.008499367833137513
sim_compute_robot_state-parked0_median0.00850934108098348
sim_compute_robot_state-parked0_min0.008173718452453613
sim_compute_sim_state_max0.016672725677490233
sim_compute_sim_state_mean0.01554184635480245
sim_compute_sim_state_median0.016010753711064654
sim_compute_sim_state_min0.01347315231959025
sim_render-ego_max0.007171872456868489
sim_render-ego_mean0.006840294599533081
sim_render-ego_median0.006819474299748739
sim_render-ego_min0.006550357341766357
simulation-passed1
step_physics_max0.09178293387095134
step_physics_mean0.08269894182682037
step_physics_median0.08249830007553101
step_physics_min0.07401623328526814
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
362199395Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:08:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6290952358997404
survival_time_median13.175000000000052
deviation-center-line_median0.27065986884923904
in-drivable-lane_median3.4000000000000177


other stats
agent_compute-ego_max0.024062813917795817
agent_compute-ego_mean0.02333356452328271
agent_compute-ego_median0.023718304251896517
agent_compute-ego_min0.021834835671541986
complete-iteration_max0.2163831215155752
complete-iteration_mean0.20511213064002148
complete-iteration_median0.2041680647368346
complete-iteration_min0.19572927157084147
deviation-center-line_max1.1331015768693116
deviation-center-line_mean0.4587226674662796
deviation-center-line_min0.1604693552973286
deviation-heading_max3.324916181526969
deviation-heading_mean1.5392154022718123
deviation-heading_median1.126242228951204
deviation-heading_min0.5794609696578722
driven_any_max4.22577886221215
driven_any_mean3.282443352739419
driven_any_median3.5154461554557175
driven_any_min1.8731022378340911
driven_lanedir_consec_max3.760413550953414
driven_lanedir_consec_mean1.978805193617132
driven_lanedir_consec_min0.8966167517156326
driven_lanedir_max3.760413550953414
driven_lanedir_mean1.978805193617132
driven_lanedir_median1.6290952358997404
driven_lanedir_min0.8966167517156326
get_state_dump_max0.017848351796468098
get_state_dump_mean0.0166989781400901
get_state_dump_median0.01676435929521653
get_state_dump_min0.015418842173459235
get_ui_image_max0.03394429411804467
get_ui_image_mean0.03222288640073557
get_ui_image_median0.032015969756298696
get_ui_image_min0.03091531197230021
in-drivable-lane_max11.150000000000084
in-drivable-lane_mean4.71250000000003
in-drivable-lane_min0.8999999999999995
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8731022378340911, "get_ui_image": 0.03177804073304621, "step_physics": 0.07542388857775972, "survival_time": 6.549999999999985, "driven_lanedir": 1.3556772229676677, "get_state_dump": 0.01691221280862357, "sim_render-ego": 0.007109383590348804, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.02362413806769684, "deviation-heading": 0.5794609696578722, "complete-iteration": 0.20112535425724873, "set_robot_commands": 0.0061552615566108065, "deviation-center-line": 0.1604693552973286, "driven_lanedir_consec": 1.3556772229676677, "sim_compute_sim_state": 0.017423939158898272, "sim_compute_performance-ego": 0.004816037097960028, "sim_compute_robot_state-ego": 0.009285726620040777, "sim_compute_robot_state-parked0": 0.008412770642579058}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.198378586634862, "get_ui_image": 0.03091531197230021, "step_physics": 0.07310951312383016, "survival_time": 14.950000000000076, "driven_lanedir": 3.760413550953414, "get_state_dump": 0.017848351796468098, "sim_render-ego": 0.006775174140930176, "in-drivable-lane": 0.8999999999999995, "agent_compute-ego": 0.024062813917795817, "deviation-heading": 3.324916181526969, "complete-iteration": 0.19572927157084147, "set_robot_commands": 0.005031687418619792, "deviation-center-line": 1.1331015768693116, "driven_lanedir_consec": 3.760413550953414, "sim_compute_sim_state": 0.017465867201487222, "sim_compute_performance-ego": 0.004477450847625733, "sim_compute_robot_state-ego": 0.007693614959716797, "sim_compute_robot_state-parked0": 0.008162704308827718}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.22577886221215, "get_ui_image": 0.03225389877955119, "step_physics": 0.08226681232452393, "survival_time": 14.950000000000076, "driven_lanedir": 0.8966167517156326, "get_state_dump": 0.01661650578180949, "sim_render-ego": 0.007314334710439047, "in-drivable-lane": 11.150000000000084, "agent_compute-ego": 0.023812470436096193, "deviation-heading": 1.352504894285726, "complete-iteration": 0.20721077521642048, "set_robot_commands": 0.005994056065877279, "deviation-center-line": 0.21321612568461296, "driven_lanedir_consec": 0.8966167517156326, "sim_compute_sim_state": 0.015743234157562257, "sim_compute_performance-ego": 0.004835636615753174, "sim_compute_robot_state-ego": 0.00965192715326945, "sim_compute_robot_state-parked0": 0.008539669513702393}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.832513724276573, "get_ui_image": 0.03394429411804467, "step_physics": 0.09059770274580572, "survival_time": 11.400000000000029, "driven_lanedir": 1.9025132488318133, "get_state_dump": 0.015418842173459235, "sim_render-ego": 0.007110183699089184, "in-drivable-lane": 4.850000000000042, "agent_compute-ego": 0.021834835671541986, "deviation-heading": 0.8999795636166819, "complete-iteration": 0.2163831215155752, "set_robot_commands": 0.005958335441455506, "deviation-center-line": 0.3281036120138651, "driven_lanedir_consec": 1.9025132488318133, "sim_compute_sim_state": 0.017945906572174607, "sim_compute_performance-ego": 0.004795253276824951, "sim_compute_robot_state-ego": 0.009878610309801604, "sim_compute_robot_state-parked0": 0.008721214637421724}}
set_robot_commands_max0.0061552615566108065
set_robot_commands_mean0.005784835120640846
set_robot_commands_median0.005976195753666392
set_robot_commands_min0.005031687418619792
sim_compute_performance-ego_max0.004835636615753174
sim_compute_performance-ego_mean0.004731094459540971
sim_compute_performance-ego_median0.004805645187392489
sim_compute_performance-ego_min0.004477450847625733
sim_compute_robot_state-ego_max0.009878610309801604
sim_compute_robot_state-ego_mean0.009127469760707156
sim_compute_robot_state-ego_median0.009468826886655114
sim_compute_robot_state-ego_min0.007693614959716797
sim_compute_robot_state-parked0_max0.008721214637421724
sim_compute_robot_state-parked0_mean0.008459089775632724
sim_compute_robot_state-parked0_median0.008476220078140726
sim_compute_robot_state-parked0_min0.008162704308827718
sim_compute_sim_state_max0.017945906572174607
sim_compute_sim_state_mean0.01714473677253059
sim_compute_sim_state_median0.017444903180192747
sim_compute_sim_state_min0.015743234157562257
sim_render-ego_max0.007314334710439047
sim_render-ego_mean0.007077269035201803
sim_render-ego_median0.007109783644718994
sim_render-ego_min0.006775174140930176
simulation-passed1
step_physics_max0.09059770274580572
step_physics_mean0.08034947919297988
step_physics_median0.07884535045114183
step_physics_min0.07310951312383016
survival_time_max14.950000000000076
survival_time_mean11.962500000000045
survival_time_min6.549999999999985
No reset possible
362159758Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoSandy1-sandy-10:03:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 132 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362099761Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednoSandy1-sandy-10:04:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 481, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 145 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 655, in go
    wrap(cie)
  File "experiment_manager.py", line 640, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 241, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 485, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
362059764Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4507780588383756
survival_time_median12.100000000000035
deviation-center-line_median0.4967653829540284
in-drivable-lane_median5.925000000000038


other stats
agent_compute-ego_max0.020567187556514033
agent_compute-ego_mean0.020323190208783648
agent_compute-ego_median0.0203165685796292
agent_compute-ego_min0.02009243611936216
complete-iteration_max0.21036935521063405
complete-iteration_mean0.2079208922477833
complete-iteration_median0.20754902388052965
complete-iteration_min0.2062161660194397
deviation-center-line_max0.7733612285662239
deviation-center-line_mean0.5107865463177967
deviation-center-line_min0.27625419079690605
deviation-heading_max2.8258921024738544
deviation-heading_mean2.2403259809805043
deviation-heading_median2.179498293503286
deviation-heading_min1.776415234441591
driven_any_max3.303858930953348
driven_any_mean2.757103047421535
driven_any_median2.6823564218577576
driven_any_min2.359840415017278
driven_lanedir_consec_max1.91885178682452
driven_lanedir_consec_mean1.4068214984409786
driven_lanedir_consec_min0.8068780892626432
driven_lanedir_max1.91885178682452
driven_lanedir_mean1.4068214984409786
driven_lanedir_median1.4507780588383756
driven_lanedir_min0.8068780892626432
get_state_dump_max0.014834503147089593
get_state_dump_mean0.014544860046630102
get_state_dump_median0.014530902684681
get_state_dump_min0.014283131670068812
get_ui_image_max0.035518618866249366
get_ui_image_mean0.03505085337962523
get_ui_image_median0.03512924604945712
get_ui_image_min0.03442630255333731
in-drivable-lane_max6.900000000000056
in-drivable-lane_mean5.475000000000042
in-drivable-lane_min3.150000000000036
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.359840415017278, "get_ui_image": 0.03498684035407172, "step_physics": 0.08666555969803422, "survival_time": 9.45, "driven_lanedir": 0.8068780892626432, "get_state_dump": 0.01463197148035443, "sim_render-ego": 0.0068633051776381395, "in-drivable-lane": 5.100000000000007, "agent_compute-ego": 0.020567187556514033, "deviation-heading": 1.776415234441591, "complete-iteration": 0.2076346508409611, "set_robot_commands": 0.005227590994860129, "deviation-center-line": 0.27625419079690605, "driven_lanedir_consec": 0.8068780892626432, "sim_compute_sim_state": 0.017207804180326917, "sim_compute_performance-ego": 0.004521947689157315, "sim_compute_robot_state-ego": 0.008641705941901636, "sim_compute_robot_state-parked0": 0.008135611418063047}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.303858930953348, "get_ui_image": 0.03527165174484253, "step_physics": 0.08671674410502116, "survival_time": 14.950000000000076, "driven_lanedir": 1.7185426731299984, "get_state_dump": 0.014429833889007568, "sim_render-ego": 0.006719430287679036, "in-drivable-lane": 6.900000000000056, "agent_compute-ego": 0.020154938697814945, "deviation-heading": 2.8258921024738544, "complete-iteration": 0.2062161660194397, "set_robot_commands": 0.0050994690259297685, "deviation-center-line": 0.7733612285662239, "driven_lanedir_consec": 1.7185426731299984, "sim_compute_sim_state": 0.017136566638946533, "sim_compute_performance-ego": 0.004441699186960856, "sim_compute_robot_state-ego": 0.008254020214080811, "sim_compute_robot_state-parked0": 0.00780507485071818}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.7850157444125783, "get_ui_image": 0.035518618866249366, "step_physics": 0.09144558641645643, "survival_time": 13.500000000000057, "driven_lanedir": 1.183013444546753, "get_state_dump": 0.014283131670068812, "sim_render-ego": 0.006551279845061125, "in-drivable-lane": 6.75000000000007, "agent_compute-ego": 0.02009243611936216, "deviation-heading": 2.557400413411727, "complete-iteration": 0.2074633969200982, "set_robot_commands": 0.005099738968743218, "deviation-center-line": 0.5370665344785147, "driven_lanedir_consec": 1.183013444546753, "sim_compute_sim_state": 0.01386358031520137, "sim_compute_performance-ego": 0.004399360550774468, "sim_compute_robot_state-ego": 0.008181639070864078, "sim_compute_robot_state-parked0": 0.007842903667026096}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.579697099302937, "get_ui_image": 0.03442630255333731, "step_physics": 0.09011641395426244, "survival_time": 10.700000000000015, "driven_lanedir": 1.91885178682452, "get_state_dump": 0.014834503147089593, "sim_render-ego": 0.006761809375798591, "in-drivable-lane": 3.150000000000036, "agent_compute-ego": 0.020478198461443463, "deviation-heading": 1.8015961735948447, "complete-iteration": 0.21036935521063405, "set_robot_commands": 0.005343599854228652, "deviation-center-line": 0.456464231429542, "driven_lanedir_consec": 1.91885178682452, "sim_compute_sim_state": 0.01680221401642416, "sim_compute_performance-ego": 0.004591136335212493, "sim_compute_robot_state-ego": 0.008813373396329791, "sim_compute_robot_state-parked0": 0.00801310138167622}}
set_robot_commands_max0.005343599854228652
set_robot_commands_mean0.005192599710940441
set_robot_commands_median0.005163664981801673
set_robot_commands_min0.0050994690259297685
sim_compute_performance-ego_max0.004591136335212493
sim_compute_performance-ego_mean0.004488535940526283
sim_compute_performance-ego_median0.004481823438059085
sim_compute_performance-ego_min0.004399360550774468
sim_compute_robot_state-ego_max0.008813373396329791
sim_compute_robot_state-ego_mean0.00847268465579408
sim_compute_robot_state-ego_median0.008447863077991224
sim_compute_robot_state-ego_min0.008181639070864078
sim_compute_robot_state-parked0_max0.008135611418063047
sim_compute_robot_state-parked0_mean0.007949172829370885
sim_compute_robot_state-parked0_median0.007928002524351158
sim_compute_robot_state-parked0_min0.00780507485071818
sim_compute_sim_state_max0.017207804180326917
sim_compute_sim_state_mean0.016252541287724746
sim_compute_sim_state_median0.016969390327685345
sim_compute_sim_state_min0.01386358031520137
sim_render-ego_max0.0068633051776381395
sim_render-ego_mean0.006723956171544223
sim_render-ego_median0.006740619831738813
sim_render-ego_min0.006551279845061125
simulation-passed1
step_physics_max0.09144558641645643
step_physics_mean0.08873607604344355
step_physics_median0.08841657902964178
step_physics_min0.08666555969803422
survival_time_max14.950000000000076
survival_time_mean12.150000000000038
survival_time_min9.45
No reset possible
362039767Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornoSandy1-sandy-10:01:00
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

No results found! Something very wrong. 
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1088, in run_one
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/challenge_results.py", line 90, in read_challenge_results
    raise NoResultsFound(msg)
duckietown_challenges.challenge_results.NoResultsFound: File '/tmp/duckietown/DT18/evaluator/executions/aido5-LF-sim-validation/submission9767/LFv-sim-Sandy1-sandy-1-job36203-a-wd/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
361959774Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:08:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.818687448646232
survival_time_median14.950000000000076
deviation-center-line_median0.6276417734898878
in-drivable-lane_median4.575000000000033


other stats
agent_compute-ego_max0.02182034174601237
agent_compute-ego_mean0.020998228677996885
agent_compute-ego_median0.020956012407938637
agent_compute-ego_min0.02026054815009788
complete-iteration_max0.20907719453175863
complete-iteration_mean0.20674024517889375
complete-iteration_median0.2072629768760116
complete-iteration_min0.2033578324317932
deviation-center-line_max0.8520606364020764
deviation-center-line_mean0.6012087563526558
deviation-center-line_min0.29749084202877096
deviation-heading_max5.003993342496941
deviation-heading_mean2.775506277435596
deviation-heading_median2.9011357450599773
deviation-heading_min0.2957602771254864
driven_any_max3.7082720379006338
driven_any_mean3.065349643204371
driven_any_median3.5137389350916433
driven_any_min1.5256486647335632
driven_lanedir_consec_max2.243528175873716
driven_lanedir_consec_mean1.6929740440517005
driven_lanedir_consec_min0.8909931030406206
driven_lanedir_max2.243528175873716
driven_lanedir_mean1.6929740440517005
driven_lanedir_median1.818687448646232
driven_lanedir_min0.8909931030406206
get_state_dump_max0.015498470465342204
get_state_dump_mean0.014852494155919112
get_state_dump_median0.014735215504964191
get_state_dump_min0.014441075148405851
get_ui_image_max0.035182109673817956
get_ui_image_mean0.033946822197348986
get_ui_image_median0.03392348271829111
get_ui_image_min0.03275821367899577
in-drivable-lane_max8.300000000000058
in-drivable-lane_mean4.8875000000000295
in-drivable-lane_min2.0999999999999925
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.530140398169377, "get_ui_image": 0.03275821367899577, "step_physics": 0.08065749009450277, "survival_time": 14.950000000000076, "driven_lanedir": 2.0982351828584207, "get_state_dump": 0.015498470465342204, "sim_render-ego": 0.00693683385848999, "in-drivable-lane": 5.350000000000067, "agent_compute-ego": 0.02182034174601237, "deviation-heading": 2.743672072204454, "complete-iteration": 0.2033578324317932, "set_robot_commands": 0.005314985116322835, "deviation-center-line": 0.6032315566239932, "driven_lanedir_consec": 2.0982351828584207, "sim_compute_sim_state": 0.01832600434621175, "sim_compute_performance-ego": 0.004714679718017578, "sim_compute_robot_state-ego": 0.008935902913411458, "sim_compute_robot_state-parked0": 0.008237434228261313}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.7082720379006338, "get_ui_image": 0.034560230573018394, "step_physics": 0.08681253751118978, "survival_time": 14.950000000000076, "driven_lanedir": 1.5391397144340435, "get_state_dump": 0.01477819283803304, "sim_render-ego": 0.006793679396311442, "in-drivable-lane": 8.300000000000058, "agent_compute-ego": 0.020604405403137207, "deviation-heading": 3.0585994179155005, "complete-iteration": 0.20828086694081624, "set_robot_commands": 0.005387930075327555, "deviation-center-line": 0.6520519903557824, "driven_lanedir_consec": 1.5391397144340435, "sim_compute_sim_state": 0.017617584069569904, "sim_compute_performance-ego": 0.0045924083391825354, "sim_compute_robot_state-ego": 0.008760565916697185, "sim_compute_robot_state-parked0": 0.008215425809224446}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.49733747201391, "get_ui_image": 0.035182109673817956, "step_physics": 0.08824605226516724, "survival_time": 14.950000000000076, "driven_lanedir": 2.243528175873716, "get_state_dump": 0.014692238171895343, "sim_render-ego": 0.007126765251159668, "in-drivable-lane": 3.8, "agent_compute-ego": 0.02130761941274007, "deviation-heading": 5.003993342496941, "complete-iteration": 0.20907719453175863, "set_robot_commands": 0.005516342322031657, "deviation-center-line": 0.8520606364020764, "driven_lanedir_consec": 2.243528175873716, "sim_compute_sim_state": 0.015002768039703369, "sim_compute_performance-ego": 0.004603686332702636, "sim_compute_robot_state-ego": 0.00903614362080892, "sim_compute_robot_state-parked0": 0.008197357654571533}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.5256486647335632, "get_ui_image": 0.03328673486356382, "step_physics": 0.08784283311278732, "survival_time": 5.399999999999989, "driven_lanedir": 0.8909931030406206, "get_state_dump": 0.014441075148405851, "sim_render-ego": 0.007007285400673195, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.02026054815009788, "deviation-heading": 0.2957602771254864, "complete-iteration": 0.20624508681120696, "set_robot_commands": 0.005280307045689336, "deviation-center-line": 0.29749084202877096, "driven_lanedir_consec": 0.8909931030406206, "sim_compute_sim_state": 0.016113744841681585, "sim_compute_performance-ego": 0.004701298696023447, "sim_compute_robot_state-ego": 0.008816727885493526, "sim_compute_robot_state-parked0": 0.008333109043262623}}
set_robot_commands_max0.005516342322031657
set_robot_commands_mean0.005374891139842846
set_robot_commands_median0.005351457595825195
set_robot_commands_min0.005280307045689336
sim_compute_performance-ego_max0.004714679718017578
sim_compute_performance-ego_mean0.004653018271481549
sim_compute_performance-ego_median0.004652492514363041
sim_compute_performance-ego_min0.0045924083391825354
sim_compute_robot_state-ego_max0.00903614362080892
sim_compute_robot_state-ego_mean0.008887335084102773
sim_compute_robot_state-ego_median0.008876315399452491
sim_compute_robot_state-ego_min0.008760565916697185
sim_compute_robot_state-parked0_max0.008333109043262623
sim_compute_robot_state-parked0_mean0.008245831683829977
sim_compute_robot_state-parked0_median0.008226430018742879
sim_compute_robot_state-parked0_min0.008197357654571533
sim_compute_sim_state_max0.01832600434621175
sim_compute_sim_state_mean0.016765025324291652
sim_compute_sim_state_median0.016865664455625744
sim_compute_sim_state_min0.015002768039703369
sim_render-ego_max0.007126765251159668
sim_render-ego_mean0.0069661409766585735
sim_render-ego_median0.006972059629581593
sim_render-ego_min0.006793679396311442
simulation-passed1
step_physics_max0.08824605226516724
step_physics_mean0.08588972824591176
step_physics_median0.08732768531198855
step_physics_min0.08065749009450277
survival_time_max14.950000000000076
survival_time_mean12.562500000000057
survival_time_min5.399999999999989
No reset possible
361739947Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simsuccessnoSandy1-sandy-10:46:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6862156576440903
survival_time_median14.950000000000076
deviation-center-line_median0.4386053674978682
in-drivable-lane_median5.549999999999981


other stats
agent_compute-ego_max0.05963041226069132
agent_compute-ego_mean0.044883281506528774
agent_compute-ego_median0.04971867243448893
agent_compute-ego_min0.029536214470863343
complete-iteration_max0.38910746574401855
complete-iteration_mean0.36273654504474206
complete-iteration_median0.3705890425046285
complete-iteration_min0.3317504299246447
deviation-center-line_max0.9514274076024416
deviation-center-line_mean0.502539707456465
deviation-center-line_min0.13632776533272695
deviation-heading_max3.936229564009022
deviation-heading_mean2.659863003681578
deviation-heading_median2.9630153676709905
deviation-heading_min0.5112308711234183
driven_any_max1.9399931881118515
driven_any_mean1.7022730491902736
driven_any_median1.9398614603097553
driven_any_min0.4861181244879786
driven_lanedir_consec_max1.406782132830069
driven_lanedir_consec_mean0.7219120790032516
driven_lanedir_consec_min0.15373323977938336
driven_lanedir_max1.8363843140899243
driven_lanedir_mean0.9063394633185814
driven_lanedir_median0.9034058034790324
driven_lanedir_min0.15373323977938336
get_state_dump_max0.03351718266805013
get_state_dump_mean0.030859787316125546
get_state_dump_median0.03026149386451358
get_state_dump_min0.02932280730147388
get_ui_image_max0.05893675645192464
get_ui_image_mean0.0561274341675364
get_ui_image_median0.0566588020324707
get_ui_image_min0.05190681139628092
in-drivable-lane_max10.200000000000069
in-drivable-lane_mean5.063333333333384
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 1.7876226205756267, "get_ui_image": 0.05349766734705075, "step_physics": 0.13400017827856842, "survival_time": 13.850000000000062, "driven_lanedir": 0.7685429789778948, "get_state_dump": 0.03233285156828402, "sim_render-ego": 0.006775183798173705, "in-drivable-lane": 6.150000000000081, "agent_compute-ego": 0.03158596620662978, "deviation-heading": 3.165341056676467, "complete-iteration": 0.3317504299246447, "set_robot_commands": 0.005289447867052649, "deviation-center-line": 0.5394452059238933, "driven_lanedir_consec": 0.738821616115807, "sim_compute_sim_state": 0.016545358547665152, "sim_compute_performance-ego": 0.004382677456962503, "sim_compute_robot_state-ego": 0.008434030553494119, "sim_compute_robot_state-npc0": 0.007954824702404035, "sim_compute_robot_state-npc1": 0.007445447281379562, "sim_compute_robot_state-npc2": 0.007512492823686841, "sim_compute_robot_state-npc3": 0.007807618013788217, "sim_compute_robot_state-parked0": 0.007933297312216639}, "udem1-sc1-0-ego": {"driven_any": 0.9308872691684956, "get_ui_image": 0.05739803865653317, "step_physics": 0.14257786711867976, "survival_time": 7.349999999999982, "driven_lanedir": 0.15373323977938336, "get_state_dump": 0.03026149386451358, "sim_render-ego": 0.006475002587247057, "in-drivable-lane": 5.549999999999981, "agent_compute-ego": 0.03095400252309786, "deviation-heading": 0.7402376568344685, "complete-iteration": 0.34416407792746617, "set_robot_commands": 0.005020096188499814, "deviation-center-line": 0.13632776533272695, "driven_lanedir_consec": 0.15373323977938336, "sim_compute_sim_state": 0.01857810117760483, "sim_compute_performance-ego": 0.004561597798146358, "sim_compute_robot_state-ego": 0.008956466402326311, "sim_compute_robot_state-npc0": 0.007879601043908774, "sim_compute_robot_state-npc1": 0.007466261078711269, "sim_compute_robot_state-npc2": 0.00761564572652181, "sim_compute_robot_state-npc3": 0.008066845588943584, "sim_compute_robot_state-parked0": 0.008111428241340481}, "udem1-sc2-0-ego": {"driven_any": 1.8603341179484103, "get_ui_image": 0.05401169298417892, "step_physics": 0.1296621963952892, "survival_time": 14.350000000000067, "driven_lanedir": 0.3722526173693508, "get_state_dump": 0.033096635798544, "sim_render-ego": 0.007493809955876048, "in-drivable-lane": 10.200000000000069, "agent_compute-ego": 0.03146939992073936, "deviation-heading": 2.681130940537872, "complete-iteration": 0.33985930286633426, "set_robot_commands": 0.006565843309674945, "deviation-center-line": 0.4238374110121507, "driven_lanedir_consec": 0.3722526173693508, "sim_compute_sim_state": 0.017835406891560306, "sim_compute_performance-ego": 0.004845865096780066, "sim_compute_robot_state-ego": 0.010861180800594105, "sim_compute_robot_state-npc0": 0.008929097278608262, "sim_compute_robot_state-npc1": 0.008329032605533401, "sim_compute_robot_state-npc2": 0.008434066373712095, "sim_compute_robot_state-npc3": 0.008832770357563935, "sim_compute_robot_state-parked0": 0.009226229132675543}, "udem1-sc3-0-ego": {"driven_any": 1.9399413121361768, "get_ui_image": 0.056528344949086505, "step_physics": 0.15749317089716594, "survival_time": 14.950000000000076, "driven_lanedir": 0.9034058034790324, "get_state_dump": 0.029880797068277995, "sim_render-ego": 0.0068483734130859375, "in-drivable-lane": 7.000000000000098, "agent_compute-ego": 0.030388524532318117, "deviation-heading": 2.517088787096327, "complete-iteration": 0.3598469845453898, "set_robot_commands": 0.005108532905578614, "deviation-center-line": 0.37115725958711754, "driven_lanedir_consec": 0.6862156576440903, "sim_compute_sim_state": 0.021408246358235676, "sim_compute_performance-ego": 0.004392610390981038, "sim_compute_robot_state-ego": 0.008358039061228435, "sim_compute_robot_state-npc0": 0.007829882303873699, "sim_compute_robot_state-npc1": 0.007666262785593668, "sim_compute_robot_state-npc2": 0.007717899481455485, "sim_compute_robot_state-npc3": 0.007870425383249918, "sim_compute_robot_state-parked0": 0.00810445229212443}, "udem1-sc4-0-ego": {"driven_any": 0.4861181244879786, "get_ui_image": 0.05832568407058716, "step_physics": 0.13967092633247374, "survival_time": 3.999999999999994, "driven_lanedir": 0.48193977821699585, "get_state_dump": 0.029949545860290527, "sim_render-ego": 0.006596481800079346, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029536214470863343, "deviation-heading": 0.5112308711234183, "complete-iteration": 0.3386807173490524, "set_robot_commands": 0.005349591374397278, "deviation-center-line": 0.28842150504618386, "driven_lanedir_consec": 0.48193977821699585, "sim_compute_sim_state": 0.01612401008605957, "sim_compute_performance-ego": 0.004531875252723694, "sim_compute_robot_state-ego": 0.008924376964569092, "sim_compute_robot_state-npc0": 0.007829773426055908, "sim_compute_robot_state-npc1": 0.007738882303237915, "sim_compute_robot_state-npc2": 0.007660010457038879, "sim_compute_robot_state-npc3": 0.007934290170669555, "sim_compute_robot_state-parked0": 0.00825251042842865}, "udem1-sc5-0-ego": {"driven_any": 1.939863327433229, "get_ui_image": 0.0566588020324707, "step_physics": 0.1515682323773702, "survival_time": 14.950000000000076, "driven_lanedir": 0.7014235857915853, "get_state_dump": 0.02996098279953003, "sim_render-ego": 0.006911659240722656, "in-drivable-lane": 7.850000000000095, "agent_compute-ego": 0.03616447925567627, "deviation-heading": 3.5479851526835593, "complete-iteration": 0.36299306790033975, "set_robot_commands": 0.005152653058369955, "deviation-center-line": 0.4386053674978682, "driven_lanedir_consec": 0.6366285370245629, "sim_compute_sim_state": 0.022184600035349528, "sim_compute_performance-ego": 0.004562899271647136, "sim_compute_robot_state-ego": 0.00880695899327596, "sim_compute_robot_state-npc0": 0.007985772291819255, "sim_compute_robot_state-npc1": 0.007920159498850504, "sim_compute_robot_state-npc2": 0.00810254414876302, "sim_compute_robot_state-npc3": 0.008351704279581706, "sim_compute_robot_state-parked0": 0.008407953580220541}, "udem1-sc6-0-ego": {"driven_any": 1.939921142725758, "get_ui_image": 0.053682059446970624, "step_physics": 0.13433143933614097, "survival_time": 14.950000000000076, "driven_lanedir": 1.8363843140899243, "get_state_dump": 0.03247653325398763, "sim_render-ego": 0.007115768591562907, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.055159847736358646, "deviation-heading": 2.1783436520324466, "complete-iteration": 0.3705890425046285, "set_robot_commands": 0.006117036342620849, "deviation-center-line": 0.774869148875521, "driven_lanedir_consec": 1.1969135842526988, "sim_compute_sim_state": 0.021498182614644368, "sim_compute_performance-ego": 0.004668994744618734, "sim_compute_robot_state-ego": 0.009923131465911865, "sim_compute_robot_state-npc0": 0.009075368245442708, "sim_compute_robot_state-npc1": 0.009028071562449138, "sim_compute_robot_state-npc2": 0.009093215465545654, "sim_compute_robot_state-npc3": 0.009082510471343994, "sim_compute_robot_state-parked0": 0.009065434137980144}, "udem1-sc7-0-ego": {"driven_any": 1.8534721386459296, "get_ui_image": 0.05459613983447735, "step_physics": 0.15102497847763807, "survival_time": 14.300000000000068, "driven_lanedir": 0.97139497176679, "get_state_dump": 0.031061159147249235, "sim_render-ego": 0.006802795650242092, "in-drivable-lane": 5.100000000000065, "agent_compute-ego": 0.055890260876475514, "deviation-heading": 3.936229564009022, "complete-iteration": 0.37623974826786066, "set_robot_commands": 0.005847647473528669, "deviation-center-line": 0.7476407738677658, "driven_lanedir_consec": 0.7486557656821795, "sim_compute_sim_state": 0.016281479722136383, "sim_compute_performance-ego": 0.00437473333798922, "sim_compute_robot_state-ego": 0.008697512266519186, "sim_compute_robot_state-npc0": 0.008491392735834722, "sim_compute_robot_state-npc1": 0.008195738692383665, "sim_compute_robot_state-npc2": 0.008243644154155171, "sim_compute_robot_state-npc3": 0.008264823393388228, "sim_compute_robot_state-parked0": 0.008208663313538879}, "udem1-sc8-0-ego": {"driven_any": 1.9398614603097553, "get_ui_image": 0.05856761535008748, "step_physics": 0.15251612504323322, "survival_time": 14.950000000000076, "driven_lanedir": 0.6162152590642718, "get_state_dump": 0.02979655822118123, "sim_render-ego": 0.006915818055470785, "in-drivable-lane": 8.900000000000091, "agent_compute-ego": 0.05326317469278971, "deviation-heading": 2.3888529351763736, "complete-iteration": 0.3766418433189392, "set_robot_commands": 0.005354224840799967, "deviation-center-line": 0.41549297541337865, "driven_lanedir_consec": 0.5922261505143966, "sim_compute_sim_state": 0.015246127446492511, "sim_compute_performance-ego": 0.004534617265065511, "sim_compute_robot_state-ego": 0.008689390023549399, "sim_compute_robot_state-npc0": 0.008402628898620606, "sim_compute_robot_state-npc1": 0.008390223185221354, "sim_compute_robot_state-npc2": 0.008314592838287354, "sim_compute_robot_state-npc3": 0.00811482826868693, "sim_compute_robot_state-parked0": 0.008279237747192383}, "udem1-sc9-0-ego": {"driven_any": 1.156532092320183, "get_ui_image": 0.058923801664489406, "step_physics": 0.1483857868784699, "survival_time": 9.049999999999994, "driven_lanedir": 0.9795016811747188, "get_state_dump": 0.02932280730147388, "sim_render-ego": 0.006590674595279588, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.04962429025555184, "deviation-heading": 3.196876806108601, "complete-iteration": 0.37536152555139024, "set_robot_commands": 0.005345658044130104, "deviation-center-line": 0.4988743230791625, "driven_lanedir_consec": 0.6227896895409146, "sim_compute_sim_state": 0.021846585510844025, "sim_compute_performance-ego": 0.004440560525293508, "sim_compute_robot_state-ego": 0.008356448695145917, "sim_compute_robot_state-npc0": 0.008616061500422862, "sim_compute_robot_state-npc1": 0.008471353277975683, "sim_compute_robot_state-npc2": 0.008365793122771036, "sim_compute_robot_state-npc3": 0.008314761009005552, "sim_compute_robot_state-parked0": 0.008500577336516829}, "udem1-sc10-0-ego": {"driven_any": 1.9398984291869803, "get_ui_image": 0.054315582911173506, "step_physics": 0.1401793320973714, "survival_time": 14.950000000000076, "driven_lanedir": 0.9594577927443432, "get_state_dump": 0.031259969870249434, "sim_render-ego": 0.007119732697804769, "in-drivable-lane": 6.600000000000094, "agent_compute-ego": 0.05679577906926473, "deviation-heading": 2.588418856108234, "complete-iteration": 0.37314532995224, "set_robot_commands": 0.005863686402638753, "deviation-center-line": 0.39223254107074645, "driven_lanedir_consec": 0.7241806763967737, "sim_compute_sim_state": 0.019009604454040527, "sim_compute_performance-ego": 0.004624839623769124, "sim_compute_robot_state-ego": 0.009546182950337727, "sim_compute_robot_state-npc0": 0.008967966238657633, "sim_compute_robot_state-npc1": 0.008718835512797037, "sim_compute_robot_state-npc2": 0.008832824230194092, "sim_compute_robot_state-npc3": 0.008880917231241863, "sim_compute_robot_state-parked0": 0.008765800793965658}, "udem1-sc11-0-ego": {"driven_any": 1.939880598752741, "get_ui_image": 0.057581984996795656, "step_physics": 0.15598830620447796, "survival_time": 14.950000000000076, "driven_lanedir": 1.7588486085552786, "get_state_dump": 0.030053800741831463, "sim_render-ego": 0.00661237637201945, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.05178145329157512, "deviation-heading": 3.223962388228528, "complete-iteration": 0.379167107741038, "set_robot_commands": 0.00533476193745931, "deviation-center-line": 0.9514274076024416, "driven_lanedir_consec": 0.7823325537424685, "sim_compute_sim_state": 0.018982165654500324, "sim_compute_performance-ego": 0.004328028361002604, "sim_compute_robot_state-ego": 0.008008212248484293, "sim_compute_robot_state-npc0": 0.008041142622629801, "sim_compute_robot_state-npc1": 0.00802227258682251, "sim_compute_robot_state-npc2": 0.008078943888346355, "sim_compute_robot_state-npc3": 0.008144584496816, "sim_compute_robot_state-parked0": 0.007958401838938395}, "udem1-sc12-0-ego": {"driven_any": 1.939845157173807, "get_ui_image": 0.05893675645192464, "step_physics": 0.16129784027735392, "survival_time": 14.950000000000076, "driven_lanedir": 1.406782132830069, "get_state_dump": 0.029565321604410808, "sim_render-ego": 0.006863011519114177, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.051286745071411136, "deviation-heading": 3.154717203700179, "complete-iteration": 0.38910746574401855, "set_robot_commands": 0.005330698490142822, "deviation-center-line": 0.6605112391965742, "driven_lanedir_consec": 1.406782132830069, "sim_compute_sim_state": 0.02061021248499553, "sim_compute_performance-ego": 0.004464750289916992, "sim_compute_robot_state-ego": 0.008701548576354981, "sim_compute_robot_state-npc0": 0.008368198076883953, "sim_compute_robot_state-npc1": 0.00827694574991862, "sim_compute_robot_state-npc2": 0.008297480742136638, "sim_compute_robot_state-npc3": 0.008542861938476563, "sim_compute_robot_state-parked0": 0.008302965164184571}, "udem1-sc13-0-ego": {"driven_any": 1.9399247588771824, "get_ui_image": 0.056980530420939125, "step_physics": 0.1486768905321757, "survival_time": 14.950000000000076, "driven_lanedir": 1.0863525974941144, "get_state_dump": 0.030361169974009197, "sim_render-ego": 0.006935389041900635, "in-drivable-lane": 5.400000000000077, "agent_compute-ego": 0.04971867243448893, "deviation-heading": 2.9630153676709905, "complete-iteration": 0.37536893129348753, "set_robot_commands": 0.005418167908986409, "deviation-center-line": 0.43842592104100714, "driven_lanedir_consec": 1.0863525974941144, "sim_compute_sim_state": 0.02206633965174357, "sim_compute_performance-ego": 0.0044541724522908525, "sim_compute_robot_state-ego": 0.008732414245605469, "sim_compute_robot_state-npc0": 0.0082992156346639, "sim_compute_robot_state-npc1": 0.008425098260243733, "sim_compute_robot_state-npc2": 0.008259387811024983, "sim_compute_robot_state-npc3": 0.008468539714813232, "sim_compute_robot_state-parked0": 0.008323030471801758}, "udem1-sc14-0-ego": {"driven_any": 1.9399931881118515, "get_ui_image": 0.05190681139628092, "step_physics": 0.12423662265141804, "survival_time": 14.950000000000076, "driven_lanedir": 0.5988565884449688, "get_state_dump": 0.03351718266805013, "sim_render-ego": 0.006579588254292806, "in-drivable-lane": 9.200000000000063, "agent_compute-ego": 0.05963041226069132, "deviation-heading": 3.1045138172371693, "complete-iteration": 0.34813260078430175, "set_robot_commands": 0.005689739386240641, "deviation-center-line": 0.4608267673004364, "driven_lanedir_consec": 0.5988565884449688, "sim_compute_sim_state": 0.01696435610453288, "sim_compute_performance-ego": 0.004246971607208252, "sim_compute_robot_state-ego": 0.007050332228342692, "sim_compute_robot_state-npc0": 0.008225274880727133, "sim_compute_robot_state-npc1": 0.007525096734364828, "sim_compute_robot_state-npc2": 0.007325573762257894, "sim_compute_robot_state-npc3": 0.0074672778447469074, "sim_compute_robot_state-parked0": 0.007491436799367269}}
set_robot_commands_max0.006565843309674945
set_robot_commands_mean0.005519185702008053
set_robot_commands_median0.005349591374397278
set_robot_commands_min0.005020096188499814
sim_compute_performance-ego_max0.004845865096780066
sim_compute_performance-ego_mean0.004494346231626372
sim_compute_performance-ego_median0.004464750289916992
sim_compute_performance-ego_min0.004246971607208252
sim_compute_robot_state-ego_max0.010861180800594105
sim_compute_robot_state-ego_mean0.008803081698382637
sim_compute_robot_state-ego_median0.008701548576354981
sim_compute_robot_state-ego_min0.007050332228342692
sim_compute_robot_state-npc0_max0.009075368245442708
sim_compute_robot_state-npc0_mean0.008326413325370216
sim_compute_robot_state-npc0_median0.0082992156346639
sim_compute_robot_state-npc0_min0.007829773426055908
sim_compute_robot_state-npc1_max0.009028071562449138
sim_compute_robot_state-npc1_mean0.008107978741032192
sim_compute_robot_state-npc1_median0.008195738692383665
sim_compute_robot_state-npc1_min0.007445447281379562
sim_compute_robot_state-npc2_max0.009093215465545654
sim_compute_robot_state-npc2_mean0.008123607668393155
sim_compute_robot_state-npc2_median0.008243644154155171
sim_compute_robot_state-npc2_min0.007325573762257894
sim_compute_robot_state-npc3_max0.009082510471343994
sim_compute_robot_state-npc3_mean0.00827631721082108
sim_compute_robot_state-npc3_median0.008264823393388228
sim_compute_robot_state-npc3_min0.0074672778447469074
sim_compute_robot_state-parked0_max0.009226229132675543
sim_compute_robot_state-parked0_mean0.008328761239366145
sim_compute_robot_state-parked0_median0.008279237747192383
sim_compute_robot_state-parked0_min0.007491436799367269
sim_compute_sim_state_max0.022184600035349528
sim_compute_sim_state_mean0.01901205178269368
sim_compute_sim_state_median0.018982165654500324
sim_compute_sim_state_min0.015246127446492511
sim_render-ego_max0.007493809955876048
sim_render-ego_mean0.00684237770485813
sim_render-ego_median0.0068483734130859375
sim_render-ego_min0.006475002587247057
simulation-passed1
step_physics_max0.16129784027735392
step_physics_mean0.14477399285985512
step_physics_median0.1483857868784699
step_physics_min0.12423662265141804
survival_time_max14.950000000000076
survival_time_mean13.16333333333339
survival_time_min3.999999999999994
No reset possible
361719949Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simsuccessnoSandy1-sandy-10:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.774999999999998
in-drivable-lane_median1.0249999999999972
driven_lanedir_consec_median0.6234003877597323
deviation-center-line_median0.09798021227150149


other stats
agent_compute-ego_max0.020086512421116684
agent_compute-ego_mean0.019701264612339897
agent_compute-ego_median0.01971963584189931
agent_compute-ego_min0.01927927434444427
complete-iteration_max0.215374611891233
complete-iteration_mean0.2059161719162169
complete-iteration_median0.20478249113943617
complete-iteration_min0.19872509349476208
deviation-center-line_max0.1246386243322534
deviation-center-line_mean0.10127151649114262
deviation-center-line_min0.0844870170893141
deviation-heading_max0.3702890519496023
deviation-heading_mean0.3329644572473781
deviation-heading_median0.3455789792737065
deviation-heading_min0.27041081849249704
driven_any_max1.6523255055706776
driven_any_mean1.1016684721598489
driven_any_median1.0867682846581967
driven_any_min0.5808118137523243
driven_lanedir_consec_max0.7721548881035027
driven_lanedir_consec_mean0.5885722147310573
driven_lanedir_consec_min0.3353331953012615
driven_lanedir_max0.7721548881035027
driven_lanedir_mean0.5885722147310573
driven_lanedir_median0.6234003877597323
driven_lanedir_min0.3353331953012615
get_state_dump_max0.01869457043134249
get_state_dump_mean0.015790921430998743
get_state_dump_median0.014931227344087776
get_state_dump_min0.014606660604476927
get_ui_image_max0.0385202719615056
get_ui_image_mean0.0357722143326865
get_ui_image_median0.035339837306636875
get_ui_image_min0.03388891075596665
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean1.1124999999999972
in-drivable-lane_min0.5000000000000004
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.03558111594895185, "step_physics": 0.08684020527338578, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.015084303031533451, "sim_render-ego": 0.00634778152077885, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.020054635355028057, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.20429786585145077, "set_robot_commands": 0.004616745447708389, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.016112125526040286, "sim_compute_performance-ego": 0.004280700521954036, "sim_compute_robot_state-ego": 0.007769107818603516, "sim_compute_robot_state-parked0": 0.007441932872190314}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.0116043895204634, "get_ui_image": 0.0385202719615056, "step_physics": 0.09365234008202186, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6382125950507833, "get_state_dump": 0.01869457043134249, "sim_render-ego": 0.006809422603020301, "in-drivable-lane": 0.8499999999999979, "agent_compute-ego": 0.019384636328770563, "deviation-heading": 0.3389885563832438, "complete-iteration": 0.215374611891233, "set_robot_commands": 0.0050020997340862565, "deviation-center-line": 0.1053904880393105, "driven_lanedir_consec": 0.6382125950507833, "sim_compute_sim_state": 0.012448058678553654, "sim_compute_performance-ego": 0.004421128676487849, "sim_compute_robot_state-ego": 0.008134736464573787, "sim_compute_robot_state-parked0": 0.008137835906102108}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.6523255055706776, "get_ui_image": 0.0350985586643219, "step_physics": 0.08696412742137909, "survival_time": 3.999999999999994, "driven_lanedir": 0.7721548881035027, "get_state_dump": 0.014606660604476927, "sim_render-ego": 0.006557923555374145, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.01927927434444427, "deviation-heading": 0.35216940216416925, "complete-iteration": 0.20526711642742157, "set_robot_commands": 0.004557716846466065, "deviation-center-line": 0.09056993650369242, "driven_lanedir_consec": 0.7721548881035027, "sim_compute_sim_state": 0.01881182789802551, "sim_compute_performance-ego": 0.004375964403152466, "sim_compute_robot_state-ego": 0.00758715569972992, "sim_compute_robot_state-parked0": 0.007252660393714905}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.5808118137523243, "get_ui_image": 0.03388891075596665, "step_physics": 0.08197324926202948, "survival_time": 1.6500000000000008, "driven_lanedir": 0.3353331953012615, "get_state_dump": 0.014778151656642103, "sim_render-ego": 0.006808634960290157, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.020086512421116684, "deviation-heading": 0.3702890519496023, "complete-iteration": 0.19872509349476208, "set_robot_commands": 0.004365559780236446, "deviation-center-line": 0.0844870170893141, "driven_lanedir_consec": 0.3353331953012615, "sim_compute_sim_state": 0.016523715221520626, "sim_compute_performance-ego": 0.004689137140909831, "sim_compute_robot_state-ego": 0.007884618007775509, "sim_compute_robot_state-parked0": 0.007545594013098515}}
set_robot_commands_max0.0050020997340862565
set_robot_commands_mean0.004635530452124289
set_robot_commands_median0.004587231147087227
set_robot_commands_min0.004365559780236446
sim_compute_performance-ego_max0.004689137140909831
sim_compute_performance-ego_mean0.004441732685626046
sim_compute_performance-ego_median0.004398546539820157
sim_compute_performance-ego_min0.004280700521954036
sim_compute_robot_state-ego_max0.008134736464573787
sim_compute_robot_state-ego_mean0.007843904497670681
sim_compute_robot_state-ego_median0.007826862913189512
sim_compute_robot_state-ego_min0.00758715569972992
sim_compute_robot_state-parked0_max0.008137835906102108
sim_compute_robot_state-parked0_mean0.00759450579627646
sim_compute_robot_state-parked0_median0.007493763442644415
sim_compute_robot_state-parked0_min0.007252660393714905
sim_compute_sim_state_max0.01881182789802551
sim_compute_sim_state_mean0.01597393183103502
sim_compute_sim_state_median0.016317920373780458
sim_compute_sim_state_min0.012448058678553654
sim_render-ego_max0.006809422603020301
sim_render-ego_mean0.0066309406598658634
sim_render-ego_median0.006683279257832152
sim_render-ego_min0.00634778152077885
simulation-passed1
step_physics_max0.09365234008202186
step_physics_mean0.08735748050970406
step_physics_median0.08690216634738243
step_physics_min0.08197324926202948
survival_time_max3.999999999999994
survival_time_mean2.7999999999999976
survival_time_min1.6500000000000008
No reset possible
361609956Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simsuccessnoSandy1-sandy-10:19:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6497500907548364
survival_time_median4.249999999999993
deviation-center-line_median0.1485546737890131
in-drivable-lane_median2.1999999999999926


other stats
agent_compute-ego_max0.03118815823136089
agent_compute-ego_mean0.029990212885487044
agent_compute-ego_median0.029946364024106192
agent_compute-ego_min0.0290473073720932
complete-iteration_max0.35420955362774076
complete-iteration_mean0.3356141212449737
complete-iteration_median0.337148443976445
complete-iteration_min0.318082509321325
deviation-center-line_max0.6910962119878233
deviation-center-line_mean0.19364762146629472
deviation-center-line_min0.06494571772210404
deviation-heading_max1.4486706467120278
deviation-heading_mean0.7176249100858005
deviation-heading_median0.7649721039644373
deviation-heading_min0.21987475169154813
driven_any_max3.4377404982533286
driven_any_mean2.0541823308021656
driven_any_median1.782957983049124
driven_any_min0.8006369147274865
driven_lanedir_consec_max2.2467398736422166
driven_lanedir_consec_mean0.8642949729018259
driven_lanedir_consec_min0.29028938101777335
driven_lanedir_max2.2700968138041833
driven_lanedir_mean0.8995789615469522
driven_lanedir_median0.6497500907548364
driven_lanedir_min0.29028938101777335
get_state_dump_max0.03146699389571664
get_state_dump_mean0.030435230144389647
get_state_dump_median0.030424678182027425
get_state_dump_min0.029171340259504908
get_ui_image_max0.0591193746637415
get_ui_image_mean0.05525146442737448
get_ui_image_median0.05518497560257302
get_ui_image_min0.052440550748039695
in-drivable-lane_max4.349999999999989
in-drivable-lane_mean2.3266666666666596
in-drivable-lane_min0.04999999999999982
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 1.65406851544617, "get_ui_image": 0.057718667387962344, "step_physics": 0.14209724068641663, "survival_time": 3.999999999999994, "driven_lanedir": 0.6467016616800385, "get_state_dump": 0.029787281155586244, "sim_render-ego": 0.006509903073310852, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.0290473073720932, "deviation-heading": 0.7649721039644373, "complete-iteration": 0.33495076894760134, "set_robot_commands": 0.00456148087978363, "deviation-center-line": 0.1440401596261301, "driven_lanedir_consec": 0.6419379600343871, "sim_compute_sim_state": 0.015850397944450378, "sim_compute_performance-ego": 0.004277771711349488, "sim_compute_robot_state-ego": 0.007513940334320068, "sim_compute_robot_state-npc0": 0.007308825850486755, "sim_compute_robot_state-npc1": 0.007534843683242798, "sim_compute_robot_state-npc2": 0.00733889639377594, "sim_compute_robot_state-npc3": 0.007588601112365723, "sim_compute_robot_state-parked0": 0.007600370049476624}, "udem1-sc1-0-ego": {"driven_any": 1.6704039613423076, "get_ui_image": 0.05657622549268934, "step_physics": 0.13755217010592236, "survival_time": 4.049999999999994, "driven_lanedir": 0.6497500907548364, "get_state_dump": 0.030840090763421705, "sim_render-ego": 0.006371892528769411, "in-drivable-lane": 2.1999999999999926, "agent_compute-ego": 0.03097591576752839, "deviation-heading": 0.21987475169154813, "complete-iteration": 0.3321622359899827, "set_robot_commands": 0.004970506385520652, "deviation-center-line": 0.1316870511375048, "driven_lanedir_consec": 0.6497500907548364, "sim_compute_sim_state": 0.016203671325871975, "sim_compute_performance-ego": 0.004118607367998288, "sim_compute_robot_state-ego": 0.007511032952202691, "sim_compute_robot_state-npc0": 0.007545109148378725, "sim_compute_robot_state-npc1": 0.007223105724946952, "sim_compute_robot_state-npc2": 0.007236677923320252, "sim_compute_robot_state-npc3": 0.007259354179288134, "sim_compute_robot_state-parked0": 0.007555858588513033}, "udem1-sc2-0-ego": {"driven_any": 1.8069248215632787, "get_ui_image": 0.05525815215977756, "step_physics": 0.143779226324775, "survival_time": 4.399999999999992, "driven_lanedir": 0.5309482697103225, "get_state_dump": 0.029678694226525047, "sim_render-ego": 0.00684373758055947, "in-drivable-lane": 2.5999999999999943, "agent_compute-ego": 0.030287300998514347, "deviation-heading": 0.821756013266449, "complete-iteration": 0.34263218532909046, "set_robot_commands": 0.005336864428086715, "deviation-center-line": 0.17311258344521005, "driven_lanedir_consec": 0.5309482697103225, "sim_compute_sim_state": 0.01685750213536349, "sim_compute_performance-ego": 0.004426566037264737, "sim_compute_robot_state-ego": 0.008686791766773571, "sim_compute_robot_state-npc0": 0.008108510212464766, "sim_compute_robot_state-npc1": 0.008336205374110828, "sim_compute_robot_state-npc2": 0.008410423994064331, "sim_compute_robot_state-npc3": 0.008107301863757048, "sim_compute_robot_state-parked0": 0.008282054554332386}, "udem1-sc3-0-ego": {"driven_any": 0.8006369147274865, "get_ui_image": 0.054356143588111513, "step_physics": 0.15975666046142578, "survival_time": 2.1000000000000005, "driven_lanedir": 0.7513234886278148, "get_state_dump": 0.031201981362842374, "sim_render-ego": 0.006187421934945243, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.029454197202410017, "deviation-heading": 0.3862027445592439, "complete-iteration": 0.35420955362774076, "set_robot_commands": 0.00462360041482108, "deviation-center-line": 0.07893440221925406, "driven_lanedir_consec": 0.7513234886278148, "sim_compute_sim_state": 0.020616661934625535, "sim_compute_performance-ego": 0.004142420632498605, "sim_compute_robot_state-ego": 0.007076848120916458, "sim_compute_robot_state-npc0": 0.007471771467299689, "sim_compute_robot_state-npc1": 0.007006548699878511, "sim_compute_robot_state-npc2": 0.007205650919959659, "sim_compute_robot_state-npc3": 0.007299990881057013, "sim_compute_robot_state-parked0": 0.007586819784981864}, "udem1-sc4-0-ego": {"driven_any": 1.7175261671406614, "get_ui_image": 0.052746915817260744, "step_physics": 0.125839564204216, "survival_time": 3.999999999999994, "driven_lanedir": 0.36228852478726825, "get_state_dump": 0.03128623366355896, "sim_render-ego": 0.0063997477293014525, "in-drivable-lane": 2.5499999999999936, "agent_compute-ego": 0.03046698272228241, "deviation-heading": 0.8309452702743971, "complete-iteration": 0.318138113617897, "set_robot_commands": 0.004876556992530823, "deviation-center-line": 0.14442735414914476, "driven_lanedir_consec": 0.36228852478726825, "sim_compute_sim_state": 0.018427687883377075, "sim_compute_performance-ego": 0.0043343275785446165, "sim_compute_robot_state-ego": 0.007218861579895019, "sim_compute_robot_state-npc0": 0.007536906003952027, "sim_compute_robot_state-npc1": 0.0070504963397979735, "sim_compute_robot_state-npc2": 0.006925895810127258, "sim_compute_robot_state-npc3": 0.007223245501518249, "sim_compute_robot_state-parked0": 0.007575061917304992}, "udem1-sc5-0-ego": {"driven_any": 1.6834787159499032, "get_ui_image": 0.054005918732608654, "step_physics": 0.12500665561262383, "survival_time": 4.149999999999993, "driven_lanedir": 0.4288789649417757, "get_state_dump": 0.030424678182027425, "sim_render-ego": 0.006567216781248529, "in-drivable-lane": 2.3999999999999932, "agent_compute-ego": 0.029582793454089797, "deviation-heading": 1.0985823861669952, "complete-iteration": 0.32021052866096955, "set_robot_commands": 0.004946895392544298, "deviation-center-line": 0.1488075947581576, "driven_lanedir_consec": 0.4288789649417757, "sim_compute_sim_state": 0.021393462836024273, "sim_compute_performance-ego": 0.004370479698640755, "sim_compute_robot_state-ego": 0.007485151290893555, "sim_compute_robot_state-npc0": 0.007351814982402755, "sim_compute_robot_state-npc1": 0.007086386163550687, "sim_compute_robot_state-npc2": 0.007013516253735645, "sim_compute_robot_state-npc3": 0.00723259420279997, "sim_compute_robot_state-parked0": 0.007516700101185994}, "udem1-sc6-0-ego": {"driven_any": 2.8495634364507954, "get_ui_image": 0.05450586774455967, "step_physics": 0.13829243183135986, "survival_time": 6.699999999999984, "driven_lanedir": 1.875028073870427, "get_state_dump": 0.03058645262647031, "sim_render-ego": 0.006983806837850542, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.0299098029065488, "deviation-heading": 0.6370181661839738, "complete-iteration": 0.337148443976445, "set_robot_commands": 0.0055560158259833035, "deviation-center-line": 0.20092590743448857, "driven_lanedir_consec": 1.451165953091315, "sim_compute_sim_state": 0.017822858112961498, "sim_compute_performance-ego": 0.00441770411249417, "sim_compute_robot_state-ego": 0.00875188165636205, "sim_compute_robot_state-npc0": 0.007814291697829517, "sim_compute_robot_state-npc1": 0.007849714649257376, "sim_compute_robot_state-npc2": 0.007975453761086534, "sim_compute_robot_state-npc3": 0.008223969544937362, "sim_compute_robot_state-parked0": 0.008229819696340988}, "udem1-sc7-0-ego": {"driven_any": 3.4377404982533286, "get_ui_image": 0.05422952040186469, "step_physics": 0.14119048688396718, "survival_time": 7.94999999999998, "driven_lanedir": 2.2700968138041833, "get_state_dump": 0.03146699389571664, "sim_render-ego": 0.006314979409271816, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.03019432751637585, "deviation-heading": 1.4486706467120278, "complete-iteration": 0.33439437098473124, "set_robot_commands": 0.004859604925479529, "deviation-center-line": 0.6910962119878233, "driven_lanedir_consec": 2.2467398736422166, "sim_compute_sim_state": 0.01695386268807657, "sim_compute_performance-ego": 0.004093084695204249, "sim_compute_robot_state-ego": 0.0075393112950355, "sim_compute_robot_state-npc0": 0.007553799347307697, "sim_compute_robot_state-npc1": 0.007379761282003151, "sim_compute_robot_state-npc2": 0.007358234633439742, "sim_compute_robot_state-npc3": 0.007448001477703359, "sim_compute_robot_state-parked0": 0.007583828092371143}, "udem1-sc8-0-ego": {"driven_any": 2.059331728359254, "get_ui_image": 0.05544252248154473, "step_physics": 0.15079427011234245, "survival_time": 4.849999999999991, "driven_lanedir": 1.100066728049779, "get_state_dump": 0.029572570446840266, "sim_render-ego": 0.0061496901757938345, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.02938456879448645, "deviation-heading": 0.2609717934465678, "complete-iteration": 0.3403075749112159, "set_robot_commands": 0.00470235175693158, "deviation-center-line": 0.26612607435859403, "driven_lanedir_consec": 1.0989724384040085, "sim_compute_sim_state": 0.016021246762619804, "sim_compute_performance-ego": 0.00398660689285121, "sim_compute_robot_state-ego": 0.007437905085455512, "sim_compute_robot_state-npc0": 0.007250262289932093, "sim_compute_robot_state-npc1": 0.007314490288803258, "sim_compute_robot_state-npc2": 0.007381480993683805, "sim_compute_robot_state-npc3": 0.007350734828673687, "sim_compute_robot_state-parked0": 0.0072980123696867955}, "udem1-sc9-0-ego": {"driven_any": 1.6932117732223284, "get_ui_image": 0.054484567046165465, "step_physics": 0.13157080113887787, "survival_time": 3.999999999999994, "driven_lanedir": 0.6461172718464347, "get_state_dump": 0.030164220929145814, "sim_render-ego": 0.0064499199390411375, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.030349212884902953, "deviation-heading": 0.9141633172540072, "complete-iteration": 0.3262326121330261, "set_robot_commands": 0.004861071705818176, "deviation-center-line": 0.1517178415640418, "driven_lanedir_consec": 0.6461172718464347, "sim_compute_sim_state": 0.020842954516410828, "sim_compute_performance-ego": 0.004171597957611084, "sim_compute_robot_state-ego": 0.0070018768310546875, "sim_compute_robot_state-npc0": 0.007570582628250122, "sim_compute_robot_state-npc1": 0.00706075131893158, "sim_compute_robot_state-npc2": 0.0071233600378036496, "sim_compute_robot_state-npc3": 0.007155197858810425, "sim_compute_robot_state-parked0": 0.007205882668495178}, "udem1-sc10-0-ego": {"driven_any": 2.829514228956659, "get_ui_image": 0.05518497560257302, "step_physics": 0.14108951647478837, "survival_time": 6.649999999999984, "driven_lanedir": 1.3769437991511737, "get_state_dump": 0.03011620851387655, "sim_render-ego": 0.006635631833757673, "in-drivable-lane": 2.79999999999999, "agent_compute-ego": 0.029749723305379536, "deviation-heading": 1.0782247681019923, "complete-iteration": 0.34439682601986077, "set_robot_commands": 0.005181502578850079, "deviation-center-line": 0.3589271948061821, "driven_lanedir_consec": 1.3766933074322054, "sim_compute_sim_state": 0.021076912270452743, "sim_compute_performance-ego": 0.0043532346424303555, "sim_compute_robot_state-ego": 0.00901341796817636, "sim_compute_robot_state-npc0": 0.008298011650716452, "sim_compute_robot_state-npc1": 0.008263077054704939, "sim_compute_robot_state-npc2": 0.00840945351392703, "sim_compute_robot_state-npc3": 0.008367450613724558, "sim_compute_robot_state-parked0": 0.008436518504207296}, "udem1-sc11-0-ego": {"driven_any": 1.6732675334610676, "get_ui_image": 0.0591193746637415, "step_physics": 0.13677118442676686, "survival_time": 4.049999999999994, "driven_lanedir": 0.740088497182728, "get_state_dump": 0.029171340259504908, "sim_render-ego": 0.006500894640698845, "in-drivable-lane": 2.0499999999999927, "agent_compute-ego": 0.03018018051430031, "deviation-heading": 0.27358421252914833, "complete-iteration": 0.339706830036493, "set_robot_commands": 0.0052994386649426115, "deviation-center-line": 0.06494571772210404, "driven_lanedir_consec": 0.6641562114573031, "sim_compute_sim_state": 0.019132478737536773, "sim_compute_performance-ego": 0.004307690961861316, "sim_compute_robot_state-ego": 0.008321061546419874, "sim_compute_robot_state-npc0": 0.008024474720896027, "sim_compute_robot_state-npc1": 0.008041852786217206, "sim_compute_robot_state-npc2": 0.008200445292908469, "sim_compute_robot_state-npc3": 0.008252915040946301, "sim_compute_robot_state-parked0": 0.00815479549360864}, "udem1-sc12-0-ego": {"driven_any": 2.8497284656256134, "get_ui_image": 0.055853757788153255, "step_physics": 0.14635189491159775, "survival_time": 6.799999999999984, "driven_lanedir": 1.243537592627009, "get_state_dump": 0.030908398768481088, "sim_render-ego": 0.006992029793122236, "in-drivable-lane": 3.4999999999999876, "agent_compute-ego": 0.029946364024106192, "deviation-heading": 0.6351181716310226, "complete-iteration": 0.3522795070620144, "set_robot_commands": 0.005504052428638234, "deviation-center-line": 0.1338032860724614, "driven_lanedir_consec": 1.243537592627009, "sim_compute_sim_state": 0.021325353313894832, "sim_compute_performance-ego": 0.004445237271925982, "sim_compute_robot_state-ego": 0.009033983244615445, "sim_compute_robot_state-npc0": 0.008165324435514562, "sim_compute_robot_state-npc1": 0.008336731616188498, "sim_compute_robot_state-npc2": 0.008290913175134099, "sim_compute_robot_state-npc3": 0.00850065315470976, "sim_compute_robot_state-parked0": 0.00839474271325504}, "udem1-sc13-0-ego": {"driven_any": 2.3043802184845057, "get_ui_image": 0.05684880675556504, "step_physics": 0.13324469717863563, "survival_time": 5.349999999999989, "driven_lanedir": 0.29028938101777335, "get_state_dump": 0.031205876965389075, "sim_render-ego": 0.006473030999442127, "in-drivable-lane": 4.349999999999989, "agent_compute-ego": 0.03118815823136089, "deviation-heading": 0.3638671131427464, "complete-iteration": 0.3393597580562128, "set_robot_commands": 0.005387566914068204, "deviation-center-line": 0.06760826892431042, "driven_lanedir_consec": 0.29028938101777335, "sim_compute_sim_state": 0.024182154753497827, "sim_compute_performance-ego": 0.004303698227784344, "sim_compute_robot_state-ego": 0.008029875354232075, "sim_compute_robot_state-npc0": 0.007706027164637486, "sim_compute_robot_state-npc1": 0.007472131853905794, "sim_compute_robot_state-npc2": 0.0075090599951343, "sim_compute_robot_state-npc3": 0.00787062065623631, "sim_compute_robot_state-parked0": 0.0077132554811852}, "udem1-sc14-0-ego": {"driven_any": 1.782957983049124, "get_ui_image": 0.052440550748039695, "step_physics": 0.13131900114171646, "survival_time": 4.249999999999993, "driven_lanedir": 0.581625265152717, "get_state_dump": 0.03011743040645824, "sim_render-ego": 0.006493683422313017, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.02913635758792653, "deviation-heading": 1.0304221923624517, "complete-iteration": 0.318082509321325, "set_robot_commands": 0.004967605366426355, "deviation-center-line": 0.1485546737890131, "driven_lanedir_consec": 0.581625265152717, "sim_compute_sim_state": 0.016507760216208065, "sim_compute_performance-ego": 0.004087504218606388, "sim_compute_robot_state-ego": 0.007097045113058652, "sim_compute_robot_state-npc0": 0.007442771687227137, "sim_compute_robot_state-npc1": 0.006787583407233743, "sim_compute_robot_state-npc2": 0.006963752297794118, "sim_compute_robot_state-npc3": 0.007329545301549575, "sim_compute_robot_state-parked0": 0.00717474993537454}}
set_robot_commands_max0.0055560158259833035
set_robot_commands_mean0.005042340977361685
set_robot_commands_median0.004967605366426355
set_robot_commands_min0.00456148087978363
sim_compute_performance-ego_max0.004445237271925982
sim_compute_performance-ego_mean0.0042557688004710385
sim_compute_performance-ego_median0.004303698227784344
sim_compute_performance-ego_min0.00398660689285121
sim_compute_robot_state-ego_max0.009033983244615445
sim_compute_robot_state-ego_mean0.007847932275960768
sim_compute_robot_state-ego_median0.007513940334320068
sim_compute_robot_state-ego_min0.0070018768310546875
sim_compute_robot_state-npc0_max0.008298011650716452
sim_compute_robot_state-npc0_mean0.007676565552486387
sim_compute_robot_state-npc0_median0.007553799347307697
sim_compute_robot_state-npc0_min0.007250262289932093
sim_compute_robot_state-npc1_max0.008336731616188498
sim_compute_robot_state-npc1_mean0.00751624534951822
sim_compute_robot_state-npc1_median0.007379761282003151
sim_compute_robot_state-npc1_min0.006787583407233743
sim_compute_robot_state-npc2_max0.008410423994064331
sim_compute_robot_state-npc2_mean0.007556214333059656
sim_compute_robot_state-npc2_median0.007358234633439742
sim_compute_robot_state-npc2_min0.006925895810127258
sim_compute_robot_state-npc3_max0.00850065315470976
sim_compute_robot_state-npc3_mean0.007680678414538498
sim_compute_robot_state-npc3_median0.007448001477703359
sim_compute_robot_state-npc3_min0.007155197858810425
sim_compute_robot_state-parked0_max0.008436518504207296
sim_compute_robot_state-parked0_mean0.00775389799668798
sim_compute_robot_state-parked0_median0.007586819784981864
sim_compute_robot_state-parked0_min0.00717474993537454
sim_compute_sim_state_max0.024182154753497827
sim_compute_sim_state_mean0.018880997695424777
sim_compute_sim_state_median0.018427687883377075
sim_compute_sim_state_min0.015850397944450378
sim_render-ego_max0.006992029793122236
sim_render-ego_mean0.006524905778628413
sim_render-ego_median0.006493683422313017
sim_render-ego_min0.0061496901757938345
simulation-passed1
step_physics_max0.15975666046142578
step_physics_mean0.1389770534330288
step_physics_median0.13829243183135986
step_physics_min0.12500665561262383
survival_time_max7.94999999999998
survival_time_mean4.886666666666658
survival_time_min2.1000000000000005
No reset possible
361589957Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simsuccessnoSandy1-sandy-10:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4513253938788271
survival_time_median1.4000000000000006
deviation-center-line_median0.06765510590993717
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03897660970687866
agent_compute-ego0_mean0.03897660970687866
agent_compute-ego0_median0.03897660970687866
agent_compute-ego0_min0.03897660970687866
agent_compute-ego1_max0.038993426731654575
agent_compute-ego1_mean0.038993426731654575
agent_compute-ego1_median0.038993426731654575
agent_compute-ego1_min0.038993426731654575
agent_compute-ego2_max0.03655360426221575
agent_compute-ego2_mean0.03655360426221575
agent_compute-ego2_median0.03655360426221575
agent_compute-ego2_min0.03655360426221575
complete-iteration_max0.8344898990222386
complete-iteration_mean0.8344898990222386
complete-iteration_median0.8344898990222386
complete-iteration_min0.8344898990222386
deviation-center-line_max0.08268604467768378
deviation-center-line_mean0.06972428646591035
deviation-center-line_min0.05883170881011011
deviation-heading_max0.34026865010654345
deviation-heading_mean0.20076786897579912
deviation-heading_median0.1995635348005658
deviation-heading_min0.06247142202028814
driven_any_max0.45800751537035295
driven_any_mean0.45800751537035106
driven_any_median0.4580075153703512
driven_any_min0.45800751537034895
driven_lanedir_consec_max0.4569612677734005
driven_lanedir_consec_mean0.4260928939651853
driven_lanedir_consec_min0.3699920202433282
driven_lanedir_max0.4569612677734005
driven_lanedir_mean0.4260928939651853
driven_lanedir_median0.4513253938788271
driven_lanedir_min0.3699920202433282
get_state_dump_max0.04032565014702933
get_state_dump_mean0.04032565014702933
get_state_dump_median0.04032565014702933
get_state_dump_min0.04032565014702933
get_ui_image_max0.06472116708755493
get_ui_image_mean0.06472116708755493
get_ui_image_median0.06472116708755493
get_ui_image_min0.06472116708755493
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.05000000000000005
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego0": {"driven_any": 0.45800751537035295, "get_ui_image": 0.06472116708755493, "step_physics": 0.46155459540230886, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4513253938788271, "get_state_dump": 0.04032565014702933, "sim_render-ego0": 0.007306482110704694, "sim_render-ego1": 0.00623473950794765, "sim_render-ego2": 0.005863734654017857, "in-drivable-lane": 0.0, "deviation-heading": 0.1995635348005658, "agent_compute-ego0": 0.03897660970687866, "agent_compute-ego1": 0.038993426731654575, "agent_compute-ego2": 0.03655360426221575, "complete-iteration": 0.8344898990222386, "set_robot_commands": 0.004326394626072475, "deviation-center-line": 0.06765510590993717, "driven_lanedir_consec": 0.4513253938788271, "sim_compute_sim_state": 0.04174416405814035, "sim_compute_performance-ego0": 0.004424844469342913, "sim_compute_performance-ego1": 0.004027009010314941, "sim_compute_performance-ego2": 0.003803917339869908, "sim_compute_robot_state-ego0": 0.007320387022835868, "sim_compute_robot_state-ego1": 0.007266138281141009, "sim_compute_robot_state-ego2": 0.007474243640899658, "sim_compute_robot_state-parked0": 0.007481677191598075, "sim_compute_robot_state-parked1": 0.007093523229871478, "sim_compute_robot_state-parked2": 0.006985076836177281, "sim_compute_robot_state-parked3": 0.0070787327630179265, "sim_compute_robot_state-parked4": 0.007568291255405971, "sim_compute_robot_state-parked5": 0.007495505469185966}, "udem1-sc0-0-ego1": {"driven_any": 0.45800751537034895, "get_ui_image": 0.06472116708755493, "step_physics": 0.46155459540230886, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4569612677734005, "get_state_dump": 0.04032565014702933, "sim_render-ego0": 0.007306482110704694, "sim_render-ego1": 0.00623473950794765, "sim_render-ego2": 0.005863734654017857, "in-drivable-lane": 0.0, "deviation-heading": 0.06247142202028814, "agent_compute-ego0": 0.03897660970687866, "agent_compute-ego1": 0.038993426731654575, "agent_compute-ego2": 0.03655360426221575, "complete-iteration": 0.8344898990222386, "set_robot_commands": 0.004326394626072475, "deviation-center-line": 0.05883170881011011, "driven_lanedir_consec": 0.4569612677734005, "sim_compute_sim_state": 0.04174416405814035, "sim_compute_performance-ego0": 0.004424844469342913, "sim_compute_performance-ego1": 0.004027009010314941, "sim_compute_performance-ego2": 0.003803917339869908, "sim_compute_robot_state-ego0": 0.007320387022835868, "sim_compute_robot_state-ego1": 0.007266138281141009, "sim_compute_robot_state-ego2": 0.007474243640899658, "sim_compute_robot_state-parked0": 0.007481677191598075, "sim_compute_robot_state-parked1": 0.007093523229871478, "sim_compute_robot_state-parked2": 0.006985076836177281, "sim_compute_robot_state-parked3": 0.0070787327630179265, "sim_compute_robot_state-parked4": 0.007568291255405971, "sim_compute_robot_state-parked5": 0.007495505469185966}, "udem1-sc0-0-ego2": {"driven_any": 0.4580075153703512, "get_ui_image": 0.06472116708755493, "step_physics": 0.46155459540230886, "survival_time": 1.4000000000000006, "driven_lanedir": 0.3699920202433282, "get_state_dump": 0.04032565014702933, "sim_render-ego0": 0.007306482110704694, "sim_render-ego1": 0.00623473950794765, "sim_render-ego2": 0.005863734654017857, "in-drivable-lane": 0.15000000000000013, "deviation-heading": 0.34026865010654345, "agent_compute-ego0": 0.03897660970687866, "agent_compute-ego1": 0.038993426731654575, "agent_compute-ego2": 0.03655360426221575, "complete-iteration": 0.8344898990222386, "set_robot_commands": 0.004326394626072475, "deviation-center-line": 0.08268604467768378, "driven_lanedir_consec": 0.3699920202433282, "sim_compute_sim_state": 0.04174416405814035, "sim_compute_performance-ego0": 0.004424844469342913, "sim_compute_performance-ego1": 0.004027009010314941, "sim_compute_performance-ego2": 0.003803917339869908, "sim_compute_robot_state-ego0": 0.007320387022835868, "sim_compute_robot_state-ego1": 0.007266138281141009, "sim_compute_robot_state-ego2": 0.007474243640899658, "sim_compute_robot_state-parked0": 0.007481677191598075, "sim_compute_robot_state-parked1": 0.007093523229871478, "sim_compute_robot_state-parked2": 0.006985076836177281, "sim_compute_robot_state-parked3": 0.0070787327630179265, "sim_compute_robot_state-parked4": 0.007568291255405971, "sim_compute_robot_state-parked5": 0.007495505469185966}}
set_robot_commands_max0.004326394626072475
set_robot_commands_mean0.004326394626072475
set_robot_commands_median0.004326394626072475
set_robot_commands_min0.004326394626072475
sim_compute_performance-ego0_max0.004424844469342913
sim_compute_performance-ego0_mean0.004424844469342913
sim_compute_performance-ego0_median0.004424844469342913
sim_compute_performance-ego0_min0.004424844469342913
sim_compute_performance-ego1_max0.004027009010314941
sim_compute_performance-ego1_mean0.004027009010314941
sim_compute_performance-ego1_median0.004027009010314941
sim_compute_performance-ego1_min0.004027009010314941
sim_compute_performance-ego2_max0.003803917339869908
sim_compute_performance-ego2_mean0.003803917339869908
sim_compute_performance-ego2_median0.003803917339869908
sim_compute_performance-ego2_min0.003803917339869908
sim_compute_robot_state-ego0_max0.007320387022835868
sim_compute_robot_state-ego0_mean0.007320387022835867
sim_compute_robot_state-ego0_median0.007320387022835868
sim_compute_robot_state-ego0_min0.007320387022835868
sim_compute_robot_state-ego1_max0.007266138281141009
sim_compute_robot_state-ego1_mean0.007266138281141009
sim_compute_robot_state-ego1_median0.007266138281141009
sim_compute_robot_state-ego1_min0.007266138281141009
sim_compute_robot_state-ego2_max0.007474243640899658
sim_compute_robot_state-ego2_mean0.007474243640899658
sim_compute_robot_state-ego2_median0.007474243640899658
sim_compute_robot_state-ego2_min0.007474243640899658
sim_compute_robot_state-parked0_max0.007481677191598075
sim_compute_robot_state-parked0_mean0.007481677191598074
sim_compute_robot_state-parked0_median0.007481677191598075
sim_compute_robot_state-parked0_min0.007481677191598075
sim_compute_robot_state-parked1_max0.007093523229871478
sim_compute_robot_state-parked1_mean0.007093523229871478
sim_compute_robot_state-parked1_median0.007093523229871478
sim_compute_robot_state-parked1_min0.007093523229871478
sim_compute_robot_state-parked2_max0.006985076836177281
sim_compute_robot_state-parked2_mean0.006985076836177281
sim_compute_robot_state-parked2_median0.006985076836177281
sim_compute_robot_state-parked2_min0.006985076836177281
sim_compute_robot_state-parked3_max0.0070787327630179265
sim_compute_robot_state-parked3_mean0.0070787327630179265
sim_compute_robot_state-parked3_median0.0070787327630179265
sim_compute_robot_state-parked3_min0.0070787327630179265
sim_compute_robot_state-parked4_max0.007568291255405971
sim_compute_robot_state-parked4_mean0.007568291255405971
sim_compute_robot_state-parked4_median0.007568291255405971
sim_compute_robot_state-parked4_min0.007568291255405971
sim_compute_robot_state-parked5_max0.007495505469185966
sim_compute_robot_state-parked5_mean0.007495505469185965
sim_compute_robot_state-parked5_median0.007495505469185966
sim_compute_robot_state-parked5_min0.007495505469185966
sim_compute_sim_state_max0.04174416405814035
sim_compute_sim_state_mean0.04174416405814035
sim_compute_sim_state_median0.04174416405814035
sim_compute_sim_state_min0.04174416405814035
sim_render-ego0_max0.007306482110704694
sim_render-ego0_mean0.007306482110704694
sim_render-ego0_median0.007306482110704694
sim_render-ego0_min0.007306482110704694
sim_render-ego1_max0.00623473950794765
sim_render-ego1_mean0.00623473950794765
sim_render-ego1_median0.00623473950794765
sim_render-ego1_min0.00623473950794765
sim_render-ego2_max0.005863734654017857
sim_render-ego2_mean0.005863734654017857
sim_render-ego2_median0.005863734654017857
sim_render-ego2_min0.005863734654017857
simulation-passed1
step_physics_max0.46155459540230886
step_physics_mean0.46155459540230886
step_physics_median0.46155459540230886
step_physics_min0.46155459540230886
survival_time_max1.4000000000000006
survival_time_mean1.4000000000000006
survival_time_min1.4000000000000006
No reset possible
361569959Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simsuccessnoSandy1-sandy-10:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5878970450502723
survival_time_median10.950000000000022
deviation-center-line_median0.23211348485163824
in-drivable-lane_median7.175000000000029


other stats
agent_compute-ego_max0.0220497553883074
agent_compute-ego_mean0.02157154685244573
agent_compute-ego_median0.021635024238797
agent_compute-ego_min0.020966383543881504
complete-iteration_max0.2062496018409729
complete-iteration_mean0.2026234714164045
complete-iteration_median0.2023325025276014
complete-iteration_min0.1995792787694422
deviation-center-line_max0.34338607823154926
deviation-center-line_mean0.23543277224821776
deviation-center-line_min0.13411804105804526
deviation-heading_max1.5879915541980465
deviation-heading_mean0.7519805263253957
deviation-heading_median0.5170812199983161
deviation-heading_min0.3857681111069043
driven_any_max4.170360891007898
driven_any_mean2.726511332296653
driven_any_median3.121898296330709
driven_any_min0.49188784551729625
driven_lanedir_consec_max1.3223676127236927
driven_lanedir_consec_mean0.7186093789904544
driven_lanedir_consec_min0.3762758131375801
driven_lanedir_max1.3223676127236927
driven_lanedir_mean0.7186093789904544
driven_lanedir_median0.5878970450502723
driven_lanedir_min0.3762758131375801
get_state_dump_max0.015773770156180023
get_state_dump_mean0.015291664243134042
get_state_dump_median0.015181210736787193
get_state_dump_min0.01503046534278176
get_ui_image_max0.03473925590515137
get_ui_image_mean0.033445102285548346
get_ui_image_median0.03315387550939167
get_ui_image_min0.03273340221825868
in-drivable-lane_max12.100000000000064
in-drivable-lane_mean6.687500000000031
in-drivable-lane_min0.29999999999999916
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2854553904600294, "get_ui_image": 0.03282464233932981, "step_physics": 0.07610853918039115, "survival_time": 7.84999999999998, "driven_lanedir": 0.7439396204784537, "get_state_dump": 0.015773770156180023, "sim_render-ego": 0.007242456363264922, "in-drivable-lane": 4.999999999999985, "agent_compute-ego": 0.021448250788791923, "deviation-heading": 0.5581467848827308, "complete-iteration": 0.19962675556255757, "set_robot_commands": 0.005726545479646914, "deviation-center-line": 0.3282075246145834, "driven_lanedir_consec": 0.7439396204784537, "sim_compute_sim_state": 0.017563932260889915, "sim_compute_performance-ego": 0.004975461656120932, "sim_compute_robot_state-ego": 0.009659092897062849, "sim_compute_robot_state-parked0": 0.008141385521858361}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.170360891007898, "get_ui_image": 0.03348310867945353, "step_physics": 0.08404810905456543, "survival_time": 14.950000000000076, "driven_lanedir": 1.3223676127236927, "get_state_dump": 0.015087523460388184, "sim_render-ego": 0.007080613772074381, "in-drivable-lane": 9.350000000000072, "agent_compute-ego": 0.02182179768880208, "deviation-heading": 1.5879915541980465, "complete-iteration": 0.2062496018409729, "set_robot_commands": 0.005336971282958985, "deviation-center-line": 0.34338607823154926, "driven_lanedir_consec": 1.3223676127236927, "sim_compute_sim_state": 0.01707620938618978, "sim_compute_performance-ego": 0.004656358559926351, "sim_compute_robot_state-ego": 0.009103854497273764, "sim_compute_robot_state-parked0": 0.008395260175069173}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.958341202201389, "get_ui_image": 0.03273340221825868, "step_physics": 0.08070393389230097, "survival_time": 14.050000000000065, "driven_lanedir": 0.43185446962209095, "get_state_dump": 0.0152748980131862, "sim_render-ego": 0.007024739560707608, "in-drivable-lane": 12.100000000000064, "agent_compute-ego": 0.0220497553883074, "deviation-heading": 0.47601565511390137, "complete-iteration": 0.1995792787694422, "set_robot_commands": 0.005305627911116305, "deviation-center-line": 0.13411804105804526, "driven_lanedir_consec": 0.43185446962209095, "sim_compute_sim_state": 0.014075895221207916, "sim_compute_performance-ego": 0.0046992615872854865, "sim_compute_robot_state-ego": 0.009181810867743985, "sim_compute_robot_state-parked0": 0.008368874784041979}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.49188784551729625, "get_ui_image": 0.03473925590515137, "step_physics": 0.0874127745628357, "survival_time": 2.2, "driven_lanedir": 0.3762758131375801, "get_state_dump": 0.01503046534278176, "sim_render-ego": 0.006638743660666726, "in-drivable-lane": 0.29999999999999916, "agent_compute-ego": 0.020966383543881504, "deviation-heading": 0.3857681111069043, "complete-iteration": 0.2050382494926453, "set_robot_commands": 0.004833595319227738, "deviation-center-line": 0.13601944508869307, "driven_lanedir_consec": 0.3762758131375801, "sim_compute_sim_state": 0.015565444122661243, "sim_compute_performance-ego": 0.0043162974444302645, "sim_compute_robot_state-ego": 0.007822210138494318, "sim_compute_robot_state-parked0": 0.007548521865497936}}
set_robot_commands_max0.005726545479646914
set_robot_commands_mean0.005300684998237485
set_robot_commands_median0.005321299597037645
set_robot_commands_min0.004833595319227738
sim_compute_performance-ego_max0.004975461656120932
sim_compute_performance-ego_mean0.004661844811940759
sim_compute_performance-ego_median0.004677810073605919
sim_compute_performance-ego_min0.0043162974444302645
sim_compute_robot_state-ego_max0.009659092897062849
sim_compute_robot_state-ego_mean0.00894174210014373
sim_compute_robot_state-ego_median0.009142832682508874
sim_compute_robot_state-ego_min0.007822210138494318
sim_compute_robot_state-parked0_max0.008395260175069173
sim_compute_robot_state-parked0_mean0.008113510586616862
sim_compute_robot_state-parked0_median0.00825513015295017
sim_compute_robot_state-parked0_min0.007548521865497936
sim_compute_sim_state_max0.017563932260889915
sim_compute_sim_state_mean0.016070370247737213
sim_compute_sim_state_median0.01632082675442551
sim_compute_sim_state_min0.014075895221207916
sim_render-ego_max0.007242456363264922
sim_render-ego_mean0.006996638339178409
sim_render-ego_median0.007052676666390995
sim_render-ego_min0.006638743660666726
simulation-passed1
step_physics_max0.0874127745628357
step_physics_mean0.0820683391725233
step_physics_median0.0823760214734332
step_physics_min0.07610853918039115
survival_time_max14.950000000000076
survival_time_mean9.762500000000031
survival_time_min2.2
No reset possible
361099998Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simsuccessnoSandy1-sandy-10:29:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.603105389055139
survival_time_median7.449999999999981
deviation-center-line_median0.33402699046660184
in-drivable-lane_median2.3499999999999917


other stats
agent_compute-ego_max0.0309712047930117
agent_compute-ego_mean0.029862524371393355
agent_compute-ego_median0.02995044787724813
agent_compute-ego_min0.028933251605314368
complete-iteration_max0.3565026736650311
complete-iteration_mean0.33334591357491633
complete-iteration_median0.3346110343933105
complete-iteration_min0.3002052044167238
deviation-center-line_max1.0448778138815191
deviation-center-line_mean0.35577721436617116
deviation-center-line_min0.11873049729392472
deviation-heading_max2.3674645275360993
deviation-heading_mean1.1988837481535328
deviation-heading_median0.9771969087342148
deviation-heading_min0.4680611555303739
driven_any_max2.41949506654321
driven_any_mean1.3621818442116245
driven_any_median1.1714383183786077
driven_any_min0.4430550625482196
driven_lanedir_consec_max2.0456931805226946
driven_lanedir_consec_mean0.6469084793556983
driven_lanedir_consec_min0.2541693488907706
driven_lanedir_max2.0456931805226946
driven_lanedir_mean0.6469084793556983
driven_lanedir_median0.603105389055139
driven_lanedir_min0.2541693488907706
get_state_dump_max0.03244492351608788
get_state_dump_mean0.031169307567437955
get_state_dump_median0.030883886019388834
get_state_dump_min0.02966860112021951
get_ui_image_max0.05262599388758341
get_ui_image_mean0.05065053959902956
get_ui_image_median0.05086441509059218
get_ui_image_min0.048046734693239064
in-drivable-lane_max10.500000000000076
in-drivable-lane_mean4.0266666666666815
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.051062958996470384, "step_physics": 0.12866297582300698, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.030676802484000603, "sim_render-ego": 0.006791757374275021, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.029302453122487884, "deviation-heading": 0.656882474004175, "complete-iteration": 0.32575770122248954, "set_robot_commands": 0.005542963016323927, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.018379915051343964, "sim_compute_performance-ego": 0.00447155789631169, "sim_compute_robot_state-ego": 0.008867153307286704, "sim_compute_robot_state-npc0": 0.008124412559881443, "sim_compute_robot_state-npc1": 0.008399480726660752, "sim_compute_robot_state-npc2": 0.008279066260268048, "sim_compute_robot_state-npc3": 0.00846097963612254, "sim_compute_robot_state-parked0": 0.00850421626393388}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.4152240999375416, "get_ui_image": 0.05063325564066569, "step_physics": 0.14686262210210163, "survival_time": 14.950000000000076, "driven_lanedir": 2.0456931805226946, "get_state_dump": 0.030433936913808187, "sim_render-ego": 0.006817143758138021, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.02924478689829509, "deviation-heading": 0.9771969087342148, "complete-iteration": 0.3421405784289042, "set_robot_commands": 0.0054467312494913735, "deviation-center-line": 1.0448778138815191, "driven_lanedir_consec": 2.0456931805226946, "sim_compute_sim_state": 0.016594475110371907, "sim_compute_performance-ego": 0.004498183727264404, "sim_compute_robot_state-ego": 0.00881434440612793, "sim_compute_robot_state-npc0": 0.008300355275472005, "sim_compute_robot_state-npc1": 0.008451496760050456, "sim_compute_robot_state-npc2": 0.008637700875600179, "sim_compute_robot_state-npc3": 0.00860137701034546, "sim_compute_robot_state-parked0": 0.0085700527826945}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2700357301999614, "get_ui_image": 0.049918704844535665, "step_physics": 0.11836209449362248, "survival_time": 14.100000000000064, "driven_lanedir": 0.5249395572253229, "get_state_dump": 0.03187058496137037, "sim_render-ego": 0.007089357849553967, "in-drivable-lane": 9.700000000000044, "agent_compute-ego": 0.030290740601559903, "deviation-heading": 2.204431586558605, "complete-iteration": 0.3224717395525452, "set_robot_commands": 0.005967090315852605, "deviation-center-line": 0.46507411597051385, "driven_lanedir_consec": 0.5249395572253229, "sim_compute_sim_state": 0.019763446023278203, "sim_compute_performance-ego": 0.004568545530873833, "sim_compute_robot_state-ego": 0.009893066494177418, "sim_compute_robot_state-npc0": 0.008721775196968241, "sim_compute_robot_state-npc1": 0.008927024848072241, "sim_compute_robot_state-npc2": 0.008780011048553683, "sim_compute_robot_state-npc3": 0.00892675852944665, "sim_compute_robot_state-parked0": 0.009144930974811527}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.41949506654321, "get_ui_image": 0.051205933888753254, "step_physics": 0.1575243631998698, "survival_time": 14.950000000000076, "driven_lanedir": 0.603105389055139, "get_state_dump": 0.029979650974273683, "sim_render-ego": 0.006813099384307861, "in-drivable-lane": 10.500000000000076, "agent_compute-ego": 0.029975612958272297, "deviation-heading": 1.5409913938727442, "complete-iteration": 0.35245091915130616, "set_robot_commands": 0.005206091403961182, "deviation-center-line": 0.33402699046660184, "driven_lanedir_consec": 0.603105389055139, "sim_compute_sim_state": 0.016856988271077473, "sim_compute_performance-ego": 0.004404343763987223, "sim_compute_robot_state-ego": 0.0087191907564799, "sim_compute_robot_state-npc0": 0.008149425983428955, "sim_compute_robot_state-npc1": 0.00820175806681315, "sim_compute_robot_state-npc2": 0.00830641746520996, "sim_compute_robot_state-npc3": 0.008477076689402263, "sim_compute_robot_state-parked0": 0.008392224311828613}, "ETHZ_autolab_technical_track-sc4-0-ego": {"driven_any": 1.7189468011393174, "get_ui_image": 0.05262599388758341, "step_physics": 0.1367282878469538, "survival_time": 10.800000000000018, "driven_lanedir": 0.35567286057868797, "get_state_dump": 0.031246647790626244, "sim_render-ego": 0.007189051972495185, "in-drivable-lane": 7.25000000000001, "agent_compute-ego": 0.0309712047930117, "deviation-heading": 2.3674645275360993, "complete-iteration": 0.3383944277410154, "set_robot_commands": 0.005943123941068296, "deviation-center-line": 0.37835989013039456, "driven_lanedir_consec": 0.35567286057868797, "sim_compute_sim_state": 0.01587915089395311, "sim_compute_performance-ego": 0.00460080416114242, "sim_compute_robot_state-ego": 0.009444038073221842, "sim_compute_robot_state-npc0": 0.008393900261984931, "sim_compute_robot_state-npc1": 0.008619274254198428, "sim_compute_robot_state-npc2": 0.008777633861259179, "sim_compute_robot_state-npc3": 0.008921210412625913, "sim_compute_robot_state-parked0": 0.008804130333441275}, "ETHZ_autolab_technical_track-sc5-0-ego": {"driven_any": 0.5084896604251888, "get_ui_image": 0.04943025112152099, "step_physics": 0.14287323110243855, "survival_time": 3.399999999999996, "driven_lanedir": 0.3152280385618491, "get_state_dump": 0.03165922445409438, "sim_render-ego": 0.006637913339278277, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.029856176937327665, "deviation-heading": 0.7647095000744895, "complete-iteration": 0.3382860877934624, "set_robot_commands": 0.005862520021550795, "deviation-center-line": 0.19557369086497545, "driven_lanedir_consec": 0.3152280385618491, "sim_compute_sim_state": 0.017195571871364817, "sim_compute_performance-ego": 0.004333036787369672, "sim_compute_robot_state-ego": 0.008435645524193259, "sim_compute_robot_state-npc0": 0.008516823544221766, "sim_compute_robot_state-npc1": 0.008323178571813247, "sim_compute_robot_state-npc2": 0.008169994634740493, "sim_compute_robot_state-npc3": 0.00825954886043773, "sim_compute_robot_state-parked0": 0.008485993918250589}, "ETHZ_autolab_technical_track-sc6-0-ego": {"driven_any": 2.413337760082281, "get_ui_image": 0.04979933897654216, "step_physics": 0.13297135750452677, "survival_time": 14.950000000000076, "driven_lanedir": 0.6527388550869847, "get_state_dump": 0.030883886019388834, "sim_render-ego": 0.006886552174886068, "in-drivable-lane": 10.150000000000087, "agent_compute-ego": 0.03024147828420003, "deviation-heading": 1.5655951236375396, "complete-iteration": 0.3346110343933105, "set_robot_commands": 0.0056105105082194014, "deviation-center-line": 0.2537922663109564, "driven_lanedir_consec": 0.6527388550869847, "sim_compute_sim_state": 0.02085946003595988, "sim_compute_performance-ego": 0.004536163806915283, "sim_compute_robot_state-ego": 0.00919749895731608, "sim_compute_robot_state-npc0": 0.008506046136220297, "sim_compute_robot_state-npc1": 0.008582777976989746, "sim_compute_robot_state-npc2": 0.008606524467468261, "sim_compute_robot_state-npc3": 0.008757264614105224, "sim_compute_robot_state-parked0": 0.008931081295013427}, "ETHZ_autolab_technical_track-sc7-0-ego": {"driven_any": 0.4467105708503631, "get_ui_image": 0.05177568607643002, "step_physics": 0.15579311964941803, "survival_time": 3.049999999999997, "driven_lanedir": 0.2541693488907706, "get_state_dump": 0.03221316806605605, "sim_render-ego": 0.006836934167830671, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.030223330513375703, "deviation-heading": 0.5538160688754614, "complete-iteration": 0.3565026736650311, "set_robot_commands": 0.005611826161869237, "deviation-center-line": 0.2176271550846063, "driven_lanedir_consec": 0.2541693488907706, "sim_compute_sim_state": 0.01608481563505579, "sim_compute_performance-ego": 0.004615029350655978, "sim_compute_robot_state-ego": 0.009357921412733734, "sim_compute_robot_state-npc0": 0.00877609800119869, "sim_compute_robot_state-npc1": 0.008764149712734535, "sim_compute_robot_state-npc2": 0.008515084376100634, "sim_compute_robot_state-npc3": 0.008755050721715708, "sim_compute_robot_state-parked0": 0.008929272167018203}, "ETHZ_autolab_technical_track-sc8-0-ego": {"driven_any": 1.6612868842651711, "get_ui_image": 0.051164669283269126, "step_physics": 0.1230444098203376, "survival_time": 10.450000000000014, "driven_lanedir": 0.4277091925758909, "get_state_dump": 0.030559479334708036, "sim_render-ego": 0.006795279717331298, "in-drivable-lane": 7.450000000000016, "agent_compute-ego": 0.029390833594582295, "deviation-heading": 0.5370201689873588, "complete-iteration": 0.32526053766314494, "set_robot_commands": 0.007061203130694668, "deviation-center-line": 0.3505375382286884, "driven_lanedir_consec": 0.4277091925758909, "sim_compute_sim_state": 0.019648936376617285, "sim_compute_performance-ego": 0.004606728348435398, "sim_compute_robot_state-ego": 0.009147553923027367, "sim_compute_robot_state-npc0": 0.009036413220127234, "sim_compute_robot_state-npc1": 0.008469865652933076, "sim_compute_robot_state-npc2": 0.008682822496697093, "sim_compute_robot_state-npc3": 0.00873407678741017, "sim_compute_robot_state-parked0": 0.008671402360834003}, "ETHZ_autolab_technical_track-sc9-0-ego": {"driven_any": 1.1714383183786077, "get_ui_image": 0.04975388834140445, "step_physics": 0.12368680486743082, "survival_time": 7.449999999999981, "driven_lanedir": 0.7018173553817487, "get_state_dump": 0.03244492351608788, "sim_render-ego": 0.007355262769148654, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.030764986204620978, "deviation-heading": 1.3349464001499858, "complete-iteration": 0.3281257472582311, "set_robot_commands": 0.0064782840293525846, "deviation-center-line": 0.41411778774873226, "driven_lanedir_consec": 0.7018173553817487, "sim_compute_sim_state": 0.01628819408032718, "sim_compute_performance-ego": 0.004730032594411965, "sim_compute_robot_state-ego": 0.010480304692415584, "sim_compute_robot_state-npc0": 0.00908667449183112, "sim_compute_robot_state-npc1": 0.00900940767070591, "sim_compute_robot_state-npc2": 0.00916159393003323, "sim_compute_robot_state-npc3": 0.009324350613075617, "sim_compute_robot_state-parked0": 0.009301412825616414}, "ETHZ_autolab_technical_track-sc10-0-ego": {"driven_any": 1.0631235847353042, "get_ui_image": 0.04978383463971755, "step_physics": 0.11665622627033909, "survival_time": 6.799999999999984, "driven_lanedir": 0.6425247110853172, "get_state_dump": 0.030712248647914213, "sim_render-ego": 0.006415049819385304, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.028933251605314368, "deviation-heading": 0.9359340449133204, "complete-iteration": 0.3002052044167238, "set_robot_commands": 0.004903931828106151, "deviation-center-line": 0.1817714101890432, "driven_lanedir_consec": 0.6425247110853172, "sim_compute_sim_state": 0.014289952376309563, "sim_compute_performance-ego": 0.0042759548215305105, "sim_compute_robot_state-ego": 0.007398345891167136, "sim_compute_robot_state-npc0": 0.00756923240773818, "sim_compute_robot_state-npc1": 0.0071608511840595915, "sim_compute_robot_state-npc2": 0.007218776380314547, "sim_compute_robot_state-npc3": 0.007144985830082613, "sim_compute_robot_state-parked0": 0.007504573639701395}, "ETHZ_autolab_technical_track-sc11-0-ego": {"driven_any": 1.0623694977119986, "get_ui_image": 0.05227330151726218, "step_physics": 0.12976202544044046, "survival_time": 6.799999999999984, "driven_lanedir": 0.6620460110865504, "get_state_dump": 0.02966860112021951, "sim_render-ego": 0.0064326735103831575, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.02910402066567365, "deviation-heading": 1.020272341928081, "complete-iteration": 0.3263375618878533, "set_robot_commands": 0.005171800360960119, "deviation-center-line": 0.1307523505299656, "driven_lanedir_consec": 0.6620460110865504, "sim_compute_sim_state": 0.020509560318554148, "sim_compute_performance-ego": 0.00441477053305682, "sim_compute_robot_state-ego": 0.008174021454418407, "sim_compute_robot_state-npc0": 0.007910745985367718, "sim_compute_robot_state-npc1": 0.008123914985095753, "sim_compute_robot_state-npc2": 0.008210308411542107, "sim_compute_robot_state-npc3": 0.00808331896277035, "sim_compute_robot_state-parked0": 0.008257464450948378}, "ETHZ_autolab_technical_track-sc12-0-ego": {"driven_any": 0.44777066442281815, "get_ui_image": 0.05086441509059218, "step_physics": 0.16088140987959065, "survival_time": 3.049999999999997, "driven_lanedir": 0.4424281297451276, "get_state_dump": 0.030504992750824474, "sim_render-ego": 0.00644800311229268, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02916451751208696, "deviation-heading": 0.4680611555303739, "complete-iteration": 0.3554013557121402, "set_robot_commands": 0.005614046190605789, "deviation-center-line": 0.11873049729392472, "driven_lanedir_consec": 0.4424281297451276, "sim_compute_sim_state": 0.01817803304703509, "sim_compute_performance-ego": 0.004378736996259846, "sim_compute_robot_state-ego": 0.008199887197525775, "sim_compute_robot_state-npc0": 0.007982429910878667, "sim_compute_robot_state-npc1": 0.008002046678887039, "sim_compute_robot_state-npc2": 0.008104777726970736, "sim_compute_robot_state-npc3": 0.008471836809252129, "sim_compute_robot_state-parked0": 0.008366338542250336}, "ETHZ_autolab_technical_track-sc13-0-ego": {"driven_any": 0.4430550625482196, "get_ui_image": 0.05141912698745728, "step_physics": 0.14428681135177612, "survival_time": 2.9999999999999973, "driven_lanedir": 0.2819726641496705, "get_state_dump": 0.03241729736328125, "sim_render-ego": 0.006450144449869791, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.02995044787724813, "deviation-heading": 0.7944342645407209, "complete-iteration": 0.33512441714604696, "set_robot_commands": 0.005159330368041992, "deviation-center-line": 0.1676313954701038, "driven_lanedir_consec": 0.2819726641496705, "sim_compute_sim_state": 0.014556503295898438, "sim_compute_performance-ego": 0.0042838533719380695, "sim_compute_robot_state-ego": 0.007582362492879232, "sim_compute_robot_state-npc0": 0.008030581474304199, "sim_compute_robot_state-npc1": 0.007797511418660482, "sim_compute_robot_state-npc2": 0.007767335573832194, "sim_compute_robot_state-npc3": 0.007500068346659342, "sim_compute_robot_state-parked0": 0.007673152287801107}, "ETHZ_autolab_technical_track-sc14-0-ego": {"driven_any": 1.091987596245604, "get_ui_image": 0.048046734693239064, "step_physics": 0.11198822714441972, "survival_time": 6.949999999999983, "driven_lanedir": 0.9060655608576224, "get_state_dump": 0.03226816911491559, "sim_render-ego": 0.007026025717206996, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.030524024002843625, "deviation-heading": 2.2615002629598218, "complete-iteration": 0.31911871759153954, "set_robot_commands": 0.006073452585892712, "deviation-center-line": 0.5395622087318213, "driven_lanedir_consec": 0.9060655608576224, "sim_compute_sim_state": 0.02239702759886817, "sim_compute_performance-ego": 0.004561806754242602, "sim_compute_robot_state-ego": 0.01005169299009035, "sim_compute_robot_state-npc0": 0.00910577671133357, "sim_compute_robot_state-npc1": 0.009299945488250512, "sim_compute_robot_state-npc2": 0.009035384912285015, "sim_compute_robot_state-npc3": 0.009118090430609616, "sim_compute_robot_state-parked0": 0.009373680293131218}}
set_robot_commands_max0.007061203130694668
set_robot_commands_mean0.0057101936741327216
set_robot_commands_median0.005611826161869237
set_robot_commands_min0.004903931828106151
sim_compute_performance-ego_max0.004730032594411965
sim_compute_performance-ego_mean0.004485303229626381
sim_compute_performance-ego_median0.004498183727264404
sim_compute_performance-ego_min0.0042759548215305105
sim_compute_robot_state-ego_max0.010480304692415584
sim_compute_robot_state-ego_mean0.00891753517153738
sim_compute_robot_state-ego_median0.008867153307286704
sim_compute_robot_state-ego_min0.007398345891167136
sim_compute_robot_state-npc0_max0.00910577671133357
sim_compute_robot_state-npc0_mean0.008414046077397134
sim_compute_robot_state-npc0_median0.008393900261984931
sim_compute_robot_state-npc0_min0.00756923240773818
sim_compute_robot_state-npc1_max0.009299945488250512
sim_compute_robot_state-npc1_mean0.008408845599728328
sim_compute_robot_state-npc1_median0.008451496760050456
sim_compute_robot_state-npc1_min0.0071608511840595915
sim_compute_robot_state-npc2_max0.00916159393003323
sim_compute_robot_state-npc2_mean0.008416895494725022
sim_compute_robot_state-npc2_median0.008515084376100634
sim_compute_robot_state-npc2_min0.007218776380314547
sim_compute_robot_state-npc3_max0.009324350613075617
sim_compute_robot_state-npc3_mean0.008502399616937422
sim_compute_robot_state-npc3_median0.00860137701034546
sim_compute_robot_state-npc3_min0.007144985830082613
sim_compute_robot_state-parked0_max0.009373680293131218
sim_compute_robot_state-parked0_mean0.008593995096484989
sim_compute_robot_state-parked0_median0.0085700527826945
sim_compute_robot_state-parked0_min0.007504573639701395
sim_compute_sim_state_max0.02239702759886817
sim_compute_sim_state_mean0.017832135332401
sim_compute_sim_state_median0.017195571871364817
sim_compute_sim_state_min0.014289952376309563
sim_render-ego_max0.007355262769148654
sim_render-ego_mean0.006798949941092197
sim_render-ego_median0.006813099384307861
sim_render-ego_min0.006415049819385304
simulation-passed1
step_physics_max0.16088140987959065
step_physics_mean0.1353389310997515
step_physics_median0.13297135750452677
step_physics_min0.11198822714441972
survival_time_max14.950000000000076
survival_time_mean8.59333333333335
survival_time_min2.9999999999999973
No reset possible