Job ID | step | status | up to date | date started | date completed | duration | message | | |
128441 | sanity-check | success | yes | | | 0:01:06 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | survival_time_median | 0.49999999999999994 | in-drivable-lane_median | 0.0 | driven_lanedir_consec_median | 0.0 | deviation-center-line_median | 0.007457570166591001 |
other statsdeviation-center-line_max | 0.007457570166591001 | deviation-center-line_mean | 0.007457570166591001 | deviation-center-line_min | 0.007457570166591001 | deviation-heading_max | 0.1966171946901932 | deviation-heading_mean | 0.1966171946901932 | deviation-heading_median | 0.1966171946901932 | deviation-heading_min | 0.1966171946901932 | distance-from-start_max | 5.551115123125783e-17 | distance-from-start_mean | 5.551115123125783e-17 | distance-from-start_median | 5.551115123125783e-17 | distance-from-start_min | 5.551115123125783e-17 | driven_any_max | 8.413744284337043e-16 | driven_any_mean | 8.413744284337043e-16 | driven_any_median | 8.413744284337043e-16 | driven_any_min | 8.413744284337043e-16 | driven_lanedir_consec_max | 0.0 | driven_lanedir_consec_mean | 0.0 | driven_lanedir_consec_min | 0.0 | driven_lanedir_max | 0.0 | driven_lanedir_mean | 0.0 | driven_lanedir_median | 0.0 | driven_lanedir_min | 0.0 | in-drivable-lane_max | 0.0 | in-drivable-lane_mean | 0.0 | in-drivable-lane_min | 0.0 | per-episodes | details{"scenarios-ego0": {"driven_any": 8.413744284337043e-16, "survival_time": 0.49999999999999994, "driven_lanedir": 0.0, "in-drivable-lane": 0.0, "deviation-heading": 0.1966171946901932, "distance-from-start": 5.551115123125783e-17, "deviation-center-line": 0.007457570166591001, "driven_lanedir_consec": 0.0}} | simulation-passed | 1 | survival_time_max | 0.49999999999999994 | survival_time_mean | 0.49999999999999994 | survival_time_min | 0.49999999999999994 |
| No reset possible |
128435 | sanity-check | success | yes | | | 0:01:01 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
128430 | sanity-check | success | yes | | | 0:01:08 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
128424 | sanity-check | success | yes | | | 0:01:13 | | Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
96493 | 370 | failed | yes | | | 0:01:20 | InvalidSubmission:
T [...]InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│ k: observations
│ v1: dataclass aido_schemas.schemas.DB20ObservationsWithTimestamp
│ field camera : dataclass aido_schemas.protocol_simulator.JPGImageWithTimestamp
│ field jpg_data : bytes
│ field timestamp : float
│ field odometry : dataclass aido_schemas.schemas.DB20OdometryWithTimestamp
│ field resolution_rad : float
│ field axis_left_rad : float
│ field axis_right_rad : float
│ field timestamp : float
│ v2: dataclass aido_schemas.schemas.DB20Observations
│ field camera : dataclass aido_schemas.protocol_simulator.JPGImage
│ field jpg_data : bytes
│ __doc__
│ An image in JPG format.
│
│ jpg_data
│ field odometry : dataclass aido_schemas.schemas.DB20Odometry
│ field resolution_rad : float
│ field axis_left_rad : float
│ field axis_right_rad : float
│ r: CanBeUsed
│ │ result: False
│ │ why:
│ │ |Type <class 'aido_schemas.schemas.DB20ObservationsWithTimestamp'>
│ │ | requires field "camera"
│ │ | of type
│ │ | <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│ │ | but <class 'aido_schemas.schemas.DB20Observations'>
│ │ | has annotated it as
│ │ | <class 'aido_schemas.protocol_simulator.JPGImage'>
│ │ | which cannot be used.
│ │ |
│ │ |assumption: ((<class 'aido_schemas.schemas.DB20Observations'>, <class 'aido_schemas.schemas.DB20ObservationsWithTimestamp'>),)
│ │ |
│ │ |> Type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│ │ |> requires field "timestamp"
│ │ |> of type <class 'float'>
│ │ |> but <class 'aido_schemas.protocol_simulator.JPGImage'> does not have it.
│ │ M: Matches()
│ │ matches: {}
│ p1_inputs: Dict[str,type][4]
│ │ seed: int
│ │ get_commands:
│ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ field at_time : float
│ │ observations:
│ │ dataclass aido_schemas.schemas.DB20ObservationsWithTimestamp
│ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImageWithTimestamp
│ │ field jpg_data : bytes
│ │ field timestamp : float
│ │ field odometry : dataclass aido_schemas.schemas.DB20OdometryWithTimestamp
│ │ field resolution_rad : float
│ │ field axis_left_rad : float
│ │ field axis_right_rad : float
│ │ field timestamp : float
│ │ episode_start:
│ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ field episode_name : str
│ │ __doc__ Marker for the start of an episode.
│ p2_inputs: dict[4]
│ │ observations:
│ │ dataclass aido_schemas.schemas.DB20Observations
│ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImage
│ │ field jpg_data : bytes
│ │ __doc__
│ │ An image in JPG format.
│ │
│ │ jpg_data
│ │ field odometry : dataclass aido_schemas.schemas.DB20Odometry
│ │ field resolution_rad : float
│ │ field axis_left_rad : float
│ │ field axis_right_rad : float
│ │ seed: int
│ │ get_commands:
│ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ field at_time : float
│ │ episode_start:
│ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ field episode_name : str
│ │ __doc__ Marker for the start of an episode.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 196, in main
aci._get_node_protocol(timeout=config.timeout_initialization)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 122, in _get_node_protocol
check_compatible_protocol(self.node_protocol, self.expect_protocol)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│ │ description: Particularization for DB20 observations and commands and timestamps.
│ │ inputs:
│ │ Dict[str,type][4]
│ │ │ seed: int
│ │ │ get_commands:
│ │ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ │ field at_time : float
│ │ │ observations:
│ │ │ dataclass aido_schemas.schemas.DB20ObservationsWithTimestamp
│ │ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImageWithTimestamp
│ │ │ field jpg_data : bytes
│ │ │ field timestamp : float
│ │ │ field odometry : dataclass aido_schemas.schemas.DB20OdometryWithTimestamp
│ │ │ field resolution_rad : float
│ │ │ field axis_left_rad : float
│ │ │ field axis_right_rad : float
│ │ │ field timestamp : float
│ │ │ episode_start:
│ │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ │ field episode_name : str
│ │ │ __doc__ Marker for the start of an episode.
│ │ outputs:
│ │ Dict[str,type][1]
│ │ │ commands:
│ │ │ dataclass aido_schemas.schemas.DB20Commands
│ │ │ field wheels : dataclass aido_schemas.schemas.PWMCommands
│ │ │ field motor_left : float
│ │ │ field motor_right : float
│ │ │ __doc__
│ │ │ PWM commands are floats between -1 and 1.
│ │ │ field LEDS : dataclass aido_schemas.schemas.LEDSCommands
│ │ │ field center : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│ │ description: Particularization for DB20 observations and commands.
│ │ inputs:
│ │ dict[4]
│ │ │ observations:
│ │ │ dataclass aido_schemas.schemas.DB20Observations
│ │ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImage
│ │ │ field jpg_data : bytes
│ │ │ __doc__
│ │ │ An image in JPG format.
│ │ │
│ │ │ jpg_data
│ │ │ field odometry : dataclass aido_schemas.schemas.DB20Odometry
│ │ │ field resolution_rad : float
│ │ │ field axis_left_rad : float
│ │ │ field axis_right_rad : float
│ │ │ seed: int
│ │ │ get_commands:
│ │ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ │ field at_time : float
│ │ │ episode_start:
│ │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ │ field episode_name : str
│ │ │ __doc__ Marker for the start of an episode.
│ │ outputs:
│ │ dict[1]
│ │ │ commands:
│ │ │ dataclass aido_schemas.schemas.DB20Commands
│ │ │ field wheels : dataclass aido_schemas.schemas.PWMCommands
│ │ │ field motor_left : float
│ │ │ field motor_right : float
│ │ │ __doc__
│ │ │ PWM commands are floats between -1 and 1.
│ │ │ field LEDS : dataclass aido_schemas.schemas.LEDSCommands
│ │ │ field center : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
wrap(cie)
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 201, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |
96488 | 370 | failed | yes | | | 0:02:44 | InvalidSubmission:
T [...]InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v1
│ k: observations
│ v1: dataclass aido_schemas.schemas.DB20ObservationsWithTimestamp
│ field camera : dataclass aido_schemas.protocol_simulator.JPGImageWithTimestamp
│ field jpg_data : bytes
│ field timestamp : float
│ field odometry : dataclass aido_schemas.schemas.DB20OdometryWithTimestamp
│ field resolution_rad : float
│ field axis_left_rad : float
│ field axis_right_rad : float
│ field timestamp : float
│ v2: dataclass aido_schemas.schemas.DB20Observations
│ field camera : dataclass aido_schemas.protocol_simulator.JPGImage
│ field jpg_data : bytes
│ __doc__
│ An image in JPG format.
│
│ jpg_data
│ field odometry : dataclass aido_schemas.schemas.DB20Odometry
│ field resolution_rad : float
│ field axis_left_rad : float
│ field axis_right_rad : float
│ r: CanBeUsed
│ │ result: False
│ │ why:
│ │ |Type <class 'aido_schemas.schemas.DB20ObservationsWithTimestamp'>
│ │ | requires field "camera"
│ │ | of type
│ │ | <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│ │ | but <class 'aido_schemas.schemas.DB20Observations'>
│ │ | has annotated it as
│ │ | <class 'aido_schemas.protocol_simulator.JPGImage'>
│ │ | which cannot be used.
│ │ |
│ │ |assumption: ((<class 'aido_schemas.schemas.DB20Observations'>, <class 'aido_schemas.schemas.DB20ObservationsWithTimestamp'>),)
│ │ |
│ │ |> Type <class 'aido_schemas.protocol_simulator.JPGImageWithTimestamp'>
│ │ |> requires field "timestamp"
│ │ |> of type <class 'float'>
│ │ |> but <class 'aido_schemas.protocol_simulator.JPGImage'> does not have it.
│ │ M: Matches()
│ │ matches: {}
│ p1_inputs: Dict[str,type][4]
│ │ seed: int
│ │ get_commands:
│ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ field at_time : float
│ │ observations:
│ │ dataclass aido_schemas.schemas.DB20ObservationsWithTimestamp
│ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImageWithTimestamp
│ │ field jpg_data : bytes
│ │ field timestamp : float
│ │ field odometry : dataclass aido_schemas.schemas.DB20OdometryWithTimestamp
│ │ field resolution_rad : float
│ │ field axis_left_rad : float
│ │ field axis_right_rad : float
│ │ field timestamp : float
│ │ episode_start:
│ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ field episode_name : str
│ │ __doc__ Marker for the start of an episode.
│ p2_inputs: dict[4]
│ │ observations:
│ │ dataclass aido_schemas.schemas.DB20Observations
│ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImage
│ │ field jpg_data : bytes
│ │ __doc__
│ │ An image in JPG format.
│ │
│ │ jpg_data
│ │ field odometry : dataclass aido_schemas.schemas.DB20Odometry
│ │ field resolution_rad : float
│ │ field axis_left_rad : float
│ │ field axis_right_rad : float
│ │ seed: int
│ │ get_commands:
│ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ field at_time : float
│ │ episode_start:
│ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ field episode_name : str
│ │ __doc__ Marker for the start of an episode.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 196, in main
aci._get_node_protocol(timeout=config.timeout_initialization)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 122, in _get_node_protocol
check_compatible_protocol(self.node_protocol, self.expect_protocol)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│ │ description: Particularization for DB20 observations and commands and timestamps.
│ │ inputs:
│ │ Dict[str,type][4]
│ │ │ seed: int
│ │ │ get_commands:
│ │ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ │ field at_time : float
│ │ │ observations:
│ │ │ dataclass aido_schemas.schemas.DB20ObservationsWithTimestamp
│ │ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImageWithTimestamp
│ │ │ field jpg_data : bytes
│ │ │ field timestamp : float
│ │ │ field odometry : dataclass aido_schemas.schemas.DB20OdometryWithTimestamp
│ │ │ field resolution_rad : float
│ │ │ field axis_left_rad : float
│ │ │ field axis_right_rad : float
│ │ │ field timestamp : float
│ │ │ episode_start:
│ │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ │ field episode_name : str
│ │ │ __doc__ Marker for the start of an episode.
│ │ outputs:
│ │ Dict[str,type][1]
│ │ │ commands:
│ │ │ dataclass aido_schemas.schemas.DB20Commands
│ │ │ field wheels : dataclass aido_schemas.schemas.PWMCommands
│ │ │ field motor_left : float
│ │ │ field motor_right : float
│ │ │ __doc__
│ │ │ PWM commands are floats between -1 and 1.
│ │ │ field LEDS : dataclass aido_schemas.schemas.LEDSCommands
│ │ │ field center : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│ │ description: Particularization for DB20 observations and commands.
│ │ inputs:
│ │ dict[4]
│ │ │ observations:
│ │ │ dataclass aido_schemas.schemas.DB20Observations
│ │ │ field camera : dataclass aido_schemas.protocol_simulator.JPGImage
│ │ │ field jpg_data : bytes
│ │ │ __doc__
│ │ │ An image in JPG format.
│ │ │
│ │ │ jpg_data
│ │ │ field odometry : dataclass aido_schemas.schemas.DB20Odometry
│ │ │ field resolution_rad : float
│ │ │ field axis_left_rad : float
│ │ │ field axis_right_rad : float
│ │ │ seed: int
│ │ │ get_commands:
│ │ │ dataclass aido_schemas.protocol_agent.GetCommands
│ │ │ field at_time : float
│ │ │ episode_start:
│ │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│ │ │ field episode_name : str
│ │ │ __doc__ Marker for the start of an episode.
│ │ outputs:
│ │ dict[1]
│ │ │ commands:
│ │ │ dataclass aido_schemas.schemas.DB20Commands
│ │ │ field wheels : dataclass aido_schemas.schemas.PWMCommands
│ │ │ field motor_left : float
│ │ │ field motor_right : float
│ │ │ __doc__
│ │ │ PWM commands are floats between -1 and 1.
│ │ │ field LEDS : dataclass aido_schemas.schemas.LEDSCommands
│ │ │ field center : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field front_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_left : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ │ field back_right : dataclass aido_schemas.schemas.RGB
│ │ │ field r : float
│ │ │ field g : float
│ │ │ field b : float
│ │ │ __doc__ Values between 0, 1.
│ │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
wrap(cie)
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 201, in main
raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Could not get protocol for agent 'ego0'
| Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard. | | No reset possible |