Evaluator 2068

aido5-LFV_multi-sim-validation

2020-11-01 19:54:01+00:00

2020-11-01 20:59:02+00:00

1:05:01

I can see how the jo [...]

I can see how the job 35957 is timeout because passed 3901 seconds and the timeout is 3600.0.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35956

9821

Bea Baselines 🐤

template-pytorch

LFVmultibodyv-sim

error

2020-11-01 19:52:10+00:00

2020-11-01 19:53:10+00:00

0:01:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 49, in check_compatible_protocol
    raise IncompatibleProtocol(
zuper_nodes.compatibility.IncompatibleProtocol: For input "observations", cannot use type v2 as v21
│         k: observations
│        v1: dataclass aido_schemas.schemas.DB20ObservationsPlusState
│             field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                                field jpg_data : bytes
│                                       __doc__
│                                                         An image in JPG format.
│ 
│                                                         jpg_data
│             field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│                                field resolution_rad : float
│                                field  axis_left_rad : float
│                                field axis_right_rad : float
│             field your_name : str
│             field     state : dataclass aido_schemas.schemas.DTSimState
│                                field t_effective : float
│                                field  duckiebots : Dict[str,DTSimRobotInfo]
│             field  map_data : str
│        v2: dataclass aido_schemas.schemas.DB20Observations
│             field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│                               field jpg_data : bytes
│                                      __doc__
│                                                        An image in JPG format.
│ 
│                                                        jpg_data
│             field odometry : dataclass aido_schemas.schemas.DB20Odometry
│                               field resolution_rad : float
│                               field  axis_left_rad : float
│                               field axis_right_rad : float
│         r: CanBeUsed
│            │ result: False
│            │ why:
│            │ |Type <class 'aido_schemas.schemas.DB20ObservationsPlusState'>
│            │ | requires field "your_name"
│            │ |  of type <class 'str'>
│            │ |  but <class 'aido_schemas.schemas.DB20Observations'> does not have it.
│            │ M: Matches()
│            │ matches: {}
│ p1_inputs: Dict[str,type][4]
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│            │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                     field jpg_data : bytes
│            │                            __doc__
│            │                                              An image in JPG format.
│            │
│            │                                              jpg_data
│            │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                     field resolution_rad : float
│            │                     field  axis_left_rad : float
│            │                     field axis_right_rad : float
│            │  field your_name : str
│            │  field     state : dataclass aido_schemas.schemas.DTSimState
│            │                     field t_effective : float
│            │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│            │  field  map_data : str
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.
│ p2_inputs: dict[4]
│            │ observations:
│            │ dataclass aido_schemas.schemas.DB20Observations
│            │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│            │                    field jpg_data : bytes
│            │                           __doc__
│            │                                             An image in JPG format.
│            │
│            │                                             jpg_data
│            │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│            │                    field resolution_rad : float
│            │                    field  axis_left_rad : float
│            │                    field axis_right_rad : float
│            │ seed: int
│            │ get_commands:
│            │ dataclass aido_schemas.protocol_agent.GetCommands
│            │  field at_time : float
│            │ episode_start:
│            │ dataclass aido_schemas.protocol_agent.EpisodeStart
│            │  field episode_name : str
│            │             __doc__    Marker for the start of an episode.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 165, in main
    robot_ci._get_node_protocol(timeout=config.timeout_initialization)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 120, in _get_node_protocol
    check_compatible_protocol(self.node_protocol, self.expect_protocol)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes/compatibility.py", line 67, in check_compatible_protocol
    raise IncompatibleProtocol(msg, p1=p1, p2=p2) from e
zuper_nodes.compatibility.IncompatibleProtocol: Cannot say that p1 is a sub-protocol of p2
│ p1: InteractionProtocol
│     │ description: Particularization for Duckiebot1 observations and commands.
│     │ inputs:
│     │ Dict[str,type][4]
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20ObservationsPlusState
│     │ │  field    camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                     field jpg_data : bytes
│     │ │                            __doc__
│     │ │                                              An image in JPG format.
│     │ │
│     │ │                                              jpg_data
│     │ │  field  odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                     field resolution_rad : float
│     │ │                     field  axis_left_rad : float
│     │ │                     field axis_right_rad : float
│     │ │  field your_name : str
│     │ │  field     state : dataclass aido_schemas.schemas.DTSimState
│     │ │                     field t_effective : float
│     │ │                     field  duckiebots : Dict[str,DTSimRobotInfo]
│     │ │  field  map_data : str
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ Dict[str,type][1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.Duckiebot1Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)
│ p2: InteractionProtocol
│     │ description: Particularization for DB20 observations and commands.
│     │ inputs:
│     │ dict[4]
│     │ │ observations:
│     │ │ dataclass aido_schemas.schemas.DB20Observations
│     │ │  field   camera : dataclass aido_schemas.protocol_simulator.JPGImage
│     │ │                    field jpg_data : bytes
│     │ │                           __doc__
│     │ │                                             An image in JPG format.
│     │ │
│     │ │                                             jpg_data
│     │ │  field odometry : dataclass aido_schemas.schemas.DB20Odometry
│     │ │                    field resolution_rad : float
│     │ │                    field  axis_left_rad : float
│     │ │                    field axis_right_rad : float
│     │ │ seed: int
│     │ │ get_commands:
│     │ │ dataclass aido_schemas.protocol_agent.GetCommands
│     │ │  field at_time : float
│     │ │ episode_start:
│     │ │ dataclass aido_schemas.protocol_agent.EpisodeStart
│     │ │  field episode_name : str
│     │ │             __doc__    Marker for the start of an episode.
│     │ outputs:
│     │ dict[1]
│     │ │ commands:
│     │ │ dataclass aido_schemas.schemas.DB20Commands
│     │ │  field wheels : dataclass aido_schemas.schemas.PWMCommands
│     │ │                  field  motor_left : float
│     │ │                  field motor_right : float
│     │ │                            __doc__
│     │ │                                              PWM commands are floats between -1 and 1.
│     │ │  field   LEDS : dataclass aido_schemas.schemas.LEDSCommands
│     │ │                  field      center : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  front_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field front_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field   back_left : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ │                  field  back_right : dataclass aido_schemas.schemas.RGB
│     │ │                                       field       r : float
│     │ │                                       field       g : float
│     │ │                                       field       b : float
│     │ │                                             __doc__    Values between 0, 1.
│     │ language: (in:seed)? ; ((in:episode_start ; ((in:observations | (in:get_commands ; out:commands))*))*)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 633, in go
    wrap(cie)
  File "experiment_manager.py", line 618, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 294, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35944

9831

Bea Baselines 🐤

template-tensorflow

aido5-LFVI-sim-testing

LFVIt-sim

error

aido5-LFVI-sim-validation

2020-11-01 18:39:00+00:00

2020-11-01 19:39:46+00:00

1:00:46

Waited 3602 seconds [...]

Waited 3602 seconds for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35942

9806

Bea Baselines 🐤

baseline-duckietown

LFVIv-sim

success

2020-11-01 18:28:11+00:00

2020-11-01 18:37:45+00:00

0:09:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5184528767834813
survival_time_median	14.950000000000076
deviation-center-line_median	0.5613536828720347
in-drivable-lane_median	7.825000000000051

other stats

agent_compute-ego_max	0.06371253410975139
agent_compute-ego_mean	0.06101209163665772
agent_compute-ego_median	0.06101209163665772
agent_compute-ego_min	0.05831164916356405
complete-iteration_max	0.5252495900789896
complete-iteration_mean	0.5249963096777598
complete-iteration_median	0.5249963096777598
complete-iteration_min	0.5247430292765299
deviation-center-line_max	0.9786410987388442
deviation-center-line_mean	0.5613536828720347
deviation-center-line_min	0.14406626700522515
deviation-heading_max	5.109969112534788
deviation-heading_mean	3.83310535562056
deviation-heading_median	3.83310535562056
deviation-heading_min	2.556241598706333
driven_any_max	1.939163830859009
driven_any_mean	1.9358587313770632
driven_any_median	1.9358587313770632
driven_any_min	1.932553631895118
driven_lanedir_consec_max	0.5696143205468265
driven_lanedir_consec_mean	0.5184528767834813
driven_lanedir_consec_min	0.4672914330201361
driven_lanedir_max	0.7775189380528431
driven_lanedir_mean	0.6735666292998348
driven_lanedir_median	0.6735666292998348
driven_lanedir_min	0.5696143205468265
get_state_dump_max	0.03592313528060913
get_state_dump_mean	0.03495484153429667
get_state_dump_median	0.03495484153429667
get_state_dump_min	0.03398654778798421
get_ui_image_max	0.09920247395833331
get_ui_image_mean	0.09663707931836446
get_ui_image_median	0.09663707931836446
get_ui_image_min	0.0940716846783956
in-drivable-lane_max	9.100000000000088
in-drivable-lane_mean	7.825000000000051
in-drivable-lane_min	6.550000000000014
per-episodes	details {"udem1-0-0-ego": {"driven_any": 1.932553631895118, "get_ui_image": 0.09920247395833331, "step_physics": 0.2331703972816467, "survival_time": 14.950000000000076, "driven_lanedir": 0.5696143205468265, "get_state_dump": 0.03398654778798421, "sim_render-ego": 0.008726335366566976, "in-drivable-lane": 9.100000000000088, "agent_compute-ego": 0.05831164916356405, "deviation-heading": 2.556241598706333, "complete-iteration": 0.5252495900789896, "set_robot_commands": 0.006463587284088135, "deviation-center-line": 0.14406626700522515, "driven_lanedir_consec": 0.5696143205468265, "sim_compute_sim_state": 0.020712144374847412, "sim_compute_performance-ego": 0.005577232837677002, "sim_compute_robot_state-ego": 0.009629093805948893, "sim_compute_robot_state-npc0": 0.010268175601959228, "sim_compute_robot_state-npc1": 0.0098608136177063, "sim_compute_robot_state-npc2": 0.009789063135782875, "sim_compute_robot_state-npc3": 0.009623864491780598, "sim_compute_robot_state-parked0": 0.009639863173166912}, "udem1-0-1-ego": {"driven_any": 1.939163830859009, "get_ui_image": 0.0940716846783956, "step_physics": 0.2307333834966024, "survival_time": 14.950000000000076, "driven_lanedir": 0.7775189380528431, "get_state_dump": 0.03592313528060913, "sim_render-ego": 0.008382413387298584, "in-drivable-lane": 6.550000000000014, "agent_compute-ego": 0.06371253410975139, "deviation-heading": 5.109969112534788, "complete-iteration": 0.5247430292765299, "set_robot_commands": 0.00643632968266805, "deviation-center-line": 0.9786410987388442, "driven_lanedir_consec": 0.4672914330201361, "sim_compute_sim_state": 0.02033652623494466, "sim_compute_performance-ego": 0.005643762747446696, "sim_compute_robot_state-ego": 0.010060649712880452, "sim_compute_robot_state-npc0": 0.009892536799112957, "sim_compute_robot_state-npc1": 0.01000277042388916, "sim_compute_robot_state-npc2": 0.009857088724772136, "sim_compute_robot_state-npc3": 0.009750154813130695, "sim_compute_robot_state-parked0": 0.009651633898417156}}
set_robot_commands_max	0.006463587284088135
set_robot_commands_mean	0.006449958483378092
set_robot_commands_median	0.006449958483378092
set_robot_commands_min	0.00643632968266805
sim_compute_performance-ego_max	0.005643762747446696
sim_compute_performance-ego_mean	0.0056104977925618485
sim_compute_performance-ego_median	0.0056104977925618485
sim_compute_performance-ego_min	0.005577232837677002
sim_compute_robot_state-ego_max	0.010060649712880452
sim_compute_robot_state-ego_mean	0.009844871759414672
sim_compute_robot_state-ego_median	0.009844871759414672
sim_compute_robot_state-ego_min	0.009629093805948893
sim_compute_robot_state-npc0_max	0.010268175601959228
sim_compute_robot_state-npc0_mean	0.010080356200536092
sim_compute_robot_state-npc0_median	0.010080356200536092
sim_compute_robot_state-npc0_min	0.009892536799112957
sim_compute_robot_state-npc1_max	0.01000277042388916
sim_compute_robot_state-npc1_mean	0.00993179202079773
sim_compute_robot_state-npc1_median	0.00993179202079773
sim_compute_robot_state-npc1_min	0.0098608136177063
sim_compute_robot_state-npc2_max	0.009857088724772136
sim_compute_robot_state-npc2_mean	0.009823075930277503
sim_compute_robot_state-npc2_median	0.009823075930277503
sim_compute_robot_state-npc2_min	0.009789063135782875
sim_compute_robot_state-npc3_max	0.009750154813130695
sim_compute_robot_state-npc3_mean	0.009687009652455648
sim_compute_robot_state-npc3_median	0.009687009652455648
sim_compute_robot_state-npc3_min	0.009623864491780598
sim_compute_robot_state-parked0_max	0.009651633898417156
sim_compute_robot_state-parked0_mean	0.009645748535792031
sim_compute_robot_state-parked0_median	0.009645748535792031
sim_compute_robot_state-parked0_min	0.009639863173166912
sim_compute_sim_state_max	0.020712144374847412
sim_compute_sim_state_mean	0.020524335304896037
sim_compute_sim_state_median	0.020524335304896037
sim_compute_sim_state_min	0.02033652623494466
sim_render-ego_max	0.008726335366566976
sim_render-ego_mean	0.00855437437693278
sim_render-ego_median	0.00855437437693278
sim_render-ego_min	0.008382413387298584
simulation-passed	1
step_physics_max	0.2331703972816467
step_physics_mean	0.23195189038912456
step_physics_median	0.23195189038912456
step_physics_min	0.2307333834966024
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

35937

9778

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-baseline-behavior-cloning

LFv-sim

success

2020-11-01 18:22:08+00:00

2020-11-01 18:27:15+00:00

0:05:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.4755013638522412
survival_time_median	9.925000000000006
deviation-center-line_median	0.18434752309787425
in-drivable-lane_median	3.450000000000021

other stats

agent_compute-ego_max	0.08385247995357702
agent_compute-ego_mean	0.08022153711040542
agent_compute-ego_median	0.08022153711040542
agent_compute-ego_min	0.07659059426723383
complete-iteration_max	0.35653135918154577
complete-iteration_mean	0.3497498375687329
complete-iteration_median	0.3497498375687329
complete-iteration_min	0.3429683159559201
deviation-center-line_max	0.19094512836760308
deviation-center-line_mean	0.18434752309787425
deviation-center-line_min	0.17774991782814534
deviation-heading_max	0.7412123865371725
deviation-heading_mean	0.7135795186605717
deviation-heading_median	0.7135795186605717
deviation-heading_min	0.6859466507839709
driven_any_max	2.329669289312401
driven_any_mean	2.2976943872998845
driven_any_median	2.2976943872998845
driven_any_min	2.265719485287367
driven_lanedir_consec_max	1.5030389559443071
driven_lanedir_consec_mean	1.4755013638522412
driven_lanedir_consec_min	1.4479637717601754
driven_lanedir_max	1.5030389559443071
driven_lanedir_mean	1.4755013638522412
driven_lanedir_median	1.4755013638522412
driven_lanedir_min	1.4479637717601754
get_state_dump_max	0.0186409855833148
get_state_dump_mean	0.017787050147684856
get_state_dump_median	0.017787050147684856
get_state_dump_min	0.016933114712054914
get_ui_image_max	0.05814223900819436
get_ui_image_mean	0.056950570675103486
get_ui_image_median	0.056950570675103486
get_ui_image_min	0.05575890234201261
in-drivable-lane_max	3.500000000000024
in-drivable-lane_mean	3.450000000000021
in-drivable-lane_min	3.400000000000018
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.329669289312401, "get_ui_image": 0.05575890234201261, "step_physics": 0.12629518178429935, "survival_time": 10.100000000000009, "driven_lanedir": 1.5030389559443071, "get_state_dump": 0.0186409855833148, "sim_render-ego": 0.012077985423626286, "in-drivable-lane": 3.500000000000024, "agent_compute-ego": 0.08385247995357702, "deviation-heading": 0.7412123865371725, "complete-iteration": 0.35653135918154577, "set_robot_commands": 0.0070421601286028875, "deviation-center-line": 0.17774991782814534, "driven_lanedir_consec": 1.5030389559443071, "sim_compute_sim_state": 0.022095624763186616, "sim_compute_performance-ego": 0.008405300650266137, "sim_compute_robot_state-ego": 0.010635891763290556, "sim_compute_robot_state-parked0": 0.011504172098518598}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.265719485287367, "get_ui_image": 0.05814223900819436, "step_physics": 0.12556090232653497, "survival_time": 9.750000000000004, "driven_lanedir": 1.4479637717601754, "get_state_dump": 0.016933114712054914, "sim_render-ego": 0.008814182036962265, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.07659059426723383, "deviation-heading": 0.6859466507839709, "complete-iteration": 0.3429683159559201, "set_robot_commands": 0.00649877694936899, "deviation-center-line": 0.19094512836760308, "driven_lanedir_consec": 1.4479637717601754, "sim_compute_sim_state": 0.02366973803593562, "sim_compute_performance-ego": 0.00602875000391251, "sim_compute_robot_state-ego": 0.01057881453098395, "sim_compute_robot_state-parked0": 0.009960096310346554}}
set_robot_commands_max	0.0070421601286028875
set_robot_commands_mean	0.006770468538985939
set_robot_commands_median	0.006770468538985939
set_robot_commands_min	0.00649877694936899
sim_compute_performance-ego_max	0.008405300650266137
sim_compute_performance-ego_mean	0.007217025327089324
sim_compute_performance-ego_median	0.007217025327089324
sim_compute_performance-ego_min	0.00602875000391251
sim_compute_robot_state-ego_max	0.010635891763290556
sim_compute_robot_state-ego_mean	0.010607353147137254
sim_compute_robot_state-ego_median	0.010607353147137254
sim_compute_robot_state-ego_min	0.01057881453098395
sim_compute_robot_state-parked0_max	0.011504172098518598
sim_compute_robot_state-parked0_mean	0.010732134204432576
sim_compute_robot_state-parked0_median	0.010732134204432576
sim_compute_robot_state-parked0_min	0.009960096310346554
sim_compute_sim_state_max	0.02366973803593562
sim_compute_sim_state_mean	0.02288268139956112
sim_compute_sim_state_median	0.02288268139956112
sim_compute_sim_state_min	0.022095624763186616
sim_render-ego_max	0.012077985423626286
sim_render-ego_mean	0.010446083730294277
sim_render-ego_median	0.010446083730294277
sim_render-ego_min	0.008814182036962265
simulation-passed	1
step_physics_max	0.12629518178429935
step_physics_mean	0.12592804205541716
step_physics_median	0.12592804205541716
step_physics_min	0.12556090232653497
survival_time_max	10.100000000000009
survival_time_mean	9.925000000000006
survival_time_min	9.750000000000004

No reset possible

35935

9783

Andrea Censi 🇨🇭

template-random

LFv-sim

success

2020-11-01 18:18:31+00:00

2020-11-01 18:21:50+00:00

0:03:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5455589268072338
survival_time_median	2.4249999999999994
deviation-center-line_median	0.11437498744672908
in-drivable-lane_median	0.8499999999999985

other stats

agent_compute-ego_max	0.045199147725509384
agent_compute-ego_mean	0.036493711446035554
agent_compute-ego_median	0.036493711446035554
agent_compute-ego_min	0.027788275166561727
complete-iteration_max	0.3735646393339513
complete-iteration_mean	0.3586287721792148
complete-iteration_median	0.3586287721792148
complete-iteration_min	0.3436929050244783
deviation-center-line_max	0.1246386243322534
deviation-center-line_mean	0.11437498744672908
deviation-center-line_min	0.10411135056120474
deviation-heading_max	0.27041081849249704
deviation-heading_mean	0.26875999230405784
deviation-heading_median	0.26875999230405784
deviation-heading_min	0.26710916611561863
driven_any_max	1.16193217979593
driven_any_mean	0.94190556585777
driven_any_median	0.94190556585777
driven_any_min	0.7218789519196097
driven_lanedir_consec_max	0.6085881804686812
driven_lanedir_consec_mean	0.5455589268072338
driven_lanedir_consec_min	0.4825296731457864
driven_lanedir_max	0.6085881804686812
driven_lanedir_mean	0.5455589268072338
driven_lanedir_median	0.5455589268072338
driven_lanedir_min	0.4825296731457864
get_state_dump_max	0.025584895732039113
get_state_dump_mean	0.02359632617336209
get_state_dump_median	0.02359632617336209
get_state_dump_min	0.02160775661468506
get_ui_image_max	0.07099326990418516
get_ui_image_mean	0.06710384872531806
get_ui_image_median	0.06710384872531806
get_ui_image_min	0.06321442754645097
in-drivable-lane_max	1.1999999999999966
in-drivable-lane_mean	0.8499999999999985
in-drivable-lane_min	0.5000000000000004
per-episodes	details {"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.16193217979593, "get_ui_image": 0.07099326990418516, "step_physics": 0.14259528709670244, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.025584895732039113, "sim_render-ego": 0.015521259631140757, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.045199147725509384, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.3735646393339513, "set_robot_commands": 0.007683075080483647, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.026772988044609456, "sim_compute_performance-ego": 0.011006250219830012, "sim_compute_robot_state-ego": 0.016961247234021204, "sim_compute_robot_state-parked0": 0.011039527796082575}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.7218789519196097, "get_ui_image": 0.06321442754645097, "step_physics": 0.15978190773411802, "survival_time": 1.900000000000001, "driven_lanedir": 0.4825296731457864, "get_state_dump": 0.02160775661468506, "sim_render-ego": 0.008435393634595369, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.027788275166561727, "deviation-heading": 0.26710916611561863, "complete-iteration": 0.3436929050244783, "set_robot_commands": 0.01582847143474378, "deviation-center-line": 0.10411135056120474, "driven_lanedir_consec": 0.4825296731457864, "sim_compute_sim_state": 0.020749895196211964, "sim_compute_performance-ego": 0.00544743161452444, "sim_compute_robot_state-ego": 0.010285891984638414, "sim_compute_robot_state-parked0": 0.010342497574655631}}
set_robot_commands_max	0.01582847143474378
set_robot_commands_mean	0.011755773257613712
set_robot_commands_median	0.011755773257613712
set_robot_commands_min	0.007683075080483647
sim_compute_performance-ego_max	0.011006250219830012
sim_compute_performance-ego_mean	0.008226840917177226
sim_compute_performance-ego_median	0.008226840917177226
sim_compute_performance-ego_min	0.00544743161452444
sim_compute_robot_state-ego_max	0.016961247234021204
sim_compute_robot_state-ego_mean	0.01362356960932981
sim_compute_robot_state-ego_median	0.01362356960932981
sim_compute_robot_state-ego_min	0.010285891984638414
sim_compute_robot_state-parked0_max	0.011039527796082575
sim_compute_robot_state-parked0_mean	0.010691012685369103
sim_compute_robot_state-parked0_median	0.010691012685369103
sim_compute_robot_state-parked0_min	0.010342497574655631
sim_compute_sim_state_max	0.026772988044609456
sim_compute_sim_state_mean	0.02376144162041071
sim_compute_sim_state_median	0.02376144162041071
sim_compute_sim_state_min	0.020749895196211964
sim_render-ego_max	0.015521259631140757
sim_render-ego_mean	0.011978326632868064
sim_render-ego_median	0.011978326632868064
sim_render-ego_min	0.008435393634595369
simulation-passed	1
step_physics_max	0.15978190773411802
step_physics_mean	0.15118859741541024
step_physics_median	0.15118859741541024
step_physics_min	0.14259528709670244
survival_time_max	2.9499999999999975
survival_time_mean	2.4249999999999994
survival_time_min	1.900000000000001

No reset possible

35927

6728

Andrea Censi 🇨🇭

template-random

LFv-sim

success

2020-11-01 04:47:20+00:00

2020-11-01 04:48:18+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35923

6760

Anthony Courchesne 🇨🇦

template-ros

LFv-sim

success

2020-11-01 04:46:05+00:00

2020-11-01 04:47:06+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35915

6783

Jiaxu Xing

template-random

LFv-sim

success

2020-11-01 04:44:53+00:00

2020-11-01 04:45:49+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35910

6801

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

success

2020-11-01 04:43:36+00:00

2020-11-01 04:44:39+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35903

6804

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

success

2020-11-01 04:41:54+00:00

2020-11-01 04:43:02+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35896

6814

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:39:42+00:00

2020-11-01 04:41:14+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35889

6821

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:37:48+00:00

2020-11-01 04:39:00+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35880

6827

exercise_ros_template

LFv-sim

success

2020-11-01 04:36:07+00:00

2020-11-01 04:37:13+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35873

6832

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:34:31+00:00

2020-11-01 04:35:32+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35867

6841

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:33:00+00:00

2020-11-01 04:34:04+00:00

0:01:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35860

6845

Daniil Lisus

exercise_ros_template

LFv-sim

success

2020-11-01 04:31:32+00:00

2020-11-01 04:32:28+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35854

6851

exercise_ros_template

LFv-sim

success

2020-11-01 04:29:57+00:00

2020-11-01 04:31:05+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35851

9228

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:28:32+00:00

2020-11-01 04:29:47+00:00

0:01:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35843

9234

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:27:07+00:00

2020-11-01 04:28:12+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35836

9236

exercise_ros_template

LFv-sim

success

2020-11-01 04:25:49+00:00

2020-11-01 04:26:45+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35833

9243

exercise_ros_template

LFv-sim

success

2020-11-01 04:24:31+00:00

2020-11-01 04:25:34+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35826

9248

exercise_ros_template

LFv-sim

success

2020-11-01 04:23:08+00:00

2020-11-01 04:24:08+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35821

9255

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:21:45+00:00

2020-11-01 04:22:50+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35815

9261

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:20:27+00:00

2020-11-01 04:21:22+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35808

9272

Liam Paull 🇨🇦

template-ros

LFv-sim

success

2020-11-01 04:18:59+00:00

2020-11-01 04:20:05+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35803

9275

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:17:40+00:00

2020-11-01 04:18:50+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35796

9279

exercise_ros_template

LFv-sim

aborted

2020-11-01 04:16:15+00:00

2020-11-01 04:17:22+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35792

9286

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:15:12+00:00

2020-11-01 04:16:07+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35787

9288

exercise_ros_template

LFv-sim

success

2020-11-01 04:13:58+00:00

2020-11-01 04:14:57+00:00

0:00:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35780

9299

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:12:37+00:00

2020-11-01 04:13:34+00:00

0:00:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35774

9302

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:10:57+00:00

2020-11-01 04:12:05+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35769

9309

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:09:48+00:00

2020-11-01 04:10:48+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35762

9313

Raphael Jean

sim-exercise-1

LFv-sim

success

2020-11-01 04:08:23+00:00

2020-11-01 04:09:26+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35756

9317

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:07:00+00:00

2020-11-01 04:08:06+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35749

9325

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:05:40+00:00

2020-11-01 04:06:46+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35742

9329

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:04:04+00:00

2020-11-01 04:05:07+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35738

9334

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 04:02:40+00:00

2020-11-01 04:03:41+00:00

0:01:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35731

9336

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 04:01:20+00:00

2020-11-01 04:02:20+00:00

0:01:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35725

9342

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 04:00:08+00:00

2020-11-01 04:01:11+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35720

9357

exercise_ros_template

LFv-sim

success

2020-11-01 03:58:33+00:00

2020-11-01 03:59:38+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35712

9362

Philippe Reddy 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 03:57:02+00:00

2020-11-01 03:58:13+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35705

9364

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 03:55:34+00:00

2020-11-01 03:56:28+00:00

0:00:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35701

9372

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 03:54:16+00:00

2020-11-01 03:55:13+00:00

0:00:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35695

9377

Jerome Labonte 🇨🇦

real-exercise-1

LFv-sim

aborted

2020-11-01 03:52:57+00:00

2020-11-01 03:53:55+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35691

9381

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 03:51:29+00:00

2020-11-01 03:52:24+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35685

9383

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 03:50:07+00:00

2020-11-01 03:51:01+00:00

0:00:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35679

9388

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 03:48:55+00:00

2020-11-01 03:49:58+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35673

9389

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 03:47:31+00:00

2020-11-01 03:48:34+00:00

0:01:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35667

9393

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 03:46:06+00:00

2020-11-01 03:47:00+00:00

0:00:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35661

9394

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-01 03:44:40+00:00

2020-11-01 03:45:38+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35654

9693

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

aido5-LFVI-sim-validation

2020-11-01 03:43:25+00:00

2020-11-01 03:44:19+00:00

0:00:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35649

9739

Bea Baselines 🐤

baseline-duckietown

LFVIv-sim

success

2020-11-01 03:42:06+00:00

2020-11-01 03:43:17+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35645

9740

Bea Baselines 🐤

baseline-duckietown

aido5-LFVI-sim-testing

LFVIt-sim

success

aido5-LFV-sim-validation

2020-11-01 03:40:52+00:00

2020-11-01 03:41:50+00:00

0:00:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35640

9752

Bea Baselines 🐤

straight

LFVv-sim

success

aido5-LFVI_multi-sim-validation

2020-11-01 03:39:41+00:00

2020-11-01 03:40:36+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35631

9757

Bea Baselines 🐤

straight

LFVIv-sim

success

2020-11-01 03:34:04+00:00

2020-11-01 03:35:11+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35626

9756

Bea Baselines 🐤

straight

aido5-LFVI-sim-testing

LFVIt-sim

success

2020-11-01 03:31:46+00:00

2020-11-01 03:32:41+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35618

9762

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 03:29:03+00:00

2020-11-01 03:30:31+00:00

0:01:28

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35610

9771

Frank (Chude) Qian 🇨🇦

template-tensorflow

LFv-sim

success

2020-11-01 03:24:58+00:00

2020-11-01 03:25:50+00:00

0:00:52

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35600

9768

Frank (Chude) Qian 🇨🇦

template-pytorch

LFv-sim

success

2020-11-01 03:20:10+00:00

2020-11-01 03:21:05+00:00

0:00:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35596

9775

Philippe Reddy 🇨🇦

exercise_ros_template

LFv-sim

success

2020-11-01 03:13:52+00:00

2020-11-01 03:14:48+00:00

0:00:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

35590

9780

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success