Duckietown Challenges | Home | Challenges | Submissions |
Very short “challenge”. Sanity check.
These are the metrics defined:
survival_time_median
This is the median survival time. The simulation is terminated when the car goes outside of the road or it crashes with an obstacle or pedestrian.
in-drivable-lane_median
This is the median of the time spent outside of the drivable zones. For example this penalizes driving in the wrong lane.
driven_lanedir_consec_median
This is the median distance traveled, along a lane. (That is, going in circles will not make this metric increase.)
This is discretized to tiles.
deviation-center-line_median
This is the median lateral deviation from the center line.
No dependencies
At the beginning execute step sanity-check
.
If step sanity-check
has result success, then declare the submission SUCCESS
.
If step sanity-check
has result failed, then declare the submission FAILED
.
If step sanity-check
has result error, then declare the submission ERROR
.
sanity-check
Timeout 10000.0
This is the Docker Compose configuration skeleton:
version: '3' services: evaluator: image: docker.io/andreacensi/duckietown-challenges@sha256:6b8e7cf14a7ae2e6fafd3af0e89993abc2f81891160a8a202a4526668cbe5c27 environment: experiment_manager_parameters: 'episodes_per_scenario: 1 episode_length_s: 0.5 min_episode_length_s: 0.0 seed: 20200922 physics_dt: 0.05 max_failures: 2 fifo_dir: /fifos sim_in: /fifos/simulator-in sim_out: /fifos/simulator-out sm_in: /fifos/scenario_maker-in sm_out: /fifos/scenario_maker-out timeout_initialization: 120 timeout_regular: 120 port: 10123 # visualization port scenarios: - /scenarios ' simulator: image: docker.io/andreacensi/duckietown-challenges@sha256:4a8daea0baf01e1a0891e35479960370163ae476b61a4da3ec76ae21f0138aeb environment: AIDONODE_CONFIG: "env_constructor: Simulator\nenv_parameters:\n max_steps:\ \ 500001 # we don't want the gym to reset itself\n domain_rand: 0\n\ \ camera_width: 640\n camera_height: 480\n distortion: true\n \ \ num_tris_distractors: 0\n color_ground: [0, 0.3, 0] # green\n \ \ enable_leds: true\n" AIDONODE_DATA_IN: /fifos/simulator-in AIDONODE_DATA_OUT: fifo:/fifos/simulator-out solution-ego0: image: SUBMISSION_CONTAINER environment: AIDONODE_NAME: ego0 AIDONODE_DATA_IN: /fifos/ego0-in AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
The text SUBMISSION_CONTAINER
will be replaced with the user containter.
Cloud simulations | 1 |