AI Driving Olympics Home Challenges Submissions Jobs

Challenge "[AIDO 1] AMOD - Fleet Size (rev. 1)"

Challenge description

In the Fleet Size Championship, the goal is to reduce the fleet size as much as possible while keeping the total waiting time W below a fixed level.

The test scenario is San Francisco.

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

fleet_size

Penalty for fleet size.

Details

Technical details

Evaluation steps details

  • At the beginning execute step step1-simulation.

  • If step step1-simulation finishes with status success, then execute step step2-scoring.

  • If step step1-simulation finishes with status failed, then declare the submission FAILED.

  • If step step1-simulation finishes with status error, then declare the submission ERROR.

  • If step step2-scoring finishes with status success, then declare the submission SUCCESS.

  • If step step2-scoring finishes with status failed, then declare the submission FAILED.

  • If step step2-scoring finishes with status error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout None

This is the simulation step.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    aido-host:
        image: andreacensi/aido1_amod_fleet_size_r1-v3-step1-simulation-aido-host:2018_11_21_21_20_50@sha256:9b562dfe561e33a8a2711b6fd57f6d5c06f92c74459882d0392b5eb9425e43a5
        environment:
            SCENARIO: SanFrancisco.20080520
            REQUESTS_SIZE: '500'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout None

This step computes the actual scores.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    aido-scorer:
        image: andreacensi/aido1_amod_fleet_size_r1-v3-aido-scorer:2018_10_20_20_59_03@sha256:a21acb3e9b394992951537c9fa3f066cddb1d70b307d9a8d9929fe0c51c6a36b
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.