AI Driving Olympics Home Challenges Submissions Jobs

Challenge "[AIDO 1] AMOD - Efficiency (rev. 1)"

Challenge description

In the Efficiency Championship, the principal goal of the operator is to perform as efficiently as possible while maintaining the best possible service level.

The test scenario is San Francisco.

The fleet size is set to 20.

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

efficiency

-

Details

Technical details

Evaluation steps details

  • At the beginning execute step step1-simulation.

  • If step step1-simulation finishes with status success, then execute step step2-scoring.

  • If step step1-simulation finishes with status failed, then declare the submission FAILED.

  • If step step1-simulation finishes with status error, then declare the submission ERROR.

  • If step step2-scoring finishes with status success, then declare the submission SUCCESS.

  • If step step2-scoring finishes with status failed, then declare the submission FAILED.

  • If step step2-scoring finishes with status error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout None

This is the simulation step.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    aido-host:
        image: andreacensi/aido1_amod_efficiency_r1-v3-step1-simulation-aido-host:2018_11_21_21_18_41@sha256:9b562dfe561e33a8a2711b6fd57f6d5c06f92c74459882d0392b5eb9425e43a5
        environment:
            SCENARIO: SanFrancisco.20080518
            NUMBER_OF_VEHICLES: '20'
            REQUEST_NUMBER_DESIRED: '500'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout None

This step computes the actual scores.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    aido-scorer:
        image: andreacensi/aido1_amod_efficiency_r1-v3-aido-scorer:2018_10_20_20_58_33@sha256:a21acb3e9b394992951537c9fa3f066cddb1d70b307d9a8d9929fe0c51c6a36b
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.