AI Driving Olympics Home Challenges Submissions Jobs

Challenge "AMOD 🤹 ‍- Efficiency "

Challenge description

In the Efficiency Championship, the principal goal of the operator is to perform as efficiently as possible while maintaining the best possible service level.

The test scenario is San Francisco.

The fleet size is set to 20.

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

efficiency

-

Details

Technical details

Evaluation steps details

  • At the beginning execute step step1-simulation.

  • If step step1-simulation finishes with status success, then execute step step2-scoring.

  • If step step1-simulation finishes with status failed, then declare the submission FAILED.

  • If step step1-simulation finishes with status error, then declare the submission ERROR.

  • If step step2-scoring finishes with status success, then declare the submission SUCCESS.

  • If step step2-scoring finishes with status failed, then declare the submission FAILED.

  • If step step2-scoring finishes with status error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout 7200.0

This is the simulation step.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    aido-host:
        image: docker.io/andreacensi/aido2-amod-efficiency-step1-simulation-aido-host:2019_04_24_10_53_32@sha256:03b346288d3bae570a3bddc46399a84f9c7fe7986535402e107806c746ca2c98
        environment:
            SCENARIO: SanFrancisco.20080518
            NUMBER_OF_VEHICLES: '20'
            REQUEST_NUMBER_DESIRED: '500'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout 600.0

This step computes the actual scores.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    aido-scorer:
        image: docker.io/andreacensi/aido2-amod-efficiency-step2-scoring-aido-scorer:2019_04_24_10_55_57@sha256:78fece85eb90e5c190b137622713e0567abca9365318181164ffe6b25b4de858
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.