Challenge "aido2-AMOD-efficiency"

These are the metrics defined:

efficiency - efficiency

-

Evaluation steps details

• At the beginning execute step step1-simulation.

• If step step1-simulation has result success, then execute step step2-scoring.

• If step step1-simulation has result failed, then declare the submission FAILED.

• If step step1-simulation has result error, then declare the submission ERROR.

• If step step2-scoring has result success, then declare the submission SUCCESS.

• If step step2-scoring has result failed, then declare the submission FAILED.

• If step step2-scoring has result error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout 7200.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    aido-host:
        image: docker.io/andreacensi/aido2-amod-efficiency-step1-simulation-aido-host:2019_04_24_10_53_32@sha256:03b346288d3bae570a3bddc46399a84f9c7fe7986535402e107806c746ca2c98
        environment:
            SCENARIO: SanFrancisco.20080518
            NUMBER_OF_VEHICLES: '20'
            REQUEST_NUMBER_DESIRED: '500'

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout 600.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    aido-scorer:
        image: docker.io/andreacensi/aido2-amod-efficiency-step2-scoring-aido-scorer:2019_04_24_10_55_57@sha256:78fece85eb90e5c190b137622713e0567abca9365318181164ffe6b25b4de858
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.