AI Driving Olympics Home Challenges Submissions Jobs

Challenge "Simple prediction"

Challenge description

Simple prediction challenge

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

L1 error

-

L2 error

-

Details

Technical details

Evaluation steps details

  • At the beginning execute step step1-simulation.

  • If step step1-simulation finishes with status success, then declare the submission SUCCESS.

  • If step step1-simulation finishes with status failed, then declare the submission FAILED.

  • If step step1-simulation finishes with status error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout 120.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            AIDONODE_DATA_IN: /fifos/predictor-in
            AIDONODE_DATA_OUT: fifo:/fifos/predictor-out
    evaluation:
        image: docker.io/andreacensi/aido2-pred-step1-simulation-evaluation:2019_04_14_16_11_27@sha256:5b0883b3b915ef03aaaf78a6e1fa26f319058ae7723b91e9a44d92d136aeb3f7
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.