AI Driving Olympics Home Challenges Submissions Jobs

Challenge "[old] AMOD challenge (rev. 1)"

Challenge description

This is the AMOD challenge.

Getting started

We provide two templates: Java and Python.

To get started, clone either of the two repositories:

Java: https://github.com/duckietown/challenge-aido1_amod1-template-java

Python: https://github.com/duckietown/challenge-aido1_amod1-template-python

and read the instructions provided therein.

Getting help

To get help about this challenge, please file an issue on this repository.

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

service_quality - service_quality

-

efficiency - efficiency

-

fleet_size - fleet_size

-

Dependencies

Dependencies

No dependencies

Details

Technical details

Evaluation steps details

  • At the beginning execute step step1-simulation.

  • If step step1-simulation finishes with status success, then execute step step2-scoring.

  • If step step1-simulation finishes with status failed, then declare the submission FAILED.

  • If step step1-simulation finishes with status error, then declare the submission ERROR.

  • If step step2-scoring finishes with status success, then declare the submission SUCCESS.

  • If step step2-scoring finishes with status failed, then declare the submission FAILED.

  • If step step2-scoring finishes with status error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout None

This is the simulation step.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    aido-host:
        image: andreacensi/aido1_amod1-v3-evaluator:2018_10_12_00_08_55@sha256:9a134d614b26dec84639654e8989ea7ef893012b529a5e6a56e13d1acb9571b4
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout None

This step computes the actual scores.

This is the Docker Compose configuration skeleton:

version: '3'
services:
    aido-scorer:
        image: andreacensi/aido1_amod1-v3-evaluator:2018_10_12_00_09_02@sha256:8203d8e358f3106cc12a427481746c0a2d888321ad581cc55e7e9d3c4c962cf9
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.