AI Driving Olympics Home Challenges Submissions Jobs

Challenge "[Test] Log processing"

Challenge description

This is a test challenge for log processing.

Artefacts

On success, the submission will produce an MP4 rendered from a log.

Example output (MP4)

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

passed

1 if the submission passed

Details

Technical details

Evaluation steps details

  • At the beginning execute step logstep1.

  • If step logstep1 finishes with status success, then declare the submission SUCCESS.

  • If step logstep1 finishes with status failed, then declare the submission FAILED.

  • If step logstep1 finishes with status error, then declare the submission ERROR.

Evaluation step logstep1

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    evaluator:
        image: andreacensi/aido1_log_processing-v3-evaluator:2018_10_12_00_08_25@sha256:7728483b8151d0de361d665c4f9836711b34c35965b48a40dd6768176cd9bf75
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

RAM free (MB)80
Disk available (MB)100