Challenge "mooc-collision-check-test"

These are the metrics defined:

false negative rate - false_negative_rate

False negative (guessed free but there was a collision)

false positive rate - false_positive_rate

False positive (detected a collision but it was not)

Evaluation steps details

• At the beginning execute step step1.

• If step step1 has result success, then declare the submission SUCCESS.

• If step step1 has result failed, then declare the submission FAILED.

• If step step1 has result error, then declare the submission ERROR.

Evaluation step step1

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: docker.io/andreacensi/duckietown-challenges@sha256:4f089f15f04e90f8168b11335ca4aea67615806ef2327ba95315f4d2509ab426
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.