Duckietown Challenges Home Challenges Submissions

Challenge "mooc-planning-cc-empty-test"

Challenge description

Planning intermediate (validation)

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

mistake ratio - mistakes

A mistake is when you provide an infeasible plan

Success ratio - success_ratio

Percentage of (declared) successfull queries.

Duration - duration

Average plan duration

Plan complexity - complexity

Average plan complexity (number of steps)

Min distance - avg_min_distance

Min distance from obstacles

Dependencies

Dependencies

Depends on successful evaluation on Planning (empty env)

Validation step

The sum of the following tests should be at least 0.0.

Details

Technical details

Evaluation steps details

Evaluation step step1

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: docker.io/andreacensi/duckietown-challenges@sha256:af7464815f439e6e43a385152cb4a9e7bd9b5991c81e5da2b338eaf745b73231
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.