Duckietown Challenges Home Challenges Submissions

Challenge "lx22-planning-cc-empty-vali"

Challenge description

Planning test with empty environment.

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

mistake ratio - mistakes

A mistake is when you provide an infeasible plan

Success ratio - success_ratio

Percentage of (declared) successfull queries.

Duration - duration

Average plan duration

Plan complexity - complexity

Average plan complexity (number of steps)

Min distance - avg_min_distance

Min distance from obstacles

Dependencies

Dependencies

No dependencies

Details

Technical details

Evaluation steps details

Evaluation step step1

Timeout 1000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment:
            AIDONODE_DATA_IN: /fifos/checker-in
            AIDONODE_DATA_OUT: fifo:/fifos/checker-out
    evaluator:
        image: andreacensi/duckietown-challenges:lx22-planning-cc-empty-vali-step1-evaluator@sha256:5f280cf87ec45ad4f96f42423a54d726553d1549866870c3bb2969d3b8bbf78c
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.