AI Driving Olympics Home Challenges Submissions Jobs

Challenge "Native"

Challenge description

(No description.)

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

Traveled distance - driven_lanedir_consec

This is the median distance traveled, along a lane. (That is, going in circles will not make this metric increase.)

This is discretized to tiles.

Survival time - survival_time

This is the median survival time. The simulation is terminated when the car goes outside of the road or it crashes with an obstacle.

Lateral deviation - deviation-center-line

This is the median lateral deviation from the center line.

Major infractions - in-drivable-lane

This is the median of the time spent outside of the drivable zones. For example this penalizes driving in the wrong lane.

Dependencies

Dependencies

No dependencies

Details

Technical details

Evaluation steps details

    Evaluation step eval-native0

    Timeout 18000.0

    Evaluation in the robotarium.

    This is the Docker Compose configuration skeleton:

    version: '3'
    services:
        evaluator:
            image: docker.io/andreacensi/aido3-native-eval-native0-evaluator:2019_11_28_17_20_14@sha256:79a231d8a49b004aa662d8171269526f91ac7b139bbe98e51fbb03d285375941
            environment: {}
            ports:
            - 8005:8005
    

    The text SUBMISSION_CONTAINER will be replaced with the user containter.

    Resources required for evaluating this step

    # Duckiebots1
    AIDO 2 Map LF public1