Challenge "aido3-native"

These are the metrics defined:

Traveled distance - driven_lanedir_consec

This is the median distance traveled, along a lane. (That is, going in circles will not make this metric increase.)

This is discretized to tiles.

Survival time - survival_time

This is the median survival time. The simulation is terminated when the car goes outside of the road or it crashes with an obstacle.

Lateral deviation - deviation-center-line

This is the median lateral deviation from the center line.

Major infractions - in-drivable-lane

This is the median of the time spent outside of the drivable zones. For example this penalizes driving in the wrong lane.

Evaluation steps details

Evaluation step eval-native0

Timeout 18000.0

This is the Docker Compose configuration skeleton:

version: '3'
services:
    evaluator:
        image: docker.io/andreacensi/aido3-native-eval-native0-evaluator:2019_11_28_17_20_14@sha256:79a231d8a49b004aa662d8171269526f91ac7b139bbe98e51fbb03d285375941
        environment: {}
        ports:
        - 8005:8005

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step