AI Driving Olympics Home Challenges Submissions Jobs

Challenge "LF - Lane following (rev. 4, more samples) "

Challenge description

Lane following challenge.

This challenge is described in the detail in the book.

Leaderboard

Submissions

Challenge logistics

Scoring

Scoring criteria

These are the metrics defined:

Traveled distance

This is the median distance traveled, along a lane. (That is, going in circles will not make this metric increase.)

This is discretized to tiles.

Survival time

This is the median survival time. The simulation is terminated when the car goes outside of the road or it crashes with an obstacle.

Lateral deviation

This is the median lateral deviation from the center line.

Major infractions

This is the median of the time spent outside of the drivable zones. For example this penalizes driving in the wrong lane.

Details

Technical details

Evaluation steps details

  • At the beginning execute step step1-simulation.

  • If step step1-simulation finishes with status success, then execute step step2-scoring.

  • If step step1-simulation finishes with status failed, then declare the submission FAILED.

  • If step step1-simulation finishes with status error, then declare the submission ERROR.

  • If step step2-scoring finishes with status success, then execute step step3-videos.

  • If step step2-scoring finishes with status failed, then declare the submission FAILED.

  • If step step2-scoring finishes with status error, then declare the submission ERROR.

  • If step step3-videos finishes with status success, then execute step step4-viz.

  • If step step3-videos finishes with status failed, then declare the submission FAILED.

  • If step step3-videos finishes with status error, then declare the submission ERROR.

  • If step step4-viz finishes with status success, then declare the submission SUCCESS.

  • If step step4-viz finishes with status failed, then declare the submission FAILED.

  • If step step4-viz finishes with status error, then declare the submission ERROR.

Evaluation step step1-simulation

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    solution:
        image: SUBMISSION_CONTAINER
        environment: {}
    evaluator:
        image: andreacensi/aido1_lf1_r4-v3-step1-simulation-evaluator:2018_12_07_13_03_11@sha256:d14a8e78df036113c89c44a413dd4f2839aea784ba20c02cfb184aeba02248b7
        environment:
            launcher_parameters: "challenge: LF\nepisodes: 7\nsteps_per_episode: 500\n\
                include_map: true\nenvironment-constructor: Simulator\nenvironment-parameters:\
                \ {seed: 123, map_name: loop_empty, max_steps: 500001, domain_rand:\
                \ 0,\n  camera_width: 640, camera_height: 480, accept_start_angle_deg:\
                \ 6, full_transparency: true,\n  distortion: true}\nagent-info: {challenge:\
                \ LF}\n"
            solution_parameters: '{env: Duckietown-Lf-Lfv-Navv-Silent-v1}

                '

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step4-viz

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    visualization:
        image: andreacensi/aido1_lf1_r4-v3-step4-viz-visualization:2018_12_07_16_14_09@sha256:0465ad7f2c32cec964dc44caf4a79b2b8ce1b1d1dde62431be7c092e7bd36765
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step3-videos

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    videos:
        image: andreacensi/aido1_lf1_r4-v3-step3-videos-videos:2018_12_07_11_48_55@sha256:1f5598b128eb6794a4d543a74c7b44c4d5e653eaea2606093b5fb880fe196bc5
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.

Evaluation step step2-scoring

Timeout None

This is the Docker Compose configuration skeleton:

version: '3'
services:
    scorer:
        image: andreacensi/aido1_lf1_r4-v3-step2-scoring-scorer:2018_12_07_11_48_59@sha256:4c899640107fbb92373fabeba60ad837956a8cabb3b2c4991875ed8fd9fd06c7
        environment: {}

The text SUBMISSION_CONTAINER will be replaced with the user containter.

Resources required for evaluating this step

No particular resources required.