AI Driving Olympics Home Challenges Submissions Jobs

Welcome to the AI Driving Olympics (AI-DO) server.

You can find an introduction to AI-DO here.

The reference manual will get you started.

Statistics

271users
65challenges
6284submissions
30715evaluation jobs

AI-DO is brought to you by:

AI-DO 3 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories

Challenge definition challenge-aido_LF
Submission templates
Agent template- challenge-aido_LF-template-random
Pytorch templatePyTorch challenge-aido_LF-template-pytorch
Tensorflow templateTensorflow challenge-aido_LF-template-tensorflow
ROS templateROS challenge-aido_LF-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido_LF-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido_LF-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido_LF-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido_LF-baseline-duckietown

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

frank_qcd_qk 5981BME-Conti 5759rrwiyatn 4676saryazdi 4769
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1frank_qcd_qk59811/12019-12-09|FrankNet|v3-LFSIM6.2161.020
2BME-Conti57591/1lzoltan5.58160.830.8
3rrwiyatn46761/1challenge-aido_LF-baseline-duckietown4.96160.682.2
-BME-Conti58981/1lzoltan-034.96160.71
4saryazdi47691/1upduck4.96160.720
-frank_qcd_qk45071/12019-11-19|FrankNet4.96160.720
5bayesianduckie49691/1challenge-aido_LF-baseline-duckietown4.96160.721.2
-BME-Conti59071/1lzoltan-044.96160.740.8
-BME-Conti57871/1lzoltan_014.96160.740.8
-BME-Conti58071/1lzoltan-024.96160.750.6

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

BME-Conti 5821JBRRussia1 5936frank_qcd_qk 5982miksaz 6085
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1BME-Conti58211/1kaland-2253084.34160.570
-BME-Conti58081/1lzoltan-024.34160.80.2
-BME-Conti59081/1lzoltan-044.34160.860.8
2JBRRussia159361/1challenge-aido_LF-baseline-IL-02264.34160.91.4
-BME-Conti58991/1lzoltan-034.34160.920.4
3frank_qcd_qk59821/12019-12-09|FrankNet|v3-LFSIM4.34140.710.2
-frank_qcd_qk45081/12019-11-19|FrankNet3.72160.70
-frank_qcd_qk45601/12019-11-19|FrankNet|Andrew_Activation3.72160.720
-JBRRussia159201/1challenge-aido_LF-baseline-IL-02323.72160.731.6
4miksaz60851/1chameleon-09-trio3.72160.752.2

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

BME-Conti 5909JBRRussia1 6073frank_qcd_qk 5650miksaz 5716
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1BME-Conti59091/1lzoltan-044.96160.921
-BME-Conti59001/1lzoltan-034.34160.880.6
2JBRRussia160731/1challenge-aido_LF-baseline-IL-M4.34160.950.8
3frank_qcd_qk56501/12019-12-09|FrankNet|v34.34161.011.6
-frank_qcd_qk60221/12019-12-10|FrankNet|(Kay❀️Frank)4.34100.653.4
-JBRRussia160941/14 seasons3.72160.680.8
-frank_qcd_qk45611/12019-11-19|FrankNet|Andrew_Activation3.72160.712
4miksaz57161/1chameleon-103.72160.961.4
-miksaz56341/1chameleon-093.72160.980.8
-JBRRussia159221/1challenge-aido_LF-baseline-IL-02323.72160.991.4

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

BME-Conti 5760frank_qcd_qk 5986
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1BME-Conti57601/1lzoltan4.96160.791
-BME-Conti59031/1lzoltan-034.96160.811
-BME-Conti58121/1lzoltan-024.96160.811
2frank_qcd_qk59861/12019-12-09|FrankNet|v3-LFSIM4.96160.831.2
-frank_qcd_qk56531/12019-12-09|FrankNet|v34.96160.921.6
-BME-Conti58251/1kaland-2253084.34160.540
-BME-Conti45201/1kaland-2240s4.34160.620
-BME-Conti57821/1kaland-2252104.34160.730.2
-frank_qcd_qk45641/12019-11-19|FrankNet|Andrew_Activation4.34160.780
-frank_qcd_qk45121/12019-11-19|FrankNet4.34160.780

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

BME-Conti 5824frank_qcd_qk 4563JBRRussia1 5921saryazdi 5846
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1BME-Conti58241/1kaland-2253084.34160.610.4
2frank_qcd_qk45631/12019-11-19|FrankNet|Andrew_Activation4.34160.760
-frank_qcd_qk60471/12019-12-10|FrankNet|(Kay❀️Frank)4.34160.760.4
-frank_qcd_qk56521/12019-12-09|FrankNet|v34.34160.822.2
-frank_qcd_qk45111/12019-11-19|FrankNet4.34160.830
-frank_qcd_qk56431/12019-12-05|FrankNet|v34.34160.872.6
-frank_qcd_qk59851/12019-12-09|FrankNet|v3-LFSIM4.34160.911.4
3JBRRussia159211/1challenge-aido_LF-baseline-IL-02323.72160.811.2
4saryazdi58461/1upduck3.72160.850
5miksaz57701/1chameleon-10-jjlu3.72120.811.2

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

JBRRussia1 6269frank_qcd_qk 5642BME-Conti 5901
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1JBRRussia162691/10531 seasons4.96160.870.2
2frank_qcd_qk56421/12019-12-05|FrankNet|v34.96160.912.2
-frank_qcd_qk56511/12019-12-09|FrankNet|v34.96160.951.2
-frank_qcd_qk45621/12019-11-19|FrankNet|Andrew_Activation4.34160.690
-JBRRussia160741/1challenge-aido_LF-baseline-IL-M4.34160.970.8
3BME-Conti59011/1lzoltan-034.34140.750.8
-JBRRussia162751/10439 seasons4.34140.890.6
-frank_qcd_qk59841/12019-12-09|FrankNet|v3-LFSIM4.34140.90.6
-frank_qcd_qk45101/12019-11-19|FrankNet3.72160.690
-JBRRussia160951/14 seasons3.72160.721.2

See also the extended leaderboard.

AI-DO 3 - Robotarium

These are the real robot evaluations.

Challenge LF πŸš— - Lane following (robotarium 🏎, validation πŸ‹)

This challenge is OPEN for submissions.

phmarm 6017frank_qcd_qk 6058BME-Conti 4540JBRRussia1 6097
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1phmarm60171/9pp + veh dect10.53401.910.4
2Bea Baselines44531/9challenge-aido_LF-baseline-duckietown8.775482.80
-phmarm57631/9original pp8.19422.750
3frank_qcd_qk60581/92019-12-10|FrankNet|(Kay❀️Frank)7.605261.612.6
4BME-Conti45401/9kaland-224056.435422.440
5JBRRussia160971/94 seasons6.435361.414.6
-JBRRussia159411/9challenge-aido_LF-baseline-IL-02265.265321.617.4
6miksaz60901/9chameleon-09-trio5.265301.563.2
-BME-Conti57831/9kaland-2252104.68241.37.4
-frank_qcd_qk45131/92019-11-19|FrankNet4.68241.56

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (robotarium 🏎, validation πŸ‹)

This challenge is OPEN for submissions.

Bea Baselines 4454CharanReddy 5968frank_qcd_qk 6059phmarm 6018
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1Bea Baselines44541/9challenge-aido_LF-baseline-duckietown4.68422.395.4
2CharanReddy59681/9challenge-aido_LF-baseline-duckietown1.755120.412.8
3frank_qcd_qk60591/92019-12-10|FrankNet|(Kay❀️Frank)1.17160.333.8
-Bea Baselines44431/9straight1.1780.322
4phmarm60181/9pp + veh dect1.1780.332.4
5BME-Conti58271/9kaland-2253080.585100.311.2

See also the extended leaderboard.

AI-DO 2 - Robotarium

These are the real robot evaluations.

Challenge LF πŸš— - Lane following (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑
1Victor Adolfo Romero Cano35931/61.174
2enicky36251/60.58532

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑
1enicky36281/61.7554
2almasip35431/6My solution using reinforcement learning1.174
3riza.velioglu36081/60.5856
4Victor Adolfo Romero Cano35961/60.5852

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑
1Bea Baselines35111/6challenge-aido_LF-template-pytorch1.75528
2enicky36891/6Baseline solution using reinforcement learning1.7554
3jp1881310049437371/6Final test - TH-jp1.174
4Victor Adolfo Romero Cano35991/61.174
5almasip35821/6My solution using reinforcement learning0.5854

See also the extended leaderboard.

AI-DO 2 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories

Challenge definition challenge-aido_LF
Submission templates
Agent template- challenge-aido_LF-template-random
Pytorch templatePyTorch challenge-aido_LF-template-pytorch
Tensorflow templateTensorflow challenge-aido_LF-template-tensorflow
ROS templateROS challenge-aido_LF-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido_LF-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido_LF-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido_LF-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido_LF-baseline-duckietown

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

MYF 3131jp18813100494 3281JBRRussia 3338Bea Baselines 3503
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1MYF31311/1test3.72160.651.4
2jp1881310049432811/1Second test - TH3.72160.771
-jp1881310049432961/1Third test - TH3.72161.171.2
-jp1881310049437311/1LF sim test - wh3.72161.430.2
-jp1881310049431891/1First test - TH3.1160.591
-jp1881310049433941/1RL-TH-shi3.1160.750
-jp1881310049435871/1Fourth test - TH3.1160.844.6
3JBRRussia33381/1JetBrains Research3.1161.080
-JBRRussia31901/1NN Solution3.1161.111.8
4Bea Baselines35031/1Baseline-IL-logs-tensorflow3.1161.181.4

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

MYF 3650jp18813100494 3401almasip 3541JBRRussia 3344
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1MYF36501/1test3.1160.610
2jp1881310049434011/1RL-TH-shi3.1160.871
3almasip35411/1My solution using reinforcement learning3.1160.951
4JBRRussia33441/1JetBrains Research3.1161.010
-jp1881310049433151/1RL - TH -hhk1.86160.735.8
-jp1881310049437421/1LF sim test - wh1.8680.392.4
5RamiNaim27081/1challenge-aido_LF-baseline-duckietown1.24161.032.2
6Konstantin Chayka26951/1challenge-aido_LF-baseline-duckietown1.24100.540.4
-almasip31291/1Baseline solution using reinforcement learning1.2480.271.4
-jp1881310049434401/1RL-TH-HHK1.2460.231.2

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

jp18813100494 3222almasip 3580MYF 3673enicky 3633
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1jp1881310049432221/1First test - TH4.34160.734.8
-jp1881310049433961/1RL-TH-shi3.72160.770
2almasip35801/1My solution using reinforcement learning3.72160.831
3MYF36731/1test3.1160.720
4enicky36331/11.8680.293.6
5zamatory26611/1challenge-aido_LF-baseline-duckietown1.24160.780.6
6Konstantin Chayka26991/1challenge-aido_LF-baseline-duckietown1.24160.971.4
7JBRRussia33461/1JetBrains Research1.24100.580
8awoo42431031/1HKU Duckietown Project0.62160.485
9riza.velioglu36131/10.62100.143.8

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

MYF 3590JBRRussia 3340almasip 3539jp18813100494 3381
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1MYF35901/1test3.72160.780
2JBRRussia33401/1JetBrains Research3.1161.131.4
3almasip35391/1My solution using reinforcement learning3.1140.730.2
-almasip31151/1Baseline solution using reinforcement learning2.48160.840
4jp1881310049433811/1RL-TH-shi2.481610.6
5ierosodin36791/1Baseline solution using reinforcement learning1.24160.147.4
-jp1881310049437241/1Second test -RGB- TH-jp1.24160.390
6awoo42430941/1Baseline-IL-logs-tensorflow1.24140.60
7Bea Baselines35221/1challenge-aido_LF-baseline-duckietown1.24100.470.4
8ioart32661/1SSegm1.2460.250

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

MYF 3681JBRRussia 3449RamiNaim 2680Konstantin Chayka 2694
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1MYF36811/1test2.48160.490
2JBRRussia34491/1JetBrains Research1.24160.710
3RamiNaim26801/1challenge-aido_LF-baseline-duckietown1.24160.912
4Konstantin Chayka26941/1challenge-aido_LF-baseline-duckietown1.24120.720.8
5enicky36291/10.6260.181.6
6AlexKaravaev28601/1challenge-aido_LF-baseline-duckietown0.6260.210.2
7seb37491/10.6240.10.8
8Victor Adolfo Romero Cano35971/10.6240.10.8
9AmaurX33671/1challenge-aido_LF-template-random0.6240.10.8
10zamatory26441/1challenge-aido_LF-template-ros - Template solution using ROS0.6240.121

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

MYF 3677seb 3752Victor Adolfo Romero Cano 3600AmaurX 3371
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1MYF36771/1test2.48160.630
2seb37521/11.2440.150.6
3Victor Adolfo Romero Cano36001/11.2440.150.6
4AmaurX33711/1challenge-aido_LF-template-random1.2440.150.6
5AlexKaravaev28641/1challenge-aido_LF-baseline-duckietown0.62100.290.8
6zamatory26601/1challenge-aido_LF-baseline-duckietown0.6260.420.4
-zamatory26481/1challenge-aido_LF-template-ros - Template solution using ROS0.6240.121
7Konstantin Chayka26121/1challenge-aido_LF-template-ros - Template solution using ROS0.6240.121
8enicky36321/10.6240.160.6
9vguerra24061/1Baseline solution using reinforcement learning0.6220.060.2

See also the extended leaderboard.

AI-DO 2 offseason - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories

Challenge definition challenge-aido_LF
Submission templates
Agent template- challenge-aido_LF-template-random
Pytorch templatePyTorch challenge-aido_LF-template-pytorch
Tensorflow templateTensorflow challenge-aido_LF-template-tensorflow
ROS templateROS challenge-aido_LF-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido_LF-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido_LF-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido_LF-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido_LF-baseline-duckietown

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

chuyj 3803kene4192 3996jagwar 4008ekunnii 3947
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1chuyj38031/1Baseline solution using reinforcement learning1.8640.20.8
2kene419239961/1CNN-8logs-48by96-4001.24100.360.4
3jagwar40081/1Baseline solution using reinforcement learning0.6260.081.8
4ekunnii39471/1challenge-aido_LF-template-random0.6240.140.4
5AmaurX38101/1Let's do this one today0.6240.140.4
6felipecer1337841/1challenge-aido_LF-template-random0.6240.140.4
7riza.velioglu37791/1Baseline-IL-logs-tensorflow0.6240.161
-ekunnii39741/1Baseline solution using reinforcement learning0.6220.050.6
8dgmds17av40261/1challenge-aido_LF-template-pytorch0.6220.060.6
9movehoon38281/1challenge-aido_LF-template-pytorch0.6220.060.6

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

kene4192 3873movehoon 3831
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1kene419238731/1Baseline-IL-logs-tensorflow1.24160.332
-kene419239381/1CNN-Adam-More-Data-Less-One-3001.24160.687
-kene419240091/1CNN-8logs-60by80-latest1.24140.332.4
-kene419239931/1CNN-8logs-48by96-4001.24140.392.6
-kene419239081/1CNN-Adam-More-Data1.24100.660
-kene419239421/1ResNet-Adam-More-Data-Less-One-2001.2480.230
-kene419239971/1CNN-8logs-60by80-3001.2480.32.4
2movehoon38311/1challenge-aido_LF-template-pytorch0.62120.185.2
-kene419239941/1CNN-8logs-48by96-300-same0.6280.212
-kene419239261/1CNN-Adam-More-Data-Less-One-1000.6280.253

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

kene4192 3937AmaurX 3814felipecer13 3788movehoon 3834
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1kene419239371/1CNN-Adam-More-Data-Less-One-3000.6260.310.2
-kene419238461/1kene-template-random0.6240.10.6
2AmaurX38141/1Let's do this one today0.6240.10.6
3felipecer1337881/1challenge-aido_LF-template-random0.6240.10.6
4movehoon38341/1challenge-aido_LF-template-pytorch0.6220.060.4
5jagwar38551/1challenge-aido_LF-template-pytorch0.6220.080
-jagwar39651/1Baseline solution using reinforcement learning0.6220.090.6

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

kene4192 3839AmaurX 3809felipecer13 3783chuyj 3881
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1kene419238391/1kene-template-random0.6240.110.6
2AmaurX38091/1Let's do this one today0.6240.110.6
3felipecer1337831/1challenge-aido_LF-template-random0.6240.110.6
4chuyj38811/1Baseline solution using reinforcement learning0.6220.080
5jagwar38481/1challenge-aido_LF-template-pytorch0.6220.080
6movehoon38271/1challenge-aido_LF-template-pytorch0.6220.080.2

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

AmaurX 3811felipecer13 3785jagwar 3851movehoon 3830
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1AmaurX38111/1Let's do this one today0.6240.10.8
2felipecer1337851/1challenge-aido_LF-template-random0.6240.10.8
3jagwar38511/1challenge-aido_LF-template-pytorch0.6220.070.2
4movehoon38301/1challenge-aido_LF-template-pytorch0.6220.080.8
5chuyj38841/1Baseline solution using reinforcement learning0.6220.090.2

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

AmaurX 3813movehoon 3833jagwar 3964
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1AmaurX38131/1Let's do this one today1.2440.150.6
2movehoon38331/1challenge-aido_LF-template-pytorch0.6220.080.2
3jagwar39641/1Baseline solution using reinforcement learning0.6220.10
-jagwar38541/1challenge-aido_LF-template-pytorch0.6220.10

See also the extended leaderboard.

AI-DO 2 offseason - Robotarium

These are the real robot evaluations.

AI-DO 2 - Autonomous Mobility on Demand

In these challenges, the participant must coordinate a fleet of robo-taxis in various cities environments.

Challenge AMOD 🀹 ‍- Efficiency

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelefficiency↑
1dcharrez28911/2Python template-61.64956
2ssviridov31061/2Python template-62.089393
3akleban31591/2Python template-64.797321
-ssviridov31081/2Baseline-64.894913

See also the extended leaderboard.

Challenge AMOD 🀹 - Service Quality

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelservice_quality↑
1akleban31601/2Python template-32.368986
2ssviridov31091/2Baseline-32.475822
3dcharrez28921/2Python template-32.803471
-ssviridov31071/2Python template-34.356604

See also the extended leaderboard.

Challenge AMOD 🀹 - Fleet Size

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelfleet_size↑
1akleban31611/2Python template-1000000000
2ssviridov31101/2Baseline-1000000000

See also the extended leaderboard.

AI-DO 1 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories
Challenge definition challenge-aido1_LF1
Submission templates
Agent template- challenge-aido1_LF1-template-random
Pytorch templatePyTorch challenge-aido1_LF1-template-pytorch
Tensorflow templateTensorflow challenge-aido1_LF1-template-tensorflow
ROS templateROS challenge-aido1_LF1-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido1_LF1-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido1_LF1-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido1_LF1-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido1_LF1-baseline-duckietown

Challenge LF - Lane following (rev. 3)

This challenge is CLOSED for submissions.

WEIGAO 1633heyt0ny 1579miksaz 1859Jon 1744
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1WEIGAO16331/4First trial18.6180.580.2
-WEIGAO18391/4NUS & Panasonic R&D Center Singapore18.6180.610.4
-WEIGAO17041/4NUS&PANASONIC_R&D_SINGAPORE18.6180.70.2
2heyt0ny15791/4SAIC MOSCOW MML18.6180.870.4
3miksaz18591/4JetBrains Research18.6181.340.2
4Jon17441/4JP pipeline16.74181.051.8
5VincentMai10331/4ROS-based Lane Following14.88181.861.8
6Benjamin10631/4My ROS solution14.26180.910.6
7lavoiems8191/4Baby Duke13.02180.892.2
8David11391/4Pytorch IL12.4181.491.4

See also the extended leaderboard.

Challenge LFV - Lane following with vehicles (rev. 1)

This challenge is CLOSED for submissions.

heyt0ny 1779WEIGAO 2051pravishsainath 1998sodabeta 1997
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1heyt0ny17791/4SAIC MOSCOW MML1.24180.260
2WEIGAO20511/4Panasonic R&D Center Singapore & NUS0.62180.250.4
-WEIGAO17291/4NUS&PANASONIC_R&D_SINGAPORE0.62180.260
-WEIGAO20691/4Copy of #1: sub 1633 by WEIGAO (First trial)0.62180.280.2
-heyt0ny19801/4Copy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)0.62180.40
3pravishsainath19981/4Copy of #21: sub 1085 by pravishsainath (PyTorch DDPG template)0.62180.458.4
4sodabeta19971/4Copy of #20: sub 903 by sodabeta (PyTorch DDPG template)0.62180.458.4
5Sashkasem20281/4Copy of #51: sub 428 by Sashkasem (Random execution)0.62180.640
6anna.tsalapova20271/4Copy of #50: sub 396 by anna.tsalapova (simple submition)0.62180.640
7David18931/4Pytorch IL0.62180.643.2

See also the extended leaderboard.

Challenge LF - Lane following (rev. 4, more samples)

This challenge is CLOSED for submissions.

heyt0ny 2133WEIGAO 2132Benjamin 2137Jon 2135
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1heyt0ny21331/4Copy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)19.22180.720
2WEIGAO21321/4Copy of #1: sub 1633 by WEIGAO (First trial)18.6180.60
3Benjamin21371/4Copy of #6: sub 1063 by Benjamin (My ROS solution)13.64181.431.2
4Jon21351/4Copy of #4: sub 1684 by Jon (JP pipeline)11.16120.770
5VincentMai21361/4Copy of #5: sub 1033 by VincentMai (ROS-based Lane Following)9.3100.982.2
6hvrigazov21421/4Copy of #11: sub 1552 by hvrigazov (Visteon perception team)5.58181.020.8
7trimcao21481/4Copy of #17: sub 1515 by trimcao (Tensorflow template)5.58100.380.2
8shandonguniversityInspur21451/4Copy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)5.58100.380.2
9melorian21491/4Copy of #18: sub 1378 by melorian (Tensorflow template)5.58100.430.2
10madelhorius21471/4Copy of #16: sub 1832 by madelhorius (Tensorflow template)5.58100.430.2

See also the extended leaderboard.

Challenge LFV - Lane following with vehicles (rev. 2 - dynamic, 20 samples)

This challenge is CLOSED for submissions.

WEIGAO 2074Benjamin 2079pravishsainath 2094sodabeta 2093
Rank (user)UserSubmissioncompleteUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1WEIGAO20741/4Copy of #1: sub 1633 by WEIGAO (First trial)17.98180.310
2Benjamin20791/4Copy of #6: sub 1063 by Benjamin (My ROS solution)7.4481.070.4
3pravishsainath20941/4Copy of #21: sub 1085 by pravishsainath (PyTorch DDPG template)3.1180.458.4
4sodabeta20931/4Copy of #20: sub 903 by sodabeta (PyTorch DDPG template)3.1180.458.4
5VincentMai20781/4Copy of #5: sub 1033 by VincentMai (ROS-based Lane Following)3.140.250.4
6miksaz20761/4Copy of #3: sub 1859 by miksaz (JetBrains Research)2.4820.150.2
7Sashkasem21241/4Copy of #51: sub 428 by Sashkasem (Random execution)1.24181.710
8anna.tsalapova21231/4Copy of #50: sub 396 by anna.tsalapova (simple submition)1.24181.710
9haliang21081/4Copy of #35: sub 784 by haliang (Random execution)1.2440.120.8
10gunshi20951/4Copy of #22: sub 1268 by gunshi (ROS-based Lane Following)1.2440.260

See also the extended leaderboard.

AI-DO 1 - AMoD

In these challenges, the participant must coordinate a fleet of robo-taxis in various cities environments.

Challenge [AIDO 1] AMOD - Efficiency (rev. 1)

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelefficiency↑
1lic18831/2super fishy-11.88762
-lic18721/2freq no rebalance-22.87149
-lic18691/2Freq no rebalance-33.672579
-lic18631/2No rebalance-34.20501
2JoelGaechter16961/2greedy but not so lazy-34.87095
-JoelGaechter15991/2greedy but lazy-34.959489
3rumpelstilzchen16631/2Simsalabim-64.327313
-rumpelstilzchen14401/2Mein erster Zauberspruch-64.93095
-lic17771/2Python template-74.2406

See also the extended leaderboard.

Challenge [AIDO 1] AMOD - Service Quality (rev. 1)

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelservice_quality↑
1lic18851/2inaccessible code but it scores better than without-20.224397
-lic18811/2fishy-20.286685
-lic18711/2freq no rebalance-20.286685
-lic18681/2Freq no rebalance-20.286685
2JoelGaechter16971/2greedy but not so lazy-20.554737
-lic18641/2No rebalance-20.716762
-JoelGaechter16001/2greedy but lazy-21.019952
-lic18581/2Req centroid-21.308614
-lic18271/2Python template not-21.911966
3lsieber17351/2Simple FIFO-21.992748

See also the extended leaderboard.

Challenge [AIDO 1] AMOD - Fleet Size (rev. 1)

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelfleet_size↑
1lic18801/2fishy-1000000000
-lic18791/2freq no rebalance-1000000000
2JoelGaechter16981/2greedy but not so lazy-1000000000
3rumpelstilzchen16731/2Simsalabim 2-1000000000
-rumpelstilzchen16721/2Simsalabim-1000000000
-JoelGaechter16011/2greedy but lazy-1000000000
-rumpelstilzchen14431/2Mein zweiter Zauberspruch-1000000000
-rumpelstilzchen14421/2Mein erster Zauberspruch-1000000000

See also the extended leaderboard.

Test challenges

These are the test challenges.

Challenge Simple prediction

This is a testing challenge. The scores are visible, but not the full output.

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelL1 error ↓L2 error ↓
1Brian Chuang 32461/1PredictorLast0.090.02
2cesar.vidarte45981/1PredictorLast0.10.02
3nicky42531/1PredictorLast0.10.02
4kar198935831/1PredictorLast0.10.02
5Alex111431811/1PredictorLast0.10.02
6dcharrez28871/1PredictorLast0.10.02
7rrwiyatn45861/1PredictorLast0.110.02
8sfaggi45441/1PredictorLast0.110.02
9riza.velioglu45311/1PredictorLast0.110.02
10AlexD43981/1PredictorLast0.110.02

See also the extended leaderboard.

Challenge [Test] Multi-step evaluation

This is a testing challenge. The scores are visible, but not the full output.

This challenge is CLOSED for submissions.

No entries to display.

See also the extended leaderboard.

Challenge [Test] Multi-step evaluation with IPFS

This is a testing challenge. The scores are visible, but not the full output.

This challenge is CLOSED for submissions.

Rank (user)UserSubmissioncompleteUser labelpassed-step1↑passed-step2↑
-Andrea Censi33751/2Solution template11

See also the extended leaderboard.

Other

These are all other challenges

Challenge LF πŸš— - Lane following (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

No entries to display.

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

No entries to display.

See also the extended leaderboard.

Challenge Native

This challenge is CLOSED for submissions.

No entries to display.

See also the extended leaderboard.