AI Driving Olympics Home Challenges Submissions Jobs

Welcome to the AI Driving Olympics (AI-DO) server.

You can find an introduction to AI-DO here.

The reference manual will get you started.

Statistics

188users
42challenges
3644submissions
23441evaluation jobs

AI-DO is brought to you by:

AI-DO 2 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories
Challenge definition challenge-aido_LF
Submission templates
Agent template- challenge-aido_LF-template-random
Pytorch templatePyTorch challenge-aido_LF-template-pytorch
Tensorflow templateTensorflow challenge-aido_LF-template-tensorflow
ROS templateROS challenge-aido_LF-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido_LF-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido_LF-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido_LF-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido_LF-baseline-duckietown

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, testing πŸ₯‡)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11MYF3590test3.72160.780
22JBRRussia3340JetBrains Research3.1161.131.4
33almasip3539My solution using reinforcement learning3.1140.730.2
45jp188131004943381RL-TH-shi2.481610.6
510awoo4243094Baseline-IL-logs-tensorflow1.24140.60
611Bea Baselines3522challenge-aido_LF-baseline-duckietown1.24100.470.4
715ioart3266SSegm1.2460.250
817duckietown_mum2912challenge-aido_LF-baseline-duckietown1.2460.440
919Andy Ser3154challenge-aido_LF-baseline-duckietown1.2460.60.2
1021enicky3626Baseline solution using reinforcement learning1.2440.150

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, validation πŸ‹)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11MYF3131test3.72160.651.4
23jp188131004943281Second test - TH3.72160.771
315JBRRussia3338JetBrains Research3.1161.080
418Bea Baselines3503Baseline-IL-logs-tensorflow3.1161.181.4
519RamiNaim3126[0.27;0.75]3.1161.190
622ioart3239SSegm3.1161.231.8
733almasip3114Baseline solution using reinforcement learning2.48160.950
845ierosodin3669Baseline solution using reinforcement learning1.86161.312
950awoo4243634Baseline-IL-logs-tensorflow1.86140.550
1089Andy Ser3153challenge-aido_LF-baseline-duckietown1.24100.490.4

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, testing πŸ₯‡)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
12JBRRussia3449JetBrains Research1.24160.710
23RamiNaim2680challenge-aido_LF-baseline-duckietown1.24160.912
34Konstantin Chayka2694challenge-aido_LF-baseline-duckietown1.24120.720.8
46enicky3629Baseline solution using reinforcement learning0.6260.181.6
58AlexKaravaev2860challenge-aido_LF-baseline-duckietown0.6260.210.2
69Victor Adolfo Romero Cano3597challenge-aido_LF-template-random0.6240.10.8
710AmaurX3367challenge-aido_LF-template-random0.6240.10.8
820zamatory2644challenge-aido_LF-template-ros - Template solution using ROS0.6240.121
923vguerra2404Baseline solution using reinforcement learning0.6220.080.6

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, validation πŸ‹)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11MYF3650test3.1160.610
23jp188131004943401RL-TH-shi3.1160.871
35almasip3541My solution using reinforcement learning3.1160.951
46JBRRussia3344JetBrains Research3.1161.010
520RamiNaim2708challenge-aido_LF-baseline-duckietown1.24161.032.2
622Konstantin Chayka2695challenge-aido_LF-baseline-duckietown1.24100.540.4
728enicky3624Baseline solution using reinforcement learning1.2440.10.6
835AlexKaravaev2861challenge-aido_LF-baseline-duckietown0.6280.210.6
938Victor Adolfo Romero Cano3598challenge-aido_LF-template-random0.6240.120.6
1039AmaurX3368challenge-aido_LF-template-random0.6240.120.6

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, testing πŸ₯‡)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11Victor Adolfo Romero Cano3600challenge-aido_LF-template-random1.2440.150.6
22AmaurX3371challenge-aido_LF-template-random1.2440.150.6
311AlexKaravaev2864challenge-aido_LF-baseline-duckietown0.62100.290.8
413zamatory2660challenge-aido_LF-baseline-duckietown0.6260.420.4
516Konstantin Chayka2612challenge-aido_LF-template-ros - Template solution using ROS0.6240.121
618enicky3632Baseline solution using reinforcement learning0.6240.160.6
720vguerra2406Baseline solution using reinforcement learning0.6220.060.2
822JBRRussia3451JetBrains Research0.6220.090

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, validation πŸ‹)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11jp188131004943222First test - TH4.34160.734.8
23almasip3580My solution using reinforcement learning3.72160.831
310enicky3633Baseline solution using reinforcement learning1.8680.293.6
413zamatory2661challenge-aido_LF-baseline-duckietown1.24160.780.6
515Konstantin Chayka2699challenge-aido_LF-baseline-duckietown1.24160.971.4
619JBRRussia3346JetBrains Research1.24100.580
720awoo4243103HKU Duckietown Project0.62160.485
822riza.velioglu3613challenge-aido_LF-template-pytorch0.62100.143.8
926RamiNaim2685challenge-aido_LF-baseline-duckietown0.6260.360.4
1027Victor Adolfo Romero Cano3601challenge-aido_LF-template-random0.6240.10.6

See also the extended leaderboard.

AI-DO 2 - Robotarium

Challenge LF πŸš— - Lane following (robotarium 🏎, validation πŸ‹)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑
11almasip3535Baseline solution using reinforcement learning1.172
23Bea Baselines3505challenge-aido_LF-template-pytorch02

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (robotarium 🏎, validation πŸ‹)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑
11Bea Baselines3552Running the real lane following -- without challenge container3.5118
22Bea Baselines3508challenge-aido_LF-template-pytorch0.5852

See also the extended leaderboard.

AI-DO 2 - Autonomous Mobility on Demand

In these challenges, the participant must coordinate a fleet of robo-taxis in various cities environments.

Challenge AMOD 🀹 ‍- Efficiency

Rank (comp)Rank (tech)UserSubmissionUser labelefficiency↑
11dcharrez2891Python template-61.64956
22ssviridov3106Python template-62.089393
310akleban3159Python template-64.797321

See also the extended leaderboard.

Challenge AMOD 🀹 - Fleet Size

Rank (comp)Rank (tech)UserSubmissionUser labelfleet_size↑
11akleban3161Python template-1000000000
22ssviridov3110Baseline-1000000000

See also the extended leaderboard.

Challenge AMOD 🀹 - Service Quality

Rank (comp)Rank (tech)UserSubmissionUser labelservice_quality↑
13akleban3160Python template-32.368986
24ssviridov3109Baseline-32.475822
39dcharrez2892Python template-32.803471

See also the extended leaderboard.

AI-DO 1 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories
Challenge definition challenge-aido1_LF1
Submission templates
Agent template- challenge-aido1_LF1-template-random
Pytorch templatePyTorch challenge-aido1_LF1-template-pytorch
Tensorflow templateTensorflow challenge-aido1_LF1-template-tensorflow
ROS templateROS challenge-aido1_LF1-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido1_LF1-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido1_LF1-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido1_LF1-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido1_LF1-baseline-duckietown

Challenge LF - Lane following (rev. 3)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11WEIGAO1633First trial18.6180.580.2
231heyt0ny1579SAIC MOSCOW MML18.6180.870.4
337miksaz1859JetBrains Research18.6181.340.2
462Jon1744JP pipeline16.74181.051.8
574VincentMai1033ROS-based Lane Following14.88181.861.8
675Benjamin1063My ROS solution14.26180.910.6
780lavoiems819Baby Duke13.02180.892.2
890David1139Pytorch IL12.4181.491.4
9103orlando.m.bol@gmail.com455PyTorch DDPG template9.92181.381.4
10123placaille985Dolores' Awakening8.68100.590.8

See also the extended leaderboard.

Challenge LF - Lane following (rev. 4, more samples)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11heyt0ny2133Copy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)19.22180.720
22WEIGAO2132Copy of #1: sub 1633 by WEIGAO (First trial)18.6180.60
34Benjamin2137Copy of #6: sub 1063 by Benjamin (My ROS solution)13.64181.431.2
45Jon2135Copy of #4: sub 1684 by Jon (JP pipeline)11.16120.770
56VincentMai2136Copy of #5: sub 1033 by VincentMai (ROS-based Lane Following)9.3100.982.2
67hvrigazov2142Copy of #11: sub 1552 by hvrigazov (Visteon perception team)5.58181.020.8
78trimcao2148Copy of #17: sub 1515 by trimcao (Tensorflow template)5.58100.380.2
89shandonguniversityInspur2145Copy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)5.58100.380.2
910melorian2149Copy of #18: sub 1378 by melorian (Tensorflow template)5.58100.430.2
1011madelhorius2147Copy of #16: sub 1832 by madelhorius (Tensorflow template)5.58100.430.2

See also the extended leaderboard.

Challenge LFV - Lane following with vehicles (rev. 1)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
4498happyduckie2007Copy of #31: sub 419 by happyduckie (PyTorch template)0.6220.060.8
4599iban_alex2008Copy of #32: sub 651 by iban_alex (PyTorch template)0.6220.061
46101coolcat6472013Copy of #37: sub 592 by coolcat647 (PyTorch template)0.6220.070.8
47106marshin2015Copy of #39: sub 756 by marshin (PyTorch template)0.6220.080.8
48107lmandrile2012Copy of #36: sub 613 by lmandrile (PyTorch template)0.6220.080.8
49108lavoiems1985Copy of #7: sub 819 by lavoiems (Baby Duke)0.6220.10
50110melorian1995Copy of #18: sub 1378 by melorian (Tensorflow template)0.6220.120
51111madelhorius1993Copy of #16: sub 1832 by madelhorius (Tensorflow template)0.6220.120
52113yangzm111493Random execution0.6220.120.8
53114tongqiusui1991Copy of #13: sub 1363 by tongqiusui (Tensorflow template)0.6220.130.2

See also the extended leaderboard.

Challenge LFV - Lane following with vehicles (rev. 2 - dynamic, 20 samples)

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11WEIGAO2074Copy of #1: sub 1633 by WEIGAO (First trial)17.98180.310
23Benjamin2079Copy of #6: sub 1063 by Benjamin (My ROS solution)7.4481.070.4
34pravishsainath2094Copy of #21: sub 1085 by pravishsainath (PyTorch DDPG template)3.1180.458.4
45sodabeta2093Copy of #20: sub 903 by sodabeta (PyTorch DDPG template)3.1180.458.4
56VincentMai2078Copy of #5: sub 1033 by VincentMai (ROS-based Lane Following)3.140.250.4
67miksaz2076Copy of #3: sub 1859 by miksaz (JetBrains Research)2.4820.150.2
78Sashkasem2124Copy of #51: sub 428 by Sashkasem (Random execution)1.24181.710
89anna.tsalapova2123Copy of #50: sub 396 by anna.tsalapova (simple submition)1.24181.710
910haliang2108Copy of #35: sub 784 by haliang (Random execution)1.2440.120.8
1011gunshi2095Copy of #22: sub 1268 by gunshi (ROS-based Lane Following)1.2440.260

See also the extended leaderboard.

AI-DO 1 - AMoD

In these challenges, the participant must coordinate a fleet of robo-taxis in various cities environments.

Challenge [AIDO 1] AMOD - Efficiency (rev. 1)

Rank (comp)Rank (tech)UserSubmissionUser labelefficiency↑
11lic1883super fishy-11.88762
29JoelGaechter1696greedy but not so lazy-34.87095
318rumpelstilzchen1663Simsalabim-64.327313

See also the extended leaderboard.

Challenge [AIDO 1] AMOD - Fleet Size (rev. 1)

Rank (comp)Rank (tech)UserSubmissionUser labelfleet_size↑
11lic1880fishy-1000000000
23JoelGaechter1698greedy but not so lazy-1000000000
34rumpelstilzchen1673Simsalabim 2-1000000000

See also the extended leaderboard.

Challenge [AIDO 1] AMOD - Service Quality (rev. 1)

Rank (comp)Rank (tech)UserSubmissionUser labelservice_quality↑
16lic1885inaccessible code but it scores better than without-20.224397
210JoelGaechter1697greedy but not so lazy-20.554737
321lsieber1735Simple FIFO-21.992748
425mpicquet1784Python template-30.489252
531rumpelstilzchen1655Mein zweiter Zauberspruch-32.207862
635ossamaAhmed1770Python template-32.582267
745zgxsin1769Python template-33.656357

See also the extended leaderboard.

Test challenges

These are the test challenges.

Challenge [Test] Multi-step evaluation with IPFS

Rank (comp)Rank (tech)UserSubmissionUser labelpassed-step1↑passed-step2↑
not competing1Andrea Censi3375Solution template11

See also the extended leaderboard.

Challenge [Test] Multi-step evaluation

Rank (comp)Rank (tech)UserSubmissionUser labelpassed-step1↑passed-step2↑
not competing1Andrea Censi3374Solution template11
not competing2Andrea Censi3360Solution template11
not competing3Andrea Censi3358Solution template11

See also the extended leaderboard.

Challenge Simple prediction

Rank (comp)Rank (tech)UserSubmissionUser labelL1 error ↓L2 error ↓
11Victor Adolfo Romero Cano3592PredictorLast0.10.02
22Michael Su3254PredictorLast0.10.02
33Brian Chuang 3246PredictorLast0.10.02
44johnshen10093245PredictorLast0.10.02
56Masa2895PredictorLast0.10.02
67stoplight3255PredictorLast0.110.02
78WolfChen3250PredictorLast0.110.02
89Jerry3228PredictorLast0.110.02
912rulee19983180PredictorLast0.110.02
1015Ian3175PredictorLast0.110.02

See also the extended leaderboard.

Other

These are all other challenges