AI Driving Olympics Home Challenges Submissions Jobs

Welcome to the AI Driving Olympics (AI-DO) server.

You can find an introduction to AI-DO here.

The reference manual will get you started.

Statistics

193users
51challenges
3820submissions
24016evaluation jobs

AI-DO is brought to you by:

AI-DO 2 - Robotarium

These are the real robot evaluations.

Challenge LF πŸš— - Lane following (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑
11Bea Baselines3549Running the real lane following -- without challenge container4.387516
22JBRRussia3774Offset-based One4.09530
38awoo4243637HKDUCK1.75510
49seb37451.7554
510jp188131004943653Second test - TH-jp1.7554
614Victor Adolfo Romero Cano35931.173
718enicky36250.58532
819riza.velioglu36050.58514
923almasip3540My solution using reinforcement learning0.5852
1027YIPTSZFUNG377702

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (robotarium 🏎, validation πŸ‹)

This challenge is OPEN for submissions.

No entries to display.

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑
11Bea Baselines3552Running the real lane following -- without challenge container3.5118
22enicky36281.46253
34almasip3543My solution using reinforcement learning0.87753
45jp188131004943741LF sim test - wh0.5858
56JBRRussia3769Boxed Solution 0.30.5856
614seb37480.5852
715Victor Adolfo Romero Cano35960.5852
817riza.velioglu36080.29257

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (robotarium 🏎, validation πŸ‹)

This challenge is OPEN for submissions.

No entries to display.

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (robotarium 🏎, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑
11JBRRussia3767Boxed Solution 0.22.92530
22enicky36312.04754
33Bea Baselines3511challenge-aido_LF-template-pytorch1.75528
48jp188131004943743LF sim test - wh1.7556
510Victor Adolfo Romero Cano35991.46253
611seb37511.172
715almasip3582My solution using reinforcement learning0.29253
816riza.velioglu3611040

See also the extended leaderboard.

AI-DO 2 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories

Challenge definition challenge-aido_LF
Submission templates
Agent template- challenge-aido_LF-template-random
Pytorch templatePyTorch challenge-aido_LF-template-pytorch
Tensorflow templateTensorflow challenge-aido_LF-template-tensorflow
ROS templateROS challenge-aido_LF-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido_LF-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido_LF-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido_LF-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido_LF-baseline-duckietown

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
1850zamatory2640challenge-aido_LF-template-ros - Template solution using ROS0.6240.121
1953Bnaich2990challenge-aido_LF-template-tensorflow0.6240.150.2
2057vguerra2402Baseline solution using reinforcement learning0.6220.070.2
2162DavidShalom3193Baseline solution using reinforcement learning0.6220.10
2265Eric Lu3486Testing the RL solution0160.457.8

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11MYF3131test3.72160.651.4
23jp188131004943281Second test - TH3.72160.771
316JBRRussia3338JetBrains Research3.1161.080
419Bea Baselines3503Baseline-IL-logs-tensorflow3.1161.181.4
520RamiNaim3126[0.27;0.75]3.1161.190
623ioart3239SSegm3.1161.231.8
735almasip3114Baseline solution using reinforcement learning2.48160.950
849ierosodin3669Baseline solution using reinforcement learning1.86161.312
954awoo4243634Baseline-IL-logs-tensorflow1.86140.550
10100Andy Ser3153challenge-aido_LF-baseline-duckietown1.24100.490.4

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
12MYF3681test2.48160.490
23JBRRussia3449JetBrains Research1.24160.710
34RamiNaim2680challenge-aido_LF-baseline-duckietown1.24160.912
45Konstantin Chayka2694challenge-aido_LF-baseline-duckietown1.24120.720.8
57enicky36290.6260.181.6
69AlexKaravaev2860challenge-aido_LF-baseline-duckietown0.6260.210.2
710seb37490.6240.10.8
811Victor Adolfo Romero Cano35970.6240.10.8
912AmaurX3367challenge-aido_LF-template-random0.6240.10.8
1022zamatory2644challenge-aido_LF-template-ros - Template solution using ROS0.6240.121

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11MYF3650test3.1160.610
23jp188131004943401RL-TH-shi3.1160.871
35almasip3541My solution using reinforcement learning3.1160.951
46JBRRussia3344JetBrains Research3.1161.010
522RamiNaim2708challenge-aido_LF-baseline-duckietown1.24161.032.2
625Konstantin Chayka2695challenge-aido_LF-baseline-duckietown1.24100.540.4
731enicky3624Baseline solution using reinforcement learning1.2440.10.6
838AlexKaravaev2861challenge-aido_LF-baseline-duckietown0.6280.210.6
941seb37500.6240.120.6
1042Victor Adolfo Romero Cano35980.6240.120.6

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11MYF3677test2.48160.630
22seb37521.2440.150.6
33Victor Adolfo Romero Cano36001.2440.150.6
44AmaurX3371challenge-aido_LF-template-random1.2440.150.6
513AlexKaravaev2864challenge-aido_LF-baseline-duckietown0.62100.290.8
615zamatory2660challenge-aido_LF-baseline-duckietown0.6260.420.4
718Konstantin Chayka2612challenge-aido_LF-template-ros - Template solution using ROS0.6240.121
820enicky36320.6240.160.6
922vguerra2406Baseline solution using reinforcement learning0.6220.060.2
1024JBRRussia3451JetBrains Research0.6220.090

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11jp188131004943222First test - TH4.34160.734.8
23almasip3580My solution using reinforcement learning3.72160.831
35MYF3673test3.1160.720
411enicky36331.8680.293.6
514zamatory2661challenge-aido_LF-baseline-duckietown1.24160.780.6
616Konstantin Chayka2699challenge-aido_LF-baseline-duckietown1.24160.971.4
721JBRRussia3346JetBrains Research1.24100.580
822awoo4243103HKU Duckietown Project0.62160.485
924riza.velioglu36130.62100.143.8
1028RamiNaim2685challenge-aido_LF-baseline-duckietown0.6260.360.4

See also the extended leaderboard.

AI-DO 2 offseason - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories

Challenge definition challenge-aido_LF
Submission templates
Agent template- challenge-aido_LF-template-random
Pytorch templatePyTorch challenge-aido_LF-template-pytorch
Tensorflow templateTensorflow challenge-aido_LF-template-tensorflow
ROS templateROS challenge-aido_LF-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido_LF-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido_LF-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido_LF-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido_LF-baseline-duckietown

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11AmaurX3809Let's do this one today0.6240.110.6
22felipecer133783challenge-aido_LF-template-random0.6240.110.6

See also the extended leaderboard.

Challenge LF πŸš— - Lane following (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11chuyj3803Baseline solution using reinforcement learning1.8640.20.8
29AmaurX3810Let's do this one today0.6240.140.4
310felipecer133784challenge-aido_LF-template-random0.6240.140.4
411riza.velioglu3779Baseline-IL-logs-tensorflow0.6240.161
515Eric Lu3823Student A043022-0.62160.765.6

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11AmaurX3811Let's do this one today0.6240.10.8
22felipecer133785challenge-aido_LF-template-random0.6240.10.8

See also the extended leaderboard.

Challenge LFV πŸš—πŸš— - Lane following + Vehicles (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11AmaurX3812Let's do this one today0.6240.120.6
22felipecer133786challenge-aido_LF-template-random0.6240.120.6

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, testing πŸ₯‡)

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11AmaurX3813Let's do this one today1.2440.150.6

See also the extended leaderboard.

Challenge LFVI πŸš—πŸš—πŸš¦ - Lane following + Vehicles + Intersections (simulation πŸ‘Ύ, validation πŸ‹)

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11AmaurX3814Let's do this one today0.6240.10.6
22felipecer133788challenge-aido_LF-template-random0.6240.10.6

See also the extended leaderboard.

AI-DO 2 offseason - Robotarium

These are the real robot evaluations.

AI-DO 2 - Autonomous Mobility on Demand

In these challenges, the participant must coordinate a fleet of robo-taxis in various cities environments.

Challenge AMOD 🀹 ‍- Efficiency

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelefficiency↑
11dcharrez2891Python template-61.64956
22ssviridov3106Python template-62.089393
310akleban3159Python template-64.797321

See also the extended leaderboard.

Challenge AMOD 🀹 - Fleet Size

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelfleet_size↑
11akleban3161Python template-1000000000
22ssviridov3110Baseline-1000000000

See also the extended leaderboard.

Challenge AMOD 🀹 - Service Quality

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelservice_quality↑
13akleban3160Python template-32.368986
24ssviridov3109Baseline-32.475822
39dcharrez2892Python template-32.803471

See also the extended leaderboard.

AI-DO 1 - Embodied tasks

In these challenges, the participants must guide a Duckiebot through the streets of Duckietown. The only input available is a camera.

Repositories
Challenge definition challenge-aido1_LF1
Submission templates
Agent template- challenge-aido1_LF1-template-random
Pytorch templatePyTorch challenge-aido1_LF1-template-pytorch
Tensorflow templateTensorflow challenge-aido1_LF1-template-tensorflow
ROS templateROS challenge-aido1_LF1-template-ros
Baseline solutions
Imitation learning from real logsTensorflow challenge-aido1_LF1-baseline-IL-logs-tensorflow
Imitation learning from simulationTensorflow challenge-aido1_LF1-baseline-IL-sim-tensorflow
Reinforcement learning from simulationPyTorch challenge-aido1_LF1-baseline-RL-sim-pytorch
Traditional Duckietown pipelineROS challenge-aido1_LF1-baseline-duckietown

Challenge LF - Lane following (rev. 3)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11WEIGAO1633First trial18.6180.580.2
231heyt0ny1579SAIC MOSCOW MML18.6180.870.4
337miksaz1859JetBrains Research18.6181.340.2
462Jon1744JP pipeline16.74181.051.8
574VincentMai1033ROS-based Lane Following14.88181.861.8
675Benjamin1063My ROS solution14.26180.910.6
780lavoiems819Baby Duke13.02180.892.2
890David1139Pytorch IL12.4181.491.4
9103orlando.m.bol@gmail.com455PyTorch DDPG template9.92181.381.4
10123placaille985Dolores' Awakening8.68100.590.8

See also the extended leaderboard.

Challenge LF - Lane following (rev. 4, more samples)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11heyt0ny2133Copy of #2: sub 1579 by heyt0ny (SAIC MOSCOW MML)19.22180.720
22WEIGAO2132Copy of #1: sub 1633 by WEIGAO (First trial)18.6180.60
34Benjamin2137Copy of #6: sub 1063 by Benjamin (My ROS solution)13.64181.431.2
45Jon2135Copy of #4: sub 1684 by Jon (JP pipeline)11.16120.770
56VincentMai2136Copy of #5: sub 1033 by VincentMai (ROS-based Lane Following)9.3100.982.2
67hvrigazov2142Copy of #11: sub 1552 by hvrigazov (Visteon perception team)5.58181.020.8
78trimcao2148Copy of #17: sub 1515 by trimcao (Tensorflow template)5.58100.380.2
89shandonguniversityInspur2145Copy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)5.58100.380.2
910melorian2149Copy of #18: sub 1378 by melorian (Tensorflow template)5.58100.430.2
1011madelhorius2147Copy of #16: sub 1832 by madelhorius (Tensorflow template)5.58100.430.2

See also the extended leaderboard.

Challenge LFV - Lane following with vehicles (rev. 1)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
11heyt0ny1779SAIC MOSCOW MML1.24180.260
22WEIGAO2051Panasonic R&D Center Singapore & NUS0.62180.250.4
317pravishsainath1998Copy of #21: sub 1085 by pravishsainath (PyTorch DDPG template)0.62180.458.4
418sodabeta1997Copy of #20: sub 903 by sodabeta (PyTorch DDPG template)0.62180.458.4
519Sashkasem2028Copy of #51: sub 428 by Sashkasem (Random execution)0.62180.640
620anna.tsalapova2027Copy of #50: sub 396 by anna.tsalapova (simple submition)0.62180.640
721David1893Pytorch IL0.62180.643.2
822orlando.m.bol@gmail.com1987Copy of #9: sub 436 by orlando.m.bol@gmail.com (PyTorch DDPG template)0.62181.11.8
923gunshi1999Copy of #22: sub 1268 by gunshi (ROS-based Lane Following)0.62182.090
1024Benjamin1984Copy of #6: sub 1063 by Benjamin (My ROS solution)0.62182.230

See also the extended leaderboard.

Challenge LFV - Lane following with vehicles (rev. 2 - dynamic, 20 samples)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelTraveled distance↑Survival time↑Lateral deviation ↓Major infractions ↓
4950yun chen2103Copy of #30: sub 690 by yun chen (Random execution)0.6220.080.8
5051melorian2091Copy of #18: sub 1378 by melorian (Tensorflow template)0.6220.090
5152madelhorius2089Copy of #16: sub 1832 by madelhorius (Tensorflow template)0.6220.090
5253yangzm112088Copy of #15: sub 1491 by yangzm11 (Tensorflow template)0.6220.090
5354shandonguniversityInspur2087Copy of #14: sub 1482 by shandonguniversityInspur (Inspur CNN)0.6220.090
5455Allen Ou2085Copy of #12: sub 590 by Allen Ou (Tensorflow template)0.6220.090
5556orlando.m.bol@gmail.com2082Copy of #9: sub 436 by orlando.m.bol@gmail.com (PyTorch DDPG template)0.6220.090.4
5657happyduckie2104Copy of #31: sub 419 by happyduckie (PyTorch template)0.6220.090.8
5758hvrigazov2084Copy of #11: sub 1552 by hvrigazov (Visteon perception team)0.6220.110.6
5859jasonlcl2131Copy of #58: sub 956 by jasonlcl (PyTorch template)-2.48180.48.4

See also the extended leaderboard.

AI-DO 1 - AMoD

In these challenges, the participant must coordinate a fleet of robo-taxis in various cities environments.

Challenge [AIDO 1] AMOD - Efficiency (rev. 1)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelefficiency↑
11lic1883super fishy-11.88762
29JoelGaechter1696greedy but not so lazy-34.87095
318rumpelstilzchen1663Simsalabim-64.327313

See also the extended leaderboard.

Challenge [AIDO 1] AMOD - Fleet Size (rev. 1)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelfleet_size↑
11lic1880fishy-1000000000
23JoelGaechter1698greedy but not so lazy-1000000000
34rumpelstilzchen1673Simsalabim 2-1000000000

See also the extended leaderboard.

Challenge [AIDO 1] AMOD - Service Quality (rev. 1)

This challenge is CLOSED for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelservice_quality↑
16lic1885inaccessible code but it scores better than without-20.224397
210JoelGaechter1697greedy but not so lazy-20.554737
321lsieber1735Simple FIFO-21.992748
425mpicquet1784Python template-30.489252
531rumpelstilzchen1655Mein zweiter Zauberspruch-32.207862
635ossamaAhmed1770Python template-32.582267
745zgxsin1769Python template-33.656357

See also the extended leaderboard.

Test challenges

These are the test challenges.

Challenge [Test] Multi-step evaluation with IPFS

This is a testing challenge. The scores are visible, but not the full output.

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelpassed-step1↑passed-step2↑
not competing1Andrea Censi3375Solution template11

See also the extended leaderboard.

Challenge [Test] Multi-step evaluation

This is a testing challenge. The scores are visible, but not the full output.

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelpassed-step1↑passed-step2↑
not competing1Andrea Censi3374Solution template11
not competing2Andrea Censi3360Solution template11
not competing3Andrea Censi3358Solution template11

See also the extended leaderboard.

Challenge Simple prediction

This is a testing challenge. The scores are visible, but not the full output.

This challenge is OPEN for submissions.

Rank (comp)Rank (tech)UserSubmissionUser labelL1 error ↓L2 error ↓
11Victor Adolfo Romero Cano3592PredictorLast0.10.02
22Michael Su3254PredictorLast0.10.02
33Brian Chuang 3246PredictorLast0.10.02
44johnshen10093245PredictorLast0.10.02
56Masa2895PredictorLast0.10.02
67stoplight3255PredictorLast0.110.02
78WolfChen3250PredictorLast0.110.02
89Jerry3228PredictorLast0.110.02
912rulee19983180PredictorLast0.110.02
1015Ian3175PredictorLast0.110.02

See also the extended leaderboard.

Other

These are all other challenges