The Animal-AI Olympics 2019

The first Animal-AI competition ran in 2019.Only limited information was provided about the tests involved (category names and brief descriptions). Entrants could test their agents on a representative testbed of 300 problems, but could only see there scores per category as feedback (as in the table below).

1st Place: Trrrrr

2nd Place: Ironbar

3rd Place: Sirius

Category Prizes:

  • Category 10: Sungbinchoi
  • Category 9: Oltau.ai
  • Category 8: DeepFox
  • Category 7: inf mnky
  • Category 6: Forest
  • Category 5: BronzeBlood
  • Category 4: Arf-RL
  • Category 3: Gyutan
  • Category 2: UniboTeam
  • Category 1: Juramaia

Animal-AI Final Results

Team Total 1. Food 2. Preferences 3. Obstacles 4. Avoidance 5. Spatial Reasoning 6. Generalisation 7. Internal Models 8. Object Permanence 9. Numerosity 10. Causal Reasoning
Trrrrr 43.7 87.8 72.2 30.0 44.4 42.2 54.4 57.8 10.0 32.2 5.6
ironbar 43.6 87.8 63.3 40.0 48.9 40.0 34.4 51.1 25.6 43.3 1.1
sirius 38.7 92.2 66.7 23.3 26.7 34.4 36.7 50.0 6.7 48.9 1.1
BronzeBlood 35.4 73.3 81.1 17.8 21.1 30.0 40.0 38.9 2.2 50.0 0.0
Oltau.ai 35.0 71.1 73.3 21.1 24.4 24.4 33.3 46.7 5.6 50.0 0.0
sungbinchoi 34.3 84.4 56.7 23.3 27.8 31.1 42.2 28.9 1.1 36.7 11.1
DeepFox 33.2 82.2 45.6 24.4 34.4 24.4 27.8 45.6 12.2 34.4 1.1
ARF-RL 32.7 81.1 52.2 14.4 31.1 25.6 27.8 44.4 10.0 40.0 0.0
UniboTeam 32.6 73.3 75.6 13.3 21.1 23.3 32.2 36.7 8.9 40.0 1.1
Juramaia 32.0 84.4 71.1 12.2 31.1 13.3 33.3 30.0 10.0 32.2 2.2
cso 31.1 82.2 57.8 23.3 26.7 24.4 32.2 23.3 5.6 35.6 0.0
mmIA 29.6 75.6 57.8 12.2 24.4 21.1 34.4 43.3 3.3 22.2 1.1
Gyutan 28.0 67.8 42.2 24.4 28.9 24.4 25.6 37.8 4.4 23.3 1.1
winter2109 27.1 83.3 35.6 16.7 28.9 14.4 33.3 33.3 6.7 18.9 0.0
forest 26.8 66.7 63.3 18.9 16.7 17.8 41.1 12.2 0.0 30.0 1.1
CUMIN 25.2 71.1 55.6 5.6 18.9 12.2 26.7 15.6 3.3 43.3 0.0
Qodiak 24.1 64.4 41.1 16.7 30.0 16.7 20.0 28.9 0.0 23.3 0.0
inf mnky 23.1 51.1 50.0 21.1 23.3 17.8 7.8 46.7 8.9 4.4 0.0
y.yang 22.9 63.3 71.1 1.1 27.8 10.0 21.1 11.1 4.4 18.9 0.0
BABL AI 22.9 58.9 53.3 6.7 16.7 13.3 14.4 32.2 6.7 24.4 2.2
aAI-challenge 22.4 54.4 40.0 22.2 16.7 11.1 32.2 26.7 5.6 13.3 2.2
GoGoAI 21.6 54.4 57.8 3.3 22.2 12.2 33.3 20.0 0.0 12.2 0.0
Bonum 21.3 62.2 36.7 21.1 12.2 11.1 8.9 43.3 4.4 12.2 1.1
doot 19.6 57.8 43.3 11.1 15.6 12.2 11.1 34.4 2.2 7.8 0.0
KMU-AIL 19.0 47.8 55.6 8.9 17.8 13.3 10.0 28.9 4.4 3.3 0.0
BLAI 18.9 43.3 43.3 17.8 14.4 11.1 23.3 35.6 0.0 0.0 0.0
CHROMA 17.6 61.1 51.1 2.2 6.7 1.1 8.9 24.4 0.0 20.0 0.0
jinrohs 17.4 37.8 36.7 14.4 13.3 8.9 6.7 36.7 3.3 6.7 10.0
(taef)Penn 16.6 34.4 46.7 10.0 5.6 3.3 13.3 28.9 5.6 17.8 0.0
AirbrainNM 15.8 52.2 42.2 2.2 10.0 4.4 21.1 2.2 4.4 16.7 2.2
Koozyt 15.1 31.1 34.4 13.3 7.8 7.8 12.2 12.2 11.1 21.1 0.0
Horsepower 15.1 57.8 37.8 8.9 5.6 4.4 7.8 22.2 1.1 5.6 0.0
INAOE1 14.9 67.8 65.6 3.3 12.2 0.0 0.0 0.0 0.0 0.0 0.0
41Animals 14.4 56.7 30.0 1.1 17.8 1.1 7.8 26.7 0.0 3.3 0.0
daydayup 14.3 38.9 44.4 17.8 8.9 2.2 15.6 11.1 3.3 1.1 0.0
Redstone 13.9 40.0 31.1 3.3 13.3 2.2 17.8 25.6 4.4 1.1 0.0
Juohmaru 13.0 37.8 34.4 13.3 11.1 4.4 6.7 14.4 5.6 2.2 0.0
ocorcoll-AI 12.3 27.8 23.3 8.9 10.0 2.2 13.3 12.2 7.8 17.8 0.0
Thursday 11.8 25.6 27.8 8.9 6.7 7.8 16.7 15.6 3.3 5.6 0.0
Araya 11.7 36.7 42.2 1.1 14.4 0.0 10.0 7.8 1.1 2.2 1.1
fep-bot 10.0 31.1 37.8 2.2 11.1 2.2 10.0 2.2 1.1 2.2 0.0
ahorizon 9.8 17.8 23.3 5.6 7.8 6.7 5.6 11.1 12.2 7.8 0.0
aSphericalChicken 9.6 20.0 32.2 7.8 12.2 1.1 11.1 5.6 4.4 1.1 0.0
hhq126152 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
Yossy 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
loneWolf 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
bird 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
ACCESS 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
NARUTO 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
vithng 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
MadStorks 9.4 22.2 23.3 5.6 8.9 2.2 8.9 22.2 1.1 0.0 0.0
Optimize Prime 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
bamasa_team 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
Yuko Ishizaki 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
dhr 9.4 21.1 35.6 4.4 12.2 1.1 8.9 10.0 1.1 0.0 0.0
sparklemotion 9.1 27.8 13.3 4.4 6.7 6.7 15.6 6.7 4.4 5.6 0.0
cocel 8.6 36.7 30.0 1.1 3.3 1.1 1.1 8.9 3.3 0.0 0.0
Tetravoxel 8.3 20.0 22.2 4.4 2.2 4.4 13.3 13.3 2.2 1.1 0.0
Octopus 6.8 17.8 21.1 3.3 2.2 1.1 10.0 4.4 6.7 1.1 0.0
Animal AI Team 1.7 7.8 6.7 2.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0
Nishi-Hashi 1.0 5.6 2.2 0.0 2.2 0.0 0.0 0.0 0.0 0.0 0.0
ice-play 0.3 3.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0