The first Animal-AI competition ran in 2019.Only limited information was provided about the tests involved (category names and brief descriptions). Entrants could test their agents on a representative testbed of 300 problems, but could only see there scores per category as feedback (as in the table below).
Team | Total | 1. Food | 2. Preferences | 3. Obstacles | 4. Avoidance | 5. Spatial Reasoning | 6. Generalisation | 7. Internal Models | 8. Object Permanence | 9. Numerosity | 10. Causal Reasoning |
---|---|---|---|---|---|---|---|---|---|---|---|
Trrrrr | 43.7 | 87.8 | 72.2 | 30.0 | 44.4 | 42.2 | 54.4 | 57.8 | 10.0 | 32.2 | 5.6 |
ironbar | 43.6 | 87.8 | 63.3 | 40.0 | 48.9 | 40.0 | 34.4 | 51.1 | 25.6 | 43.3 | 1.1 |
sirius | 38.7 | 92.2 | 66.7 | 23.3 | 26.7 | 34.4 | 36.7 | 50.0 | 6.7 | 48.9 | 1.1 |
BronzeBlood | 35.4 | 73.3 | 81.1 | 17.8 | 21.1 | 30.0 | 40.0 | 38.9 | 2.2 | 50.0 | 0.0 |
Oltau.ai | 35.0 | 71.1 | 73.3 | 21.1 | 24.4 | 24.4 | 33.3 | 46.7 | 5.6 | 50.0 | 0.0 |
sungbinchoi | 34.3 | 84.4 | 56.7 | 23.3 | 27.8 | 31.1 | 42.2 | 28.9 | 1.1 | 36.7 | 11.1 |
DeepFox | 33.2 | 82.2 | 45.6 | 24.4 | 34.4 | 24.4 | 27.8 | 45.6 | 12.2 | 34.4 | 1.1 |
ARF-RL | 32.7 | 81.1 | 52.2 | 14.4 | 31.1 | 25.6 | 27.8 | 44.4 | 10.0 | 40.0 | 0.0 |
UniboTeam | 32.6 | 73.3 | 75.6 | 13.3 | 21.1 | 23.3 | 32.2 | 36.7 | 8.9 | 40.0 | 1.1 |
Juramaia | 32.0 | 84.4 | 71.1 | 12.2 | 31.1 | 13.3 | 33.3 | 30.0 | 10.0 | 32.2 | 2.2 |
cso | 31.1 | 82.2 | 57.8 | 23.3 | 26.7 | 24.4 | 32.2 | 23.3 | 5.6 | 35.6 | 0.0 |
mmIA | 29.6 | 75.6 | 57.8 | 12.2 | 24.4 | 21.1 | 34.4 | 43.3 | 3.3 | 22.2 | 1.1 |
Gyutan | 28.0 | 67.8 | 42.2 | 24.4 | 28.9 | 24.4 | 25.6 | 37.8 | 4.4 | 23.3 | 1.1 |
winter2109 | 27.1 | 83.3 | 35.6 | 16.7 | 28.9 | 14.4 | 33.3 | 33.3 | 6.7 | 18.9 | 0.0 |
forest | 26.8 | 66.7 | 63.3 | 18.9 | 16.7 | 17.8 | 41.1 | 12.2 | 0.0 | 30.0 | 1.1 |
CUMIN | 25.2 | 71.1 | 55.6 | 5.6 | 18.9 | 12.2 | 26.7 | 15.6 | 3.3 | 43.3 | 0.0 |
Qodiak | 24.1 | 64.4 | 41.1 | 16.7 | 30.0 | 16.7 | 20.0 | 28.9 | 0.0 | 23.3 | 0.0 |
inf mnky | 23.1 | 51.1 | 50.0 | 21.1 | 23.3 | 17.8 | 7.8 | 46.7 | 8.9 | 4.4 | 0.0 |
y.yang | 22.9 | 63.3 | 71.1 | 1.1 | 27.8 | 10.0 | 21.1 | 11.1 | 4.4 | 18.9 | 0.0 |
BABL AI | 22.9 | 58.9 | 53.3 | 6.7 | 16.7 | 13.3 | 14.4 | 32.2 | 6.7 | 24.4 | 2.2 |
aAI-challenge | 22.4 | 54.4 | 40.0 | 22.2 | 16.7 | 11.1 | 32.2 | 26.7 | 5.6 | 13.3 | 2.2 |
GoGoAI | 21.6 | 54.4 | 57.8 | 3.3 | 22.2 | 12.2 | 33.3 | 20.0 | 0.0 | 12.2 | 0.0 |
Bonum | 21.3 | 62.2 | 36.7 | 21.1 | 12.2 | 11.1 | 8.9 | 43.3 | 4.4 | 12.2 | 1.1 |
doot | 19.6 | 57.8 | 43.3 | 11.1 | 15.6 | 12.2 | 11.1 | 34.4 | 2.2 | 7.8 | 0.0 |
KMU-AIL | 19.0 | 47.8 | 55.6 | 8.9 | 17.8 | 13.3 | 10.0 | 28.9 | 4.4 | 3.3 | 0.0 |
BLAI | 18.9 | 43.3 | 43.3 | 17.8 | 14.4 | 11.1 | 23.3 | 35.6 | 0.0 | 0.0 | 0.0 |
CHROMA | 17.6 | 61.1 | 51.1 | 2.2 | 6.7 | 1.1 | 8.9 | 24.4 | 0.0 | 20.0 | 0.0 |
jinrohs | 17.4 | 37.8 | 36.7 | 14.4 | 13.3 | 8.9 | 6.7 | 36.7 | 3.3 | 6.7 | 10.0 |
(taef)Penn | 16.6 | 34.4 | 46.7 | 10.0 | 5.6 | 3.3 | 13.3 | 28.9 | 5.6 | 17.8 | 0.0 |
AirbrainNM | 15.8 | 52.2 | 42.2 | 2.2 | 10.0 | 4.4 | 21.1 | 2.2 | 4.4 | 16.7 | 2.2 |
Koozyt | 15.1 | 31.1 | 34.4 | 13.3 | 7.8 | 7.8 | 12.2 | 12.2 | 11.1 | 21.1 | 0.0 |
Horsepower | 15.1 | 57.8 | 37.8 | 8.9 | 5.6 | 4.4 | 7.8 | 22.2 | 1.1 | 5.6 | 0.0 |
INAOE1 | 14.9 | 67.8 | 65.6 | 3.3 | 12.2 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
41Animals | 14.4 | 56.7 | 30.0 | 1.1 | 17.8 | 1.1 | 7.8 | 26.7 | 0.0 | 3.3 | 0.0 |
daydayup | 14.3 | 38.9 | 44.4 | 17.8 | 8.9 | 2.2 | 15.6 | 11.1 | 3.3 | 1.1 | 0.0 |
Redstone | 13.9 | 40.0 | 31.1 | 3.3 | 13.3 | 2.2 | 17.8 | 25.6 | 4.4 | 1.1 | 0.0 |
Juohmaru | 13.0 | 37.8 | 34.4 | 13.3 | 11.1 | 4.4 | 6.7 | 14.4 | 5.6 | 2.2 | 0.0 |
ocorcoll-AI | 12.3 | 27.8 | 23.3 | 8.9 | 10.0 | 2.2 | 13.3 | 12.2 | 7.8 | 17.8 | 0.0 |
Thursday | 11.8 | 25.6 | 27.8 | 8.9 | 6.7 | 7.8 | 16.7 | 15.6 | 3.3 | 5.6 | 0.0 |
Araya | 11.7 | 36.7 | 42.2 | 1.1 | 14.4 | 0.0 | 10.0 | 7.8 | 1.1 | 2.2 | 1.1 |
fep-bot | 10.0 | 31.1 | 37.8 | 2.2 | 11.1 | 2.2 | 10.0 | 2.2 | 1.1 | 2.2 | 0.0 |
ahorizon | 9.8 | 17.8 | 23.3 | 5.6 | 7.8 | 6.7 | 5.6 | 11.1 | 12.2 | 7.8 | 0.0 |
aSphericalChicken | 9.6 | 20.0 | 32.2 | 7.8 | 12.2 | 1.1 | 11.1 | 5.6 | 4.4 | 1.1 | 0.0 |
hhq126152 | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
Yossy | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
loneWolf | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
bird | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
ACCESS | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
NARUTO | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
vithng | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
MadStorks | 9.4 | 22.2 | 23.3 | 5.6 | 8.9 | 2.2 | 8.9 | 22.2 | 1.1 | 0.0 | 0.0 |
Optimize Prime | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
bamasa_team | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
Yuko Ishizaki | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
dhr | 9.4 | 21.1 | 35.6 | 4.4 | 12.2 | 1.1 | 8.9 | 10.0 | 1.1 | 0.0 | 0.0 |
sparklemotion | 9.1 | 27.8 | 13.3 | 4.4 | 6.7 | 6.7 | 15.6 | 6.7 | 4.4 | 5.6 | 0.0 |
cocel | 8.6 | 36.7 | 30.0 | 1.1 | 3.3 | 1.1 | 1.1 | 8.9 | 3.3 | 0.0 | 0.0 |
Tetravoxel | 8.3 | 20.0 | 22.2 | 4.4 | 2.2 | 4.4 | 13.3 | 13.3 | 2.2 | 1.1 | 0.0 |
Octopus | 6.8 | 17.8 | 21.1 | 3.3 | 2.2 | 1.1 | 10.0 | 4.4 | 6.7 | 1.1 | 0.0 |
Animal AI Team | 1.7 | 7.8 | 6.7 | 2.2 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
Nishi-Hashi | 1.0 | 5.6 | 2.2 | 0.0 | 2.2 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
ice-play | 0.3 | 3.3 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |