Biologists often study large numbers of animals to collect data on collective and individual behaviour. New machine learning tools promise to help scientists process the huge amount of data this work generates more quickly while lessening workload.
Now, a new tool called replicAnt simplifies and streamlines the way the training images for these machine learning tools are created, making it quicker and easier to record observations about lots of animals at once, starting with insects.
Animal database
Existing AI-enabled tools for this purpose require users to painstakingly hand annotate hundreds of frames to provide a database for the computer to learn from. To combat this, replicAnt automatically creates thousands of annotated images with the click of a mouse, seamlessly incorporating variations in species and environments. Ultimately, these AI-generated data may increase the speed and robustness of using AI tools in animal research.The work is published in Nature Communications .
Lead author Fabian Plum, PhD researcher at Imperial College London’s Department of Bioengineering , said: "It takes a lot of time to set up studies on large numbers of animals, and to learn how to use new tools. replicAnt lowers the entry barrier for biologists to use machine learning to optimise their work."
"Understanding animal behaviour, particularly as our climate changes, is crucial. We hope our tool can help to make the time-intensive process of collecting crucial data easier and faster." Fabian Plum First To demonstrate the utility of replicAnt, the researchers trained neural networks - sets of algorithms that recognise underlying relationships in data - on these images. This allowed the neural networks to recognise individuals and track their movements across different environments out-of-the-box. For others, the required hand-labelling of real
Fabian added: "Understanding animal behaviour, particularly as our climate changes, is crucial. We hope our tool can help to make the time-intensive process of collecting crucial data easier and faster."
Further applications might include using real-time movement data to inform character movement in film and video games.
" replicAnt: a pipeline for generating annotated images of animals in complex environments using Unreal Engine " by Plum et al., published 8 November 2023 in Nature Communications.
All image credits: Fabian Plum
