An AI technology to reveal the characteristics of animal behavior

An AI technology to reveal the characteristics of animal behavior only from the trajectory
AI analysis of movement. Conceptual drawing of 'AI analysis of movement.' Credit: Kotaro Kimura

Recording the movements of people and animals (including birds and insects) has become very easy because of the development of small and inexpensive GPS devices and video cameras. However, it is still difficult to infer what triggers such movements (for example, external stimuli and/or their mental processes) from the behavioral records.

In this study, Shuhei Yamazaki and colleagues have developed an (AI) technology, first, to estimate an animal's behavioral state, such as "resting," "feeding," or "traveling," without human classification, and, next, to explore the characteristics of each behavioral state by comparing responses under , such as before and after experiencing a certain stimulus.

This method, termed STEFTR (state estimation and feature extraction of animal behavior), enabled the researchers to estimate the behavioral states of roundworms and penguins that move approximately 1 cm in 10 min in a and several kilometers in 1 day or more in the Antarctic Ocean, respectively, by analyzing them in exactly the same way. Notably, they achieved > 90% accuracy using only tens of animal trajectories, although traditionally researchers used prior knowledge of specialists about the animal's movement and/or millions of video images of animal behavior to train AI.

In the feature extraction, Yamazaki et al. revealed experience-dependent (i.e., learning-dependent) changes in specific behavioral aspects in worms and bats, and sexual pheromone-dependent changes in fruit flies. Moreover, they revealed changes in nerve activity that is linked to behavioral change in worms.

In conclusion, the STEFTR method may make it easy to infer "important places" for animal behavior, such as nests and feeding places that are usually difficult to find, using only trajectory data of wild animals. In addition, it may help discover important brain activities related to animal behavior, thereby contributing to the progress of basic brain science.

An AI technology to reveal the characteristics of animal behavior only from the trajectory
Workflow of the STEFTR method. Trajectory data of animals are used to calculate eight basic behavioral features, and are analyzed to estimate behavioral states (upper panels). From a behavioral state, behavioral features are comprehensively evaluated (lower panels). Credit: © Kotaro Kimura

More information: Shuhei J. Yamazaki et al, STEFTR: A Hybrid Versatile Method for State Estimation and Feature Extraction From the Trajectory of Animal Behavior, Frontiers in Neuroscience (2019). DOI: 10.3389/fnins.2019.00626

Journal information: Frontiers in Neuroscience

Provided by Osaka University
Citation: An AI technology to reveal the characteristics of animal behavior (2019, July 16) retrieved 2 February 2023 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

New study reveals the cause of sensory changes in starved state


Feedback to editors