Automated 3D computer vision model offers a new tool to measure and understand dairy cow behavior and welfare

Led by Niclas Högberg, DVM, and Adrien Kroese, Eng, Department of Clinical Sciences, Faculty of Veterinary Medicine and Animal Science, Swedish University of Agricultural Sciences, Uppsala, Sweden, the study aimed to develop a reliable method for monitoring the ease with which cows can get up and down in their cubicles, a crucial indicator of overall comfort and well-being.

Adrien Kroese explained, "Evidence points to a clear link between restricted movement for cows and signs of reduced welfare, so it is common to have some kind of observation practice in place to catch signs of movement struggles."

Traditional methods -- which often rely on human observation -- can be subjective, sporadic, and time-consuming.

Considering the need for more consistent methods, the study team proposed a novel framework for detecting cow movements, specifically to understand how to measure lying-to-standing transitions from 3D pose estimation data compared with the human eye.

The team employed a 24-hour setup of seven cameras recording a herd of Swedish Holstein and Swedish Red cows. This footage was then used with 3D pose estimation software, which tracks and records movements via a 2D object detector and pose estimator. These datapoints are then fed into convolutional neural networks to detect cow movements in comparison to specific anatomical landmarks on static images from the footage. The result is a 3D map of cows' movement in their stalls and a selection of which movements indicate the transition to standing.

Kroese explained, "We then compared the standing data gathered by the software against timestamps in the video annotated by three human observers, which is considered the gold standard for behavioral observations."

How did the 3D data model hold up in comparison to the human eye? Kroese said, "The framework was able to detect when a cow was transitioning from lying to standing with the same accuracy as humans. The sensitivity of the detection was over 88%."

Notably, the results also indicate that the model introduced no more bias compared with human observers.

Although not without limitations, the study's findings demonstrate the potential of 3D pose estimation to provide objective and reliable data on cow behavior. Kroese noted, "This technology represents an exciting advancement in our ability to study and monitor animal behavior and welfare. By automatically and accurately detecting posture transitions, we can gain valuable insights into the comfort and well-being of dairy cows."

The model offers potential to help researchers scale up the study of dairy cow behavior and motion patterns and opens the door to the development of new assessment tools for farmers to make informed decisions about their herds.