NON-INVASIVE REAL-TIME ESTRUS DETECTION IN DAIRY COWS WITH VIDEO PROCESSING TECHNIQUES BASED ON CONVOLUTIONAL NEURAL NETWORKS

Authors

  • Watchara Ninphet Faculty of Industrial Technology, Muban Chom Bueng Rajabhat University
  • Phayung Meesad Faculty of Information Technology and Digital Innovation, King Mongkut’s University of Technology North Bangkok
  • Noppadol Amdee Faculty of Industrial Technology, Muban Chom Bueng Rajabhat University
  • Adisak Sangsongfa Faculty of Industrial Technology, Muban Chom Bueng Rajabhat University

DOI:

https://doi.org/10.14456/lsej.2024.28

Keywords:

estrus, dairy cows, video processing, convolutional neural networks

Abstract

Estrus detection in dairy cows is a crucial factor in enhancing breeding efficiency and achieving sustainable milk production in the dairy farming industry. This research aims to develop an algorithm and evaluate the performance of a real-time estrus detection model for dairy cows without the use of wearable devices. The model utilizes video processing techniques based on evolutionary neural networks. Estrus behaviors in Holstein Friesian cows with at least 75% Holstein bloodline, with a sample size of at least 10 cows, were detected across four behaviors: walking, flirting (sniffing or licking), mating (mounting), and head mounting (playful or incorrect mounting). A total of 1,520 images, with 380 images per behavior, were used. The dataset was augmented using various image augmentation techniques, increasing the dataset size by 22.238 times, resulting in a total of 33,802 images. The estrus detection model was developed using the YOLOv7 evolutionary neural network. The batch size was set at 16, with 30 epochs, and images were resized to 640x640 pixels. The results indicated that YOLOv7 effectively detected estrus behaviors with an average F1-Score of 1.00, Precision of 1.00, Recall of 1.00, mAP@0.5 of 0.996, and mAP@0.5:.95 of 0.845. These results demonstrate that the model is suitable for practical application in dairy farming, providing an alternative to human labor for estrus detection in cows.

References

Aradhya AS, Patil AS, Rao KP, Monika M, Shireesha V. COWOZE: An Automated Estrus Detection System. International Journal of Creative Research Thoughts 2023;11(4):492-496.

Arago NM, Alvarez CI, Mabale AG, Legista CG, Repiso NE, Robles RRA, Amado TM. Automated estrus detection for dairy cattle through neural networks and bounding box corner analysis. International Journal of Advanced Computer Science and Applications 2020;11(9):303-311.

Arıkan İ, Ayav T, Seçkin AÇ, Soygazi F. Estrus Detection and dairy cow identification with cascade deep learning for augmented reality-ready livestock farming. Sensors. 2023;23(24):9795.

Aydin M, Risvanli A, Timurkan H, Kaygusuzoglu E. Lack of correlation between the electrical conductivity of milk and the blood progesterone levels in cows. Journal of the South African Veterinary Association 2008;79(3):153-154.

Benaissa S, Tuyttens FAM, Plets D, Martens L, Vandaele L, Joseph W, Sonck B. Improved cattle behaviour monitoring by combining Ultra-Wideband location and accelerometer data. Animal 2023;17(4):100730.

Chowdhury S, Verma B, Roberts J, Corbet N, Swain D. Deep learning based computer vision technique for automatic heat detection in cows. In: 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA);2016:1-6.

Higaki S, Horihata K, Suzuki C, Sakurai R, Suda T, Yoshioka K. Estrus detection using background image subtraction technique in tie-stalled cows. Animals 2021;11(6):1795.

Higaki S, Okada H, Suzuki C, Sakurai R, Suda T, Yoshioka K. Estrus detection in tie-stall housed cows through supervised machine learning using a multimodal tail-attached device. Computers and Electronics in Agriculture 2021;191:106513.

Homer EM, Gao Y, Meng X, Dodson A, Webb R, Garnsworthy PC. Technical note: A novel approach to the detection of estrus in dairy cows using ultra-wideband technology. Journal of Dairy Science 2013;96(10):6529-6534.

Jónsson R, Blanke M, Poulsen NK, Caponetti F, Højsgaard S. Oestrus detection in dairy cows from activity and lying data using on-line individual models. Computers and Electronics in Agriculture. 2011;76(1):6-15.

Li D, Wang JH, Zhang Z, Dai BS, Zhao KX, Shen WZ, et al. Cow-YOLO: Automatic cow mounting detection based on non-local CSPDarknet53 and multiscale neck. International Journal of Agricultural and Biological Engineering 2024;17(3):193-202.

MacKay JRD, Deag JM, Haskell MJ. Establishing the extent of behavioural reactions in dairy cattle to a leg mounted activity monitor. Applied Animal Behaviour Science 2012;139(1-2):35-41.

Marangoni F, Pellegrino L, Verduci E, Ghiselli A, Bernabei R, Calvani R, Cetin I, Giampietro M, et al. Cow’s Milk Consumption and Health: A Health Professional’s Guide. Journal of the American College of Nutrition 2018;38(3):197-208.

Morera Á, Sánchez Á, Moreno AB, Sappa ÁD, Vélez JF. SSD vs. YOLO for Detection of Outdoor Urban Advertising Panels under Multiple Variabilities. Sensors 2020;20(16):4587.

Ninphet W, Amdee N, Sangsongfa A. Adaptive deep learning for image-based estrus prediction and detection in Dairy Cows. PriMera Scientific Engineering 2024;5(2):12-37.

Ninphet W, Amm-Dee N, Sangsongfa A. Prediction cows estrus images using convolutional neural network with optimized parameters by the artificial immune system algorithm. In: Proceedings of the 20th International Conference on Computing and Information Technology (IC2IT 2024). Springer Link. 2024;973:105-120.

Office of Agricultural Economics Research. Situation of important agricultural products and trends in 2024. Dairy. Office of Agricultural Economics. Published Dec, 2023. Available at: https://www.oae.go.th/assets/portals/1/files/jounal/2566/trend2567.pdf. Accessed August 20, 2024.

Palmer MA, Olmos G, Boyle LA, Mee JF. Estrus detection and estrus characteristics in housed and pastured Holstein–Friesian cows. Theriogenology 2010;74(2):255-264.

Pratelli G, Tamburini B, Badami GD, Lo Pizzo M, De Blasio A, Carlisi D, Di Liberto D. Cow’s Milk: A Benefit for Human Health? Omics Tools and Precision Nutrition for Lactose Intolerance Management. Nutrients 2024;16(2):320.

Reith S, Hoy S. Relationship between daily rumination time and estrus of dairy cows. Journal of Dairy Science 2012;95(11):6416-6420.

Roelofs JB, van Eerdenburg FJCM, Soede NM, Kemp B. Pedometer readings for estrous detection and as predictor for time of ovulation in dairy cattle. Theriogenology 2005;64(8):1690-1703.

Royal MD, Darwash AO, Flint APF, Webb R, Woolliams JA, Lamming GE. Declining fertility in dairy cattle: changes in traditional and endocrine parameters of fertility. Animal Science. 2000;70(3):487-501.

Saint-Dizier M, Chastant-Maillard S. Potential of connected devices to optimize cattle reproduction. Theriogenology 2018;112:53-62.

Senger PL. The estrus detection problem: New concepts, technologies, and possibilities. Journal of Dairy Science 1994;77(9):2745-2753.

Stangaferro ML, Wijma R, Caixeta LS, Al-Abri MA, Giordano JO. Use of rumination and activity monitoring for the identification of dairy cows with health disorders: Part I. Metabolic and digestive disorders. Journal of Dairy Science 2016;99(9):7395-7410.

Wang CY, Bochkovskiy A, Liao HY. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2023. p. 7464-7474. Available from: https://openaccess.thecvf.com/ content/CVPR2023/papers/Wang_YOLOv7_Trainable_Bag-of-Freebies_Sets_New_State-of-the-Art_for_Real-Time_Object_Detectors_CVPR_2023_paper.pdf

Wang J, Chen H, Wang J, Zhao K, Li X, Liu B, Zhou Y. Identification of oestrus cows based on vocalisation characteristics and machine learning technique using a dual-channel-equipped acoustic tag. Animal 2023;17(6):100811.

Wang Z, Wang S, Wang C, Zhang Y, Zong Z, Wang H, Su L, et al. A Non-Contact Cow Estrus Monitoring Method Based on the Thermal Infrared Images of Cows. Agriculture 2023;13(2):385.

Downloads

Published

2024-11-12

How to Cite

Ninphet, W., Meesad, P., Amdee, N., & Sangsongfa, A. (2024). NON-INVASIVE REAL-TIME ESTRUS DETECTION IN DAIRY COWS WITH VIDEO PROCESSING TECHNIQUES BASED ON CONVOLUTIONAL NEURAL NETWORKS. Life Sciences and Environment Journal, 25(2), 360–379. https://doi.org/10.14456/lsej.2024.28

Issue

Section

Research Articles