FallNeXt: A Deep Residual Model based on Multi-Branch Aggregation for Sensor-based Fall Detection
Article Sidebar
Main Article Content
Abstract
Falls are uncommon and pose a substantial health danger to adults and the elderly. These situations are a leading cause of severe injury. More harm could be averted if the faller could be located in time. The rising older population necessitates the rapid development of fall detection and prevention technologies. The burgeoning technology industry is focused on developing such technologies to improve the living conditions for the elderly in particular. A fall detection system monitors falls and provides an assistance notice to support mitigation of falls. This study proposes a sensor-based solution based on a deep learning network named FallNeXt to safeguard individual privacy and increase fall detection performance. This proposed network is a novel deep residual network that utilizes multi-branch aggregation to enhance fall detection capability. The detection effectiveness of this study was evaluated using three benchmark datasets for sensor-based fall detection: UpFall, SisFall, and UMAFall datasets. Compared to benchmark deep learning models on the three datasets, the experimental findings indicate that the proposed FallNeXt network scored the most significant overall accuracy and F1-score, with 96.16% and 99.12%, respectively. The benefit of the FallNeXt model's small but highly effective size for fall detection is its portability.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
W. H. Organization, World report on ageing and health. World Health Organization, 2015.
M. Mubashir, L. Shao, and L. Seed, “A survey on fall detection: principles and approaches,” Neurocomputing, vol. 100, pp. 144-152, 2013.
K. Chaccour, R. Darazi, A. H. El Hassani, and E. Andrès, “From fall detection to fall prevention: A generic classification of fall-related systems,” IEEE Sensors Journal, vol. 17, no. 3, pp. 812-822, 2017.
A. L. S. de Lima, L. J. W. Evers, T. Hahn, L. Bataille, J. L. Hamilton, M. A. Little, Y. Okuma, B. R. Bloem, and M. J. Faber, “Freezing of gait and fall detection in Parkinson’s disease using wearable sensors: a systematic review,” Journal of Neurology, vol. 264, pp. 1642-1654, 2017.
N. el Halabi, R. A. Z. Daou, R. Achkar, A. Hayek, and J. Börcsök, “Monitoring system for prediction and detection of epilepsy seizure,” in 2019 Fourth International Conference on Advances in Computational Tools for Engineering Applications (ACTEA), 2019, pp. 1-7.
A. S. Syed, D. Sierra-Sosa, A. Kumar, and A. Elmaghraby, “A deep convolutional neural network-xgb for direction and severity aware fall detection and activity recognition,” Sensors, vol. 22, no. 7, 2022.
S. Mekruksavanich, P. Jantawong, A. Charoenphol, and A. Jitpattanakul, “Fall detection from smart wearable sensors using deep convolutional neural network with squeeze-and-excitation module,” in 2021 25th International Computer Science and Engineering Conference (ICSEC), 2021, pp. 448-453.
J. Fleming, C. Brayne, and Cambridge collaboration, “Inability to get up after falling, subsequent time on floor, and summoning help: prospective cohort study in people over 90.,” The BMJ, vol. 337, 11 2008.
X. Wang, J. Ellul, and G. Azzopardi, “Elderly fall detection systems: A literature survey,” Frontiers in Robotics and AI, vol. 7, 2020.
X. Xi, M. Tang, S. M. Miran, and Z. Luo, “Evaluation of feature extraction and recognition for activity monitoring and fall detection based on wearable semg sensors,” Sensors, vol. 17, no. 6, 2017.
F. S. Butt, L. La Blunda, M. F. Wagner, J. Schäfer, I. Medina-Bulo, and D. Gómez-Ullate, “Fall detection from electrocardiogram (ecg) signals and classi_cation by deep transfer learning,” Information, vol. 12, no. 2, 2021.
M. Bosch-Jorge, A.-J. Sánchez-Salmerón, A. Valera, and C. Ricolfe-Viala, “Fall detection based on the gravity vector using a wide-angle camera,” Expert Syst. Appl., vol. 41, no. 17, pp.7980-7986, 2014.
S. C. Agrawal, R. K. Tripathi, and A. S. Jalal, “Human-fall detection from an indoor video surveillance,” in 2017 8th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 2017, pp. 1-5.
X. Kong, Z. Meng, L. Meng, and H. Tomiyama, “A privacy protected fall detection iot system for elderly persons using depth camera,” in 2018 International Conference on Advanced Mechatronic Systems (ICAMechS), 2018, pp. 31-35.
S. Mekruksavanich, A. Jitpattanakul, K. Sitthithakerngkiet, P. Youplao, and P. Yupapin, “Resnet-se: Channel attention-based deep residual network for complex activity recognition using wrist-worn wearable sensors,” IEEE Access, vol. 10, pp. 51142-51154, 2022.
K. M. Shahiduzzaman, X. Hei, C. Guo, and W. Cheng, “Enhancing fall detection for elderly with smart helmet in a cloud-network-edge architecture,” in 2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW), 2019, pp. 1-2.
S. A. Mousavi, F. heidari, E. Tahami, and M. Azarnoosh, “Fall detection system via smart phone and send people location,” in 2020 28th European Signal Processing Conference (EUSIPCO), 2021, pp. 1605-1607.
K. Desai, P. Mane, M. Dsilva, A. Zare, P. Shingala, and D. Ambawade, “A novel machine learning based wearable belt for fall detection,” in 2020 IEEE International Conference on Computing, Power and Communication Technologies (GUCON), 2020, pp. 502-505.
K. Singh, A. Rajput, and S. Sharma, “Human fall detection using machine learning methods: A survey,” International Journal of Mathematical, Engineering and Management Sciences, vol. 5, pp. 161-180, 11 2019.
H.-W. Tzeng, M.-Y. Chen, and J.-Y. Chen, “Design of fall detection system with floor pressure and infrared image,” in 2010 International Conference on System Science and Engineering, 2010, pp. 131-135.
H. Sadreazami, M. Bolic, and S. Rajan, “Fall detection using standoff radar-based sensing and deep convolutional neural network,” IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 67, no. 1, pp. 197-201, 2020.
T. Yang, J. Cao, and Y. Guo, “Placement selection of millimeter wave fmcw radar for indoor fall detection,” in 2018 IEEE MTT-S International Wireless Symposium (IWS), 2018, pp. 1-3.
S. Mekruksavanich and A. Jitpattanakul, “Deep residual network for smartwatch-based user identification through complex hand movements,” Sensors, vol. 22, no. 8, 2022.
S. Mekruksavanich, N. Hnoohom, and A. Jitpattanakul, “A hybrid deep residual network for efficient transitional activity recognition based on wearable sensors,” Applied Sciences, vol. 12, no. 10, 2022.
S. Mekruksavanich and A. Jitpattanakul, “Sport-related activity recognition from wearable sensors using bidirectional gru network,” Intelligent Automation & Soft Computing, vol. 34, no. 3, pp. 1907-1925, 2022.
N. Hnoohom, S. Mekruksavanich, and A. Jitpattanakul, “An efficient resnetse architecture for smoking activity recognition from smartwatch,” Intelligent Automation & Soft Computing, vol. 35, no. 1, pp. 1245-1259, 2023.
S. Mekruksavanich and A. Jitpattanakul, “Multimodal wearable sensing for sport-related activity recognition using deep learning networks,” Journal of Advances in Information Technology, vol. 13, no. 2, pp. 132-138, April 2022.
I. Kiprijanovska, H. Gjoreski, and M. Gams, “Detection of gait abnormalities for fall risk assessment using wrist-worn inertial sensors and deep learning,” Sensors, vol. 20, no. 18, 2020.
M. Musci, D. De Martini, N. Blago, T. Facchinetti, and M. Piastra, “Online fall detection using recurrent neural networks on smart wearable devices,” IEEE Transactions on Emerging Topics in Computing, vol. 9, no. 3, pp. 1276-1289, 2021.
L. Martínez-Villaseñor, H. Ponce, J. Brieva, E. Moya-Albor, J. Núñez-Martínez, and C. Peñafort-Asturiano, “Up-fall detection dataset: A multimodal approach,” Sensors, vol. 19, no. 9, 2019.
A. Sucerquia, J. D. López, and J. F. Vargas-Bonilla, “Sisfall: A fall and movement dataset,” Sensors, vol. 17, no. 1, 2017.
E. Casilari, J. A. Santoyo-Ramón, and J. M. Cano-García, “Umafall: A multisensor dataset for the research on automatic fall detection,” Procedia Computer Science, vol. 110, pp. 32-39, 2017.
O. Banos, J.-M. Galvez, M. Damas, H. Pomares, and I. Rojas, “Window size impact in human activity recognition,” Sensors, vol. 14, no. 4, pp. 6474-6499, 2014.
S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He, “Aggregated residual transformations for deep neural networks,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 5987-5995.
H. Ismail Fawaz, B. Lucas, G. Forestier, C. Pelletier, D. F. Schmidt, J. Weber, G. I. Webb, L. Idoumghar, P.-A. Muller, and F. Petitjean, “Inceptiontime: Finding alexnet for time series classification,” Data Min. Knowl. Discov., vol. 34, no. 6, p. 1936-1962, nov 2020.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput., vol. 9, no. 8, pp. 1735-1780, nov 1997.
M. Schuster and K. Paliwal, “Bidirectional recurrent neural networks,” IEEE Transactions on Signal Processing, vol. 45, no. 11, pp. 2673_2681, 1997.
K. Cho, B. van Merriënboer, D. Bahdanau, and Y. Bengio, “On the properties of neural machine translation: Encoder_decoder approaches,” in Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation. Doha, Qatar: Association for Computational Linguistics, Oct. 2014, pp. 103-111.
T. Alsarhan, L. Alawneh, M. Al-Zinati, and M. Al-Ayyoub, “Bidirectional gated recurrent units for human activity recognition using accelerometer data,” in 2019 IEEE SENSORS, 2019, pp. 1-4.
S. Angerbauer, A. Palmanshofer, S. Selinger, and M. Kurz, “Comparing human activity recognition models based on complexity and resource usage,” Applied Sciences, vol. 11, no. 18, 2021.