Multimodal Sensor Fusion for Robust Physiological Monitoring during Free-Living Activities

Authors

  • Dongjie Huangfu Department of Computer Science, George Mason University, Fairfax, VA, USA. Author
  • Kasper C. Watson Department of Computer Science and Engineering, University at Buffalo, Buffalo, NY, USA. Author
  • Emmett L. Benson Department of Computer Science, University of North Texas, Denton, TX, USA. Author
  • Samir Garrett Department of Computer Science, University of Central Florida, Orlando, FL, USA. Author

Keywords:

physiological monitoring, multimodal sensor fusion, wearable systems, free-living activities, robustness, data governance, fairness, edge computing

Abstract

The expansion of wearable sensing technologies has created new opportunities for continuous physiological monitoring beyond controlled clinical environments. However, free-living conditions introduce substantial challenges related to motion artifacts, contextual variability, heterogeneous sensor placements, environmental interference, and population diversity. Single-modality physiological sensing often fails to provide sufficiently robust estimates during unstructured daily activities. Multimodal sensor fusion offers a promising system-level strategy by combining complementary physiological, kinematic, and environmental data streams to improve estimation reliability, contextual awareness, and clinical interpretability. This paper presents a long-form analysis of multimodal sensor fusion for physiological monitoring during free-living activities. It examines the architectural dimensions of sensing, edge processing, communication, and cloud analytics while emphasizing structural trade-offs among accuracy, energy consumption, latency, privacy, and scalability. The discussion explores early, intermediate, and decision-level fusion approaches and their implications for system robustness. It further considers context-aware adaptation, motion artifact mitigation, data governance, algorithmic fairness, population heterogeneity, and deployment sustainability. Rather than focusing narrowly on signal-level algorithms, the paper adopts a systems-oriented perspective, integrating concerns from artificial intelligence, wearable engineering, socio-technical infrastructure, and health policy. The analysis highlights the need for governance frameworks that address continuous physiological data collection and emphasizes the importance of fairness across demographic groups. Forward-looking perspectives on edge intelligence, federated learning, digital biomarkers, and sustainable wearable ecosystems are provided. The paper argues that robust free-living physiological monitoring requires not only advanced fusion algorithms but also carefully designed sociotechnical architectures that align technical performance with ethical and regulatory requirements.

References

1. Majumder, S., Mondal, T., & Deen, M. J. (2017). Wearable sensors for remote health monitoring. Sensors, 17(1), 130.

2. Cornacchia, M., Ozcan, K., Zheng, Y., & Velipasalar, S. (2017). A survey on activity detection and classification using wearable sensors. IEEE Sensors Journal, 17(2), 386-403.

3. Zhang, Z., Pi, Z., & Liu, B. (2015). TROIKA: A general framework for heart rate monitoring using wrist-type photoplethysmographic signals during intensive physical exercise. IEEE Transactions on Biomedical Engineering, 62(2), 522-531.

4. Gravina, R., Alinia, P., Ghasemzadeh, H., & Fortino, G. (2017). Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges. Information Fusion, 35, 68-80.

5. Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., & Ng, A. Y. (2011). Multimodal deep learning. Proceedings of the 28th International Conference on Machine Learning, 689-696.

6. Islam, S. M. R., Kwak, D., Kabir, M. H., Hossain, M., & Kwak, K.-S. (2015). The internet of things for health care: A comprehensive survey. IEEE Access, 3, 678-708.

7. Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., ... Cardoso, M. J. (2020). The future of digital health with federated learning. NPJ Digital Medicine, 3, 119.

8. Zhang, Y., Song, S., Vullings, R., Biswas, D., Simões-Capela, N., van Helleputte, N., van Hoof, C., & Groenendaal, W. (2019). Motion artifact reduction for wrist-worn photoplethysmograph sensors based on different wavelengths. Sensors, 19(3), 673.

9. Muzammal, M., Talat, R., Sodhro, A. H., & Pirbhulal, S. (2020). A multi-sensor data fusion enabled ensemble approach for medical data from body sensor networks. Information Fusion, 53, 155-164.

10. Chen, M., Li, W., Hao, Y., Qian, Y., & Humar, I. (2018). Edge cognitive computing based smart healthcare system. Future Generation Computer Systems, 86, 403-411.

11. Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447-453.

12. Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2021). A survey on bias and fairness in machine learning. ACM Computing Surveys, 54(6), 1-35.

13. Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019). A guide to deep learning in healthcare. Nature Medicine, 25(1), 24-29.

14. Vayena, E., Haeusermann, T., Adjekum, A., & Blasimme, A. (2018). Digital health: Meeting the ethical and policy challenges. Swiss Medical Weekly, 148, w14571.

15. Zheng, X., Dwyer, V. M., Barrett, L. A., Derakhshani, M., & Hu, S. (2023). Rapid vital sign extraction for real-time opto-physiological monitoring at varying physical activity intensity levels. IEEE Journal of Biomedical and Health Informatics, 27(7), 3107-3118.

16. Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. (2020). Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ Digital Medicine, 3, 18.

17. Laranjo, L., Ding, D., Heleno, B., Kocaballi, B., Quiroz, J. C., Tong, H. L., ... Lau, A. Y. S. (2021). Do smartphone applications and activity trackers increase physical activity in adults? Systematic review, meta-analysis and metaregression. British Journal of Sports Medicine, 55(8), 422-432.

18. Xu, S., Zhang, Y., Jia, L., Mathewson, K. E., Jang, K.-I., Kim, J., ... Rogers, J. A. (2014). Soft microfluidic assemblies of sensors, circuits, and radios for the skin. Science, 344(6179), 70-74.

19. Shilo, S., Rossman, H., & Segal, E. (2020). Axes of a revolution: Challenges and promises of big data in healthcare. Nature Medicine, 26(1), 29-38.

20. Smuck, M., Odonkor, C. A., Wilt, J. K., Schmidt, N., & Swiernik, M. A. (2021). The emerging clinical role of wearables: Factors for successful implementation in healthcare. NPJ Digital Medicine, 4, 45.

Downloads

Published

2026-09-18

How to Cite

Multimodal Sensor Fusion for Robust Physiological Monitoring during Free-Living Activities. (2026). International Journal of Artificial Intelligence Engineering and Systems, 1(2). https://ijaies.org/index.php/home/article/view/195