Kevin D. McCay
A Pose-based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants
McCay, Kevin D.; Hu, Pengpeng; Shum, Hubert P.H.; Woo, Wai Lok; Marcroft, Claire; Embleton, Nicholas D.; Munteanu, Adrian; Ho, Edmond S.L.
Authors
Pengpeng Hu
Dr Hubert Shum hubert.shum@durham.ac.uk
Associate Professor
Wai Lok Woo
Claire Marcroft
Nicholas D. Embleton
Adrian Munteanu
Edmond S.L. Ho
Abstract
The early diagnosis of cerebral palsy is an area which has recently seen significant multi-disciplinary research. Diagnostic tools such as the General Movements Assessment (GMA), have produced some very promising results. However, the prospect of automating these processes may improve accessibility of the assessment and also enhance the understanding of movement development of infants. Previous works have established the viability of using pose-based features extracted from RGB video sequences to undertake classification of infant body movements based upon the GMA. In this paper, we propose a series of new and improved features, and a feature fusion pipeline for this classification task. We also introduce the RVI-38 dataset, a series of videos captured as part of routine clinical care. By utilising this challenging dataset we establish the robustness of several motion features for classification, subsequently informing the design of our proposed feature fusion framework based upon the GMA. We evaluate our proposed framework’s classification performance using both the RVI-38 dataset and the publicly available MINI-RGBD dataset. We also implement several other methods from the literature for direct comparison using these two independent datasets. Our experimental results and feature analysis show that our proposed pose-based method performs well across both datasets. The proposed features afford us the opportunity to include finer detail than previous methods, and further model GMA specific body movements. These new features also allow us to take advantage of additional body-part specific information as a means of improving the overall classification performance, whilst retaining GMA relevant, interpretable, and shareable features.
Citation
McCay, K. D., Hu, P., Shum, H. P., Woo, W. L., Marcroft, C., Embleton, N. D., …Ho, E. S. (2022). A Pose-based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 30, 8-19. https://doi.org/10.1109/tnsre.2021.3138185
Journal Article Type | Article |
---|---|
Online Publication Date | Dec 23, 2021 |
Publication Date | 2022 |
Deposit Date | Jan 5, 2022 |
Publicly Available Date | Jan 5, 2022 |
Journal | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
Print ISSN | 1534-4320 |
Electronic ISSN | 1558-0210 |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
Volume | 30 |
Pages | 8-19 |
DOI | https://doi.org/10.1109/tnsre.2021.3138185 |
Files
Accepted Journal Article
(649 Kb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
Copyright Statement
This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
Published Journal Article
(1.1 Mb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
You might also like
Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentation
(2023)
Conference Proceeding
Region-based Appearance and Flow Characteristics for Anomaly Detection in Infrared Surveillance Imagery
(2023)
Conference Proceeding
Hierarchical Graph Convolutional Networks for Action Quality Assessment
(2023)
Journal Article
UAV-ReID: A Benchmark on Unmanned Aerial Vehicle Re-Identification in Video Imagery
(2022)
Conference Proceeding
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search