Practical strategies for large missing data in dementia diagnosis [article]

Niamh McCombe, Shuo Liu, Xuemei Ding, Girijesh Prasad, Magda Bucholc, David P Finn, Stephen Todd, Paula L McClean, KongFatt Wong-Lin
2020 medRxiv   pre-print
Accurate computational models for clinical decision support systems require clean and reliable data, but in clinical practice, data are often incomplete. Hence, missing data could arise not only from training datasets but also test datasets which could consist of a single undiagnosed case, an individual. Many popular methods of handling missing data are unsuitable for handling such missing test data. This work addresses the problem by evaluating multiple imputation and classification workflows
more » ... ased not only on diagnostic classification accuracy but also computational cost. In particular, we focus on dementia diagnosis due to long time delays, high variability, high attrition rates and lack of practical data imputation strategies in its diagnostic pathway. We identified and replicated the extreme missingness structure of data from a memory clinic on a larger open dataset, with the original complete data acting as ground truth. Overall, we found that computational cost, but not accuracy, varies widely for various imputation and classification approaches. Particularly, we found that iterative imputation on the training dataset combined with a reduced-feature classification model provides the best approach, compromising speed and accuracy. Taken together, this work has elucidated important factors to be considered when developing or maintaining a dementia diagnostic support system, which can be generalized to other clinical or medical domains, particularly with extreme data missingness.
doi:10.1101/2020.07.13.20146118 fatcat:um4mmasaubdxlg2u3toqs5sbaq