Potential Application of Machine Learning in Health Outcomes Research and Some Statistical Cautions

William H. Crown
2015 Value in Health  
Traditional analytic methods are often ill-suited to the evolving world of health care big data characterized by massive volume, complexity, and velocity. In particular, methods are needed that can estimate models efficiently using very large datasets containing healthcare utilization data, clinical data, data from personal devices, and many other sources. Although very large, such datasets can also be quite sparse (e.g., device data may only be available for a small subset of individuals),
more » ... h creates problems for traditional regression models. Many machine learning methods address such limitations effectively but are still subject to the usual sources of bias that commonly arise in observational studies. Researchers using machine learning methods such as lasso or ridge regression should assess these models using conventional specification tests.
doi:10.1016/j.jval.2014.12.005 pmid:25773546 fatcat:wzkwz7yxuzgc5h3blttxkm4kyq