February 23, 2023– Using ensemble learning techniques and longitudinal data from a large naturalistic driving study, researchers at Columbia University’s Mailman School of Public Health, Fu Foundation School of Engineering and Applied Science, and Vagelos College of Physicians and Surgeons have developed a novel, interpretable and highly accurate algorithm for predicting mild cognitive impairment and dementia in older drivers. Digital markers refer to variables generated from data captured through recording devices in the real-world setting. These data could be processed to measure driving behavior, performance and tempo-spatial pattern in exceptional detail. The study is published in the journal Artificial Intelligence in Medicine.
The researchers used an interaction-based classification method for selecting predictive variables in the dataset. This learning model has achieved an accuracy of 96 percent in predicting mild cognitive impairment and dementia, outperforming traditional machine learning models such as logistic regression and random forests — a statistical technique widely used in AI for classifying disease status. “Our new ensemble learning model based on digital markers and basic demographic characteristics could predict mild cognitive impairment and dementia in older drivers with excellent accuracy,” said Sharon Di, associate professor of civil engineering and engineering mechanics at Columbia Engineering and the study’s lead author.
The investigators constructed 200 variable modules using the naturalistic driving data on the driver, the vehicle and the environment captured by in-vehicle recording devices for 2977 drivers participating in the Longitudinal Research on Aging Drivers (LongROAD) project, a prospective cohort study conducted in five sites across the contiguous United States and sponsored by the AAA Foundation for Traffic Safety. At the time of enrollment, the participants were active drivers aged 65-79 years who were cognitively intact. Data used in this study came from the first three years of follow-up, spanning from August 2015 through March 2019. During the follow-up, 36 participants were diagnosed with mild cognitive impairment, 8 with Alzheimer’s disease, and 17 with other or unspecified dementia.
The researchers performed a series of computer modeling experiments and found that the new ensemble learning model is 6-10 percent more accurate than random forests and logistic regression models in predicting mild cognitive impairment and dementia. The two most influential driving variables are the right to left turn ratio and the number of hard braking events (defined as maneuvers with deceleration rates ≥ 0.4 g). “With advancing age, drivers make relatively fewer left turns and more right turns because left turns are riskier,” noted Di.
“About 85 percent of older adults in the United States are licensed drivers. As the most preferred mode of personal transportation, driving plays an important role in maintaining independence, self-control, social connection, and quality of life. Safely operating a car requires essential cognitive and physical functions. Our study indicates that digital markers embedded in routinely collected driving data can be used through innovative machine learning techniques as valid and reliable artificial intelligence for predicting mild cognitive impairment and dementia,” said Guohua Li, MD, DrPH, professor of epidemiology and anesthesiology at Columbia Mailman School of Public Health and Vagelos College of Physicians and Surgeons, and senior author. “Early detection of mild cognitive impairment and dementia could lead to timely evaluation, diagnosis, and interventions, which are especially salient in the absence of effective therapeutics.”
Co-authors are Carolyn DiGuiseppi, Colorado School of Public Health; David W. Eby, University of Michigan Transportation Research Institute; Linda Hill, University of California San Diego School of Public Health; Thelma J. Mielenz, Columbia Mailman School of Public Health; David Strogatz, Bassett Research Institute; and Minjae Kim, Columbia Vagelos College of Physicians and Surgeons.
The study was supported in part by the AAA Foundation for Traffic Safety.
Columbia University Mailman School of Public Health
Founded in 1922, the Columbia University Mailman School of Public Health pursues an agenda of research, education, and service to address the critical and complex public health issues affecting New Yorkers, the nation and the world. The Columbia Mailman School is the fourth largest recipient of NIH grants among schools of public health. Its nearly 300 multi-disciplinary faculty members work in more than 100 countries around the world, addressing such issues as preventing infectious and chronic diseases, environmental health, maternal and child health, health policy, climate change and health, and public health preparedness. It is a leader in public health education with more than 1,300 graduate students from 55 nations pursuing a variety of master’s and doctoral degree programs. The Columbia Mailman School is also home to numerous world-renowned research centers, including ICAP and the Center for Infection and Immunity. For more information, please visit www.mailman.columbia.edu.
Columbia Engineering, based in New York City, is one of the top engineering schools in the U.S. and one of the oldest in the nation. Also known as The Fu Foundation School of Engineering and Applied Science, the School expands knowledge and advances technology through the pioneering research of its more than 220 faculty, while educating undergraduate and graduate students in a collaborative environment to become leaders informed by a firm foundation in engineering. The School’s faculty are at the center of the University’s cross-disciplinary research, contributing to the Data Science Institute, Earth Institute, Zuckerman Mind Brain Behavior Institute, Precision Medicine Initiative, and the Columbia Nano Initiative. Guided by its strategic vision, “Columbia Engineering for Humanity,” the School aims to translate ideas into innovations that foster a sustainable, healthy, secure, connected, and creative humanity.
