VERTIcal Grid lOgistic regression (VERTIGO).

TitleVERTIcal Grid lOgistic regression (VERTIGO).
Publication TypeJournal Article
Year of Publication2015
AuthorsLi, Y, Jiang, X, Wang, S, Xiong, H, Ohno-Machado, L
JournalJ Am Med Inform Assoc
Date Published2015 Nov 9
ISSN1527-974X
iDASH CategoryPrivacy Technology
Abstract<p><b>OBJECTIVE: </b>To develop an accurate logistic regression (LR) algorithm to support federated data analysis of vertically partitioned distributed data sets.</p><p><b>MATERIAL AND METHODS: </b>We propose a novel technique that solves the binary LR problem by dual optimization to obtain a global solution for vertically partitioned data. We evaluated this new method, VERTIcal Grid lOgistic regression (VERTIGO), in artificial and real-world medical classification problems in terms of the area under the receiver operating characteristic curve, calibration, and computational complexity. We assumed that the institutions could "align" patient records (through patient identifiers or hashed "privacy-protecting" identifiers), and also that they both had access to the values for the dependent variable in the LR model (eg, that if the model predicts death, both institutions would have the same information about death).</p><p><b>RESULTS: </b>The solution derived by VERTIGO has the same estimated parameters as the solution derived by applying classical LR. The same is true for discrimination and calibration over both simulated and real data sets. In addition, the computational cost of VERTIGO is not prohibitive in practice.</p><p><b>DISCUSSION: </b>There is a technical challenge in scaling up federated LR for vertically partitioned data. When the number of patients m is large, our algorithm has to invert a large Hessian matrix. This is an expensive operation of time complexity O(m(3)) that may require large amounts of memory for storage and exchange of information. The algorithm may also not work well when the number of observations in each class is highly imbalanced.</p><p><b>CONCLUSION: </b>The proposed VERTIGO algorithm can generate accurate global models to support federated data analysis of vertically partitioned data.</p>
DOI10.1093/jamia/ocv146
Alternate JournalJ Am Med Inform Assoc
PubMed ID26554428
Grant ListK99 HG008175 / HG / NHGRI NIH HHS / United States