Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal release_pfqwl63yxjbe3nvkb7l5tbxkrm

by Laure Wynants, Ben Van Calster, Marc Bonten, Gary S Collins, Thomas P A Debray, Maarten De Vos, Maria C. Haller, Georg Heinze, Karel G M Moons, Richard D Riley, Ewoud Schuit, Luc Smits (+4 others)

Published in The BMJ (British Medical Journal) by BMJ.

2020   Volume 369, m1328

Abstract

<jats:title>Abstract</jats:title> <jats:sec> <jats:title>Objective</jats:title> To review and critically appraise published and preprint reports of prediction models for diagnosing coronavirus disease 2019 (covid-19) in patients with suspected infection, for prognosis of patients with covid-19, and for detecting people in the general population at risk of being admitted to hospital for covid-19 pneumonia. </jats:sec> <jats:sec> <jats:title>Design</jats:title> Rapid systematic review and critical appraisal. </jats:sec> <jats:sec> <jats:title>Data sources</jats:title> PubMed and Embase through Ovid, Arxiv, medRxiv, and bioRxiv up to 24 March 2020. </jats:sec> <jats:sec> <jats:title>Study selection</jats:title> Studies that developed or validated a multivariable covid-19 related prediction model. </jats:sec> <jats:sec> <jats:title>Data extraction</jats:title> At least two authors independently extracted data using the CHARMS (critical appraisal and data extraction for systematic reviews of prediction modelling studies) checklist; risk of bias was assessed using PROBAST (prediction model risk of bias assessment tool). </jats:sec> <jats:sec> <jats:title>Results</jats:title> 2696 titles were screened, and 27 studies describing 31 prediction models were included. Three models were identified for predicting hospital admission from pneumonia and other events (as proxy outcomes for covid-19 pneumonia) in the general population; 18 diagnostic models for detecting covid-19 infection (13 were machine learning based on computed tomography scans); and 10 prognostic models for predicting mortality risk, progression to severe disease, or length of hospital stay. Only one study used patient data from outside of China. The most reported predictors of presence of covid-19 in patients with suspected disease included age, body temperature, and signs and symptoms. The most reported predictors of severe prognosis in patients with covid-19 included age, sex, features derived from computed tomography scans, C reactive protein, lactic dehydrogenase, and lymphocyte count. C index estimates ranged from 0.73 to 0.81 in prediction models for the general population (reported for all three models), from 0.81 to more than 0.99 in diagnostic models (reported for 13 of the 18 models), and from 0.85 to 0.98 in prognostic models (reported for six of the 10 models). All studies were rated at high risk of bias, mostly because of non-representative selection of control patients, exclusion of patients who had not experienced the event of interest by the end of the study, and high risk of model overfitting. Reporting quality varied substantially between studies. Most reports did not include a description of the study population or intended use of the models, and calibration of predictions was rarely assessed. </jats:sec> <jats:sec> <jats:title>Conclusion</jats:title> Prediction models for covid-19 are quickly entering the academic literature to support medical decision making at a time when they are urgently needed. This review indicates that proposed models are poorly reported, at high risk of bias, and their reported performance is probably optimistic. Immediate sharing of well documented individual participant data from covid-19 studies is needed for collaborative efforts to develop more rigorous prediction models and validate existing ones. The predictors identified in included studies could be considered as candidate predictors for new models. Methodological guidance should be followed because unreliable predictions could cause more harm than benefit in guiding clinical decisions. Finally, studies should adhere to the TRIPOD (transparent reporting of a multivariable prediction model for individual prognosis or diagnosis) reporting guideline. </jats:sec> <jats:sec> <jats:title>Systematic review registration</jats:title> Protocol <jats:ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="https://osf.io/ehc47/">https://osf.io/ehc47/</jats:ext-link> , registration <jats:ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="https://osf.io/wy245">https://osf.io/wy245</jats:ext-link> . </jats:sec>
In application/xml+jats format

Archived Files and Locations

application/pdf  337.6 kB
file_ssvxqupxrzgnjmwyv3mlawcksu
www.bmj.com (publisher)
web.archive.org (webarchive)
application/pdf  337.7 kB
file_tjgcevkgyjgd7gmhwrldh6c6mq
ora.ox.ac.uk (web)
web.archive.org (webarchive)
application/pdf  511.0 kB
file_5e6hai73njcidks5uo6cbcip5y
aura.abdn.ac.uk (web)
web.archive.org (webarchive)
application/pdf  463.8 kB
file_7iwzpgmz25hcnpzbqnibctvhgq
lirias2repo.kuleuven.be (web)
web.archive.org (webarchive)
application/pdf  510.8 kB
file_gea4r7q3ubd2rjaoyzbq6natiq
lirias2repo.kuleuven.be (web)
web.archive.org (webarchive)
application/pdf  337.7 kB
file_a6eo3hs46rat7ork6l5hu4jqou
www.bmj.com (web)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2020-04-07
Language   en ?
DOI  10.1136/bmj.m1328
PubMed  32265220
PMC  PMC7222643
Journal Metadata
Not in DOAJ
In Keepers Registry
ISSN-L:  1756-1833
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: bf704555-b4f0-47b1-b1b7-cfa4c914e7ca
API URL: JSON