Systematic Review Identifies Errors in FDA-Authorized COVID-19 Treatment Safety Data
Overview
A critical review of Maglione et al's systematic analysis of FDA-authorized COVID-19 treatments reveals methodological errors in data abstraction and interpretation, particularly concerning thrombotic, bleeding, and infection adverse events associated with COVID-19 Convalescent Plasma (CCP). Reanalysis suggests CCP may have a lower thrombotic risk than controls, contradicting the original report's conclusions.
Background
COVID-19 treatments authorized by the U.S. FDA have undergone numerous clinical trials assessing efficacy and safety. Accurate reporting of serious adverse events (SAEs) such as thrombosis, bleeding, and infections is crucial for clinical decision-making. Maglione et al conducted a rapid systematic review summarizing these safety outcomes but included data abstraction errors and misinterpretations, especially regarding CCP. Clarifying these discrepancies is important to guide clinicians on the thrombotic risks associated with COVID-19 therapies.
Data Highlights
Study
Thrombotic Events (CCP)
Thrombotic Events (Control)
Notes
Bar et al, 2021
1 (thrombosis SAE), 1 (embolism SAE)
1 (thrombosis SAE), 0 (embolism SAE)
Events may overlap in same individuals; summing not appropriate
Begin et al, 2021
Data errors in thrombosis, bleeding, infection counts
Data errors noted
Incorrect numbers reported in original review
Self et al, 2022
Incorrect thrombosis and infection data reported
Incorrect data reported
Data from clinicaltrials.gov differ from review
Korley et al, 2021
0 infection events
1 infection event
Original review reported 33 and 40 events incorrectly
Aggregate CCP Data
49 thrombotic events / 2609 patients
83 thrombotic events / 2964 patients
Relative risk 0.67 (P=0.025), indicating lower risk with CCP
Key Findings
Maglione et al's review contains methodological errors in data abstraction for thrombotic, bleeding, and infection SAEs related to CCP and other treatments.
Summing separate SAE numerators (e.g., thrombosis and embolism) without accounting for overlapping events leads to inaccurate risk estimates.
Several studies had incorrect event counts reported in the review compared to clinicaltrials.gov data, including Bar et al, Begin et al, Self et al, and Korley et al.
Non-randomized studies with unmatched controls, such as Thompson et al, may bias safety outcome interpretations and should be carefully contextualized.
Reanalysis of aggregated CCP data indicates a significantly lower thrombotic event risk compared to controls (relative risk 0.67, P=0.025), contradicting the original review's conclusions.
Careful differentiation between serious adverse events and adverse events is necessary for accurate safety reporting.
Clinical Implications
Clinicians should interpret safety data on COVID-19 treatments, particularly CCP, with caution due to potential data abstraction errors in published reviews. The evidence does not support an increased thrombotic risk with CCP; in fact, CCP may be associated with fewer thrombotic events. Accurate and transparent reporting of SAEs is essential to guide therapeutic decisions and patient counseling.
Conclusion
This correspondence highlights critical errors in a rapid systematic review of FDA-authorized COVID-19 treatments, emphasizing the need for meticulous data handling. Corrected analyses suggest CCP does not increase thrombotic risk and may be safer than previously reported.
References
Maglione et al 2023 -- Rapid Systematic Review of FDA-Authorized COVID-19 Treatments
Bar et al 2021 -- Clinical Trial NCT04397757
Begin et al 2021 -- COVID-19 Convalescent Plasma Trial
Korley et al 2021 -- Clinical Trial NCT04355767
Ortigoza et al 2022 -- COVID-19 Plasma Study
Self et al 2022 -- COVID-19 Treatment Trial
Sullivan et al 2022 -- COVID-19 Plasma Safety Data
Thompson et al 2021 -- Propensity Matched Non-RCT in Hematologic Cancers
