Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Characteristics of the Multiplicity of Randomized Clinical Trials for Coronavirus Disease 2019 Launched During the Pandemic

Characteristics of the Multiplicity of Randomized Clinical Trials for Coronavirus Disease 2019... Research Letter | Statistics and Research Methods Characteristics of the Multiplicity of Randomized Clinical Trials for Coronavirus Disease 2019 Launched During the Pandemic Ramez Kouzy, MD; Joseph Abi Jaoude, MD; Carolina J. Garcia Garcia, BS; Molly B. El Alam, MPH; Cullen M. Taniguchi, MD, PhD; Ethan B. Ludmir, MD Introduction High-quality evidence generated by appropriately powered and controlled trials is needed to Author affiliations and article information are listed at the end of this article. advance care for patients with coronavirus disease 2019 (COVID-19) and those who are susceptible 1,2 to it. In the midst of the COVID-19 pandemic, multiple similar therapeutic trials are being conducted in parallel, potentially reducing participant accrual across trials. In this systematic review, we characterize the landscape of current COVID-19 trials to better quantify these potential issues. Methods Institutional review board approval of this study was waived because it exclusively used publicly available data without any protected health information. Screening and trial selection adhered to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline. We performed a data query of the ClinicalTrials.gov registry for interventional trials in any clinical phase regarding COVID-19 on June 8, 2020. Advanced search parameters included COVID-19, SARS-CoV-2, 2019-nCoV, 2019 novel coronavirus, and severe acute respiratory syndrome coronavirus 2. Data were analyzed using SPSS statistical software version 26 (IBM Corp). Data analysis was performed in June 2020. Results Our search yielded 674 trials after removing suspended and halted trials (Figure). Most were randomized multigroup studies (562 of 674 trials [83.4%]). Only 479 of 674 randomized trials (71.1%) included a control group deemed to be valid at the time of data curation (including either standard of care or placebo as the control group). Most of the trials assessed treatment of COVID-19 (570 of 674 trials [84.6%]) rather than its prevention (104 of 674 trials [15.4%]). Of randomized studies, only 201 (35.8%) were multicenter trials (Table). Chloroquines were the most commonly tested intervention (132 of 562 randomized trials [23.5%]; 143 trials total). Among the 201 trials accruing in the US alone, the total expected enrollment was 146 688 participants. This included 33 COVID-19 prevention trials with a planned total accrual of 100 746 participants, of which 86 950 participants (86.3%) were planned to accrue to chloroquine-specific COVID-19 prevention trials. Similarly, there were 168 US-accruing COVID-19 treatment trials with a planned total accrual of 45 942 participants, of which 13 542 participants (29.5%) were planned to accrue to chloroquine-specific COVID-19 treatment trials. Primary end points most commonly assessed among randomized studies were time to symptom and sign resolution (212 trials [37.7%]), mortality (180 trials [32.0%]), viral clearance (124 trials [22.1%]), and mechanical ventilation (57 trials [10.1%]) (Table). Discussion We found a high rate of trial multiplicity, particularly with chloroquines, which are being tested in 143 studies. Although these overlapping trials may afford opportunities for replication and validation, Open Access. This is an open access article distributed under the terms of the CC-BY License. JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 1/4 JAMA Network Open | Statistics and Research Methods Characteristics of the Randomized Clinical Trials for COVID-19 Launched During the Pandemic the high degree of multiplicity also enhances the likelihood of finding a positive result through chance alone, potentially resulting in widespread use of an ineffective and possibly hazardous intervention. The fragmentation of efforts could also lead to unnecessary competition for participants, which potentially compromises trial accrual and statistical power for all trials. This worrisome scenario has already occurred in China. Because the projected participant accrual for US-only COVID-19 treatment trials is approximately 45 942 participants (13 542 to chloroquines alone), it seems unlikely Figure. Flowchart of Screening, Eligibility, and Inclusion of Randomized Clinical Trials for Coronavirus Disease 2019 (COVID-19) 1982 Trials identified through search 857 Excluded trials 834 Observational 18 Expanded access 4 Non-COVID-19 1 Basic science 1125 Interventional clinical trials 24 Excluded inactive trials 12 Withdrawn 9 Suspended 3 Terminated 1101 Active interventional clinical trials 427 Excluded trials 344 Phase not available 64 Phase 4 19 Early Phase 1 674 Active interventional COVID-19 clinical trials Table. Characteristics of Coronavirus Disease 2019 Clinical Trials Trials, No. (%) Characteristic Randomized (n = 562) Nonrandomized (n = 112) Multicenter trials 201 (35.8) 23 (20.5) Multinational trials 22 (3.9) 1 (0.9) Any blinding 331 (58.9) 3 (2.7) Intervention Chloroquines 132 (23.5) 11 (9.8) Biologicals 177 (31.5) 60 (53.6) Convalescent plasma 30 (5.4) 18 (16.1) Tocilizumab 21 (3.7) 6 (5.4) Tyrosine kinase inhibitor 20 (3.6) 12 (10.7) Antivirals 55 (9.8) 1 (0.9) Remdesevir 9 (1.6) 0 a Nonrandomized trials included both single-group Protease inhibitors 37 (6.8) 1 (0.9) and nonrandomized multiple-group trials. Antibiotics 49 (8.7) 5 (4.5) Blinding included single, double, triple, and Azithromycin 40 (7.1) 4 (3.6) quadruple blinding. Primary end point Interventions were counted independently as many trials included multiple interventions. Time to symptom and sign resolution 212 (37.7) 51 (45.5) Chloroquines included hydroxychloroquine and Mortality 180 (32.0) 23 (20.5) chloroquine. Viral clearance 124 (22.1) 16 (14.3) Primary end points were counted independently Need for mechanical ventilation 57 (10.1) 5 (4.5) because many trials included multiple primary Industry sponsorship 175 (31.1) 19 (17.0) end points. JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 2/4 JAMA Network Open | Statistics and Research Methods Characteristics of the Randomized Clinical Trials for COVID-19 Launched During the Pandemic that this target will be achieved given the intrinsic challenges of participant accrual during an active pandemic. Notably, our study is limited through the use of a single US-based clinical trials registry, potentially representing only a fraction of the worldwide COVID-19–related trials portfolio. Furthermore, the ever-changing landscape of COVID-19 clinical research amid this pandemic may complicate future interpretation of this report. Although current trials have been initiated with the best intentions, the medical community must be mindful of the potential issues of incomplete participant accrual and publication bias that are introduced by enabling dozens of similar trials simultaneously. Together, these factors endanger the capacity to rapidly produce meaningful evidence that is vital during this critical time. Avoiding these pitfalls requires coordination of efforts. This could be achieved, in part, through makeshift cooperative groups to improve participant accrual and decrease duplicative efforts. Institutional review boards and regulators (including the US Food and Drug Administration) must also work together to responsibly ease roadblocks to coordinate pooled analyses across trials. These efforts should include synchronization and standardization of end points, focusing on the most meaningful and objective outcomes (eg, all-cause mortality, intensive care unit admission, and mechanical ventilation). It is hoped that these measures will expedite generation of high-quality prospective data to guide effective treatments while maximizing resource allocation. ARTICLE INFORMATION Accepted for Publication: June 15, 2020. Published: July 13, 2020. doi:10.1001/jamanetworkopen.2020.15100 Open Access: This is an open access article distributed under the terms of the CC-BY License.©2020KouzyRetal. JAMA Network Open. Corresponding Authors: Ethan B. Ludmir, MD, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Unit 1422, Houston, TX 77030 (ebludmir@mdanderson.org); Cullen M. Taniguchi, MD, PhD, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Unit 1050, Houston, TX 77030 (ctaniguchi @mdanderson.org). Author Affiliations: The University of Texas MD Anderson Cancer Center, Houston. Author Contributions: Drs Kouzy and Ludmir had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Drs Kouzy and Abi Jaoude contributed equally as first authors. Drs Taniguchi and Ludmir contributed equally as senior authors. Concept and design: Kouzy, Abi Jaoude, Taniguchi, Ludmir. Acquisition, analysis, or interpretation of data: Kouzy, Abi Jaoude, Garcia Garcia, El Alam, Ludmir. Drafting of the manuscript: Kouzy, Abi Jaoude, Garcia Garcia, Taniguchi, Ludmir. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: Kouzy, Abi Jaoude, Garcia Garcia, El Alam, Ludmir. Obtained funding: Abi Jaoude, Taniguchi. Administrative, technical, or material support: Abi Jaoude, Taniguchi. Supervision: Abi Jaoude, Taniguchi, Ludmir. Conflict of Interest Disclosures: Ms Garcia Garcia reported receiving support from the National Institute of Diabetes and Digestive and Kidney Diseases of the National Institutes of Health (NIH) (award number F31DK121384). Dr Taniguchi reported receiving supported from the NIH (award R01CA227517-01A1), Cancer Prevention & Research Institute of Texas (grant RR140012), V Foundation (grant V2015-22), the Kimmel Foundation, Sabin Family Foundation Fellowship, and the McNair Foundation and reported being a member of the clinical advisory board of Accuray outside the submitted work. No other disclosures were reported. REFERENCES 1. Goodman JL, Borio L. Finding effective treatments for COVID-19: scientific integrity and public confidence in a time of crisis. JAMA. 2020;323(19):1899-1900. doi:10.1001/jama.2020.6434 JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 3/4 JAMA Network Open | Statistics and Research Methods Characteristics of the Randomized Clinical Trials for COVID-19 Launched During the Pandemic 2. Kalil AC. Treating COVID-19: off-label drug use, compassionate use, and randomized clinical trials during pandemics. JAMA. 2020;323(19):1897-1898. doi:10.1001/jama.2020.4742 3. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-269. doi:10.7326/0003-4819-151-4- 200908180-00135 4. Prasad V, Booth CM. Multiplicity in oncology randomised controlled trials: a threat to medical evidence? Lancet Oncol. 2019;20(12):1638-1640. doi:10.1016/S1470-2045(19)30744-2 5. Reuters. China trial of Gilead’s potential coronavirus treatment suspended. Published April 15, 2020. Accessed April 16, 2020. https://www.reuters.com/article/us-health-coronavirus-gilead-remdesivir/china-trial-of-gileads- potential-coronavirus-treatment-suspended-idUSKCN21X2A2 6. London AJ, Omotade OO, Mello MM, Keusch GT. Ethics of randomized trials in a public health emergency. PLoS Negl Trop Dis. 2018;12(5):e0006313. doi:10.1371/journal.pntd.0006313 JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 4/4 http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png JAMA Network Open American Medical Association

Characteristics of the Multiplicity of Randomized Clinical Trials for Coronavirus Disease 2019 Launched During the Pandemic

Loading next page...
 
/lp/american-medical-association/characteristics-of-the-multiplicity-of-randomized-clinical-trials-for-VDjig0kUiu

References (13)

Publisher
American Medical Association
Copyright
Copyright 2020 Kouzy R et al. JAMA Network Open.
eISSN
2574-3805
DOI
10.1001/jamanetworkopen.2020.15100
Publisher site
See Article on Publisher Site

Abstract

Research Letter | Statistics and Research Methods Characteristics of the Multiplicity of Randomized Clinical Trials for Coronavirus Disease 2019 Launched During the Pandemic Ramez Kouzy, MD; Joseph Abi Jaoude, MD; Carolina J. Garcia Garcia, BS; Molly B. El Alam, MPH; Cullen M. Taniguchi, MD, PhD; Ethan B. Ludmir, MD Introduction High-quality evidence generated by appropriately powered and controlled trials is needed to Author affiliations and article information are listed at the end of this article. advance care for patients with coronavirus disease 2019 (COVID-19) and those who are susceptible 1,2 to it. In the midst of the COVID-19 pandemic, multiple similar therapeutic trials are being conducted in parallel, potentially reducing participant accrual across trials. In this systematic review, we characterize the landscape of current COVID-19 trials to better quantify these potential issues. Methods Institutional review board approval of this study was waived because it exclusively used publicly available data without any protected health information. Screening and trial selection adhered to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline. We performed a data query of the ClinicalTrials.gov registry for interventional trials in any clinical phase regarding COVID-19 on June 8, 2020. Advanced search parameters included COVID-19, SARS-CoV-2, 2019-nCoV, 2019 novel coronavirus, and severe acute respiratory syndrome coronavirus 2. Data were analyzed using SPSS statistical software version 26 (IBM Corp). Data analysis was performed in June 2020. Results Our search yielded 674 trials after removing suspended and halted trials (Figure). Most were randomized multigroup studies (562 of 674 trials [83.4%]). Only 479 of 674 randomized trials (71.1%) included a control group deemed to be valid at the time of data curation (including either standard of care or placebo as the control group). Most of the trials assessed treatment of COVID-19 (570 of 674 trials [84.6%]) rather than its prevention (104 of 674 trials [15.4%]). Of randomized studies, only 201 (35.8%) were multicenter trials (Table). Chloroquines were the most commonly tested intervention (132 of 562 randomized trials [23.5%]; 143 trials total). Among the 201 trials accruing in the US alone, the total expected enrollment was 146 688 participants. This included 33 COVID-19 prevention trials with a planned total accrual of 100 746 participants, of which 86 950 participants (86.3%) were planned to accrue to chloroquine-specific COVID-19 prevention trials. Similarly, there were 168 US-accruing COVID-19 treatment trials with a planned total accrual of 45 942 participants, of which 13 542 participants (29.5%) were planned to accrue to chloroquine-specific COVID-19 treatment trials. Primary end points most commonly assessed among randomized studies were time to symptom and sign resolution (212 trials [37.7%]), mortality (180 trials [32.0%]), viral clearance (124 trials [22.1%]), and mechanical ventilation (57 trials [10.1%]) (Table). Discussion We found a high rate of trial multiplicity, particularly with chloroquines, which are being tested in 143 studies. Although these overlapping trials may afford opportunities for replication and validation, Open Access. This is an open access article distributed under the terms of the CC-BY License. JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 1/4 JAMA Network Open | Statistics and Research Methods Characteristics of the Randomized Clinical Trials for COVID-19 Launched During the Pandemic the high degree of multiplicity also enhances the likelihood of finding a positive result through chance alone, potentially resulting in widespread use of an ineffective and possibly hazardous intervention. The fragmentation of efforts could also lead to unnecessary competition for participants, which potentially compromises trial accrual and statistical power for all trials. This worrisome scenario has already occurred in China. Because the projected participant accrual for US-only COVID-19 treatment trials is approximately 45 942 participants (13 542 to chloroquines alone), it seems unlikely Figure. Flowchart of Screening, Eligibility, and Inclusion of Randomized Clinical Trials for Coronavirus Disease 2019 (COVID-19) 1982 Trials identified through search 857 Excluded trials 834 Observational 18 Expanded access 4 Non-COVID-19 1 Basic science 1125 Interventional clinical trials 24 Excluded inactive trials 12 Withdrawn 9 Suspended 3 Terminated 1101 Active interventional clinical trials 427 Excluded trials 344 Phase not available 64 Phase 4 19 Early Phase 1 674 Active interventional COVID-19 clinical trials Table. Characteristics of Coronavirus Disease 2019 Clinical Trials Trials, No. (%) Characteristic Randomized (n = 562) Nonrandomized (n = 112) Multicenter trials 201 (35.8) 23 (20.5) Multinational trials 22 (3.9) 1 (0.9) Any blinding 331 (58.9) 3 (2.7) Intervention Chloroquines 132 (23.5) 11 (9.8) Biologicals 177 (31.5) 60 (53.6) Convalescent plasma 30 (5.4) 18 (16.1) Tocilizumab 21 (3.7) 6 (5.4) Tyrosine kinase inhibitor 20 (3.6) 12 (10.7) Antivirals 55 (9.8) 1 (0.9) Remdesevir 9 (1.6) 0 a Nonrandomized trials included both single-group Protease inhibitors 37 (6.8) 1 (0.9) and nonrandomized multiple-group trials. Antibiotics 49 (8.7) 5 (4.5) Blinding included single, double, triple, and Azithromycin 40 (7.1) 4 (3.6) quadruple blinding. Primary end point Interventions were counted independently as many trials included multiple interventions. Time to symptom and sign resolution 212 (37.7) 51 (45.5) Chloroquines included hydroxychloroquine and Mortality 180 (32.0) 23 (20.5) chloroquine. Viral clearance 124 (22.1) 16 (14.3) Primary end points were counted independently Need for mechanical ventilation 57 (10.1) 5 (4.5) because many trials included multiple primary Industry sponsorship 175 (31.1) 19 (17.0) end points. JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 2/4 JAMA Network Open | Statistics and Research Methods Characteristics of the Randomized Clinical Trials for COVID-19 Launched During the Pandemic that this target will be achieved given the intrinsic challenges of participant accrual during an active pandemic. Notably, our study is limited through the use of a single US-based clinical trials registry, potentially representing only a fraction of the worldwide COVID-19–related trials portfolio. Furthermore, the ever-changing landscape of COVID-19 clinical research amid this pandemic may complicate future interpretation of this report. Although current trials have been initiated with the best intentions, the medical community must be mindful of the potential issues of incomplete participant accrual and publication bias that are introduced by enabling dozens of similar trials simultaneously. Together, these factors endanger the capacity to rapidly produce meaningful evidence that is vital during this critical time. Avoiding these pitfalls requires coordination of efforts. This could be achieved, in part, through makeshift cooperative groups to improve participant accrual and decrease duplicative efforts. Institutional review boards and regulators (including the US Food and Drug Administration) must also work together to responsibly ease roadblocks to coordinate pooled analyses across trials. These efforts should include synchronization and standardization of end points, focusing on the most meaningful and objective outcomes (eg, all-cause mortality, intensive care unit admission, and mechanical ventilation). It is hoped that these measures will expedite generation of high-quality prospective data to guide effective treatments while maximizing resource allocation. ARTICLE INFORMATION Accepted for Publication: June 15, 2020. Published: July 13, 2020. doi:10.1001/jamanetworkopen.2020.15100 Open Access: This is an open access article distributed under the terms of the CC-BY License.©2020KouzyRetal. JAMA Network Open. Corresponding Authors: Ethan B. Ludmir, MD, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Unit 1422, Houston, TX 77030 (ebludmir@mdanderson.org); Cullen M. Taniguchi, MD, PhD, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Unit 1050, Houston, TX 77030 (ctaniguchi @mdanderson.org). Author Affiliations: The University of Texas MD Anderson Cancer Center, Houston. Author Contributions: Drs Kouzy and Ludmir had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Drs Kouzy and Abi Jaoude contributed equally as first authors. Drs Taniguchi and Ludmir contributed equally as senior authors. Concept and design: Kouzy, Abi Jaoude, Taniguchi, Ludmir. Acquisition, analysis, or interpretation of data: Kouzy, Abi Jaoude, Garcia Garcia, El Alam, Ludmir. Drafting of the manuscript: Kouzy, Abi Jaoude, Garcia Garcia, Taniguchi, Ludmir. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: Kouzy, Abi Jaoude, Garcia Garcia, El Alam, Ludmir. Obtained funding: Abi Jaoude, Taniguchi. Administrative, technical, or material support: Abi Jaoude, Taniguchi. Supervision: Abi Jaoude, Taniguchi, Ludmir. Conflict of Interest Disclosures: Ms Garcia Garcia reported receiving support from the National Institute of Diabetes and Digestive and Kidney Diseases of the National Institutes of Health (NIH) (award number F31DK121384). Dr Taniguchi reported receiving supported from the NIH (award R01CA227517-01A1), Cancer Prevention & Research Institute of Texas (grant RR140012), V Foundation (grant V2015-22), the Kimmel Foundation, Sabin Family Foundation Fellowship, and the McNair Foundation and reported being a member of the clinical advisory board of Accuray outside the submitted work. No other disclosures were reported. REFERENCES 1. Goodman JL, Borio L. Finding effective treatments for COVID-19: scientific integrity and public confidence in a time of crisis. JAMA. 2020;323(19):1899-1900. doi:10.1001/jama.2020.6434 JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 3/4 JAMA Network Open | Statistics and Research Methods Characteristics of the Randomized Clinical Trials for COVID-19 Launched During the Pandemic 2. Kalil AC. Treating COVID-19: off-label drug use, compassionate use, and randomized clinical trials during pandemics. JAMA. 2020;323(19):1897-1898. doi:10.1001/jama.2020.4742 3. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-269. doi:10.7326/0003-4819-151-4- 200908180-00135 4. Prasad V, Booth CM. Multiplicity in oncology randomised controlled trials: a threat to medical evidence? Lancet Oncol. 2019;20(12):1638-1640. doi:10.1016/S1470-2045(19)30744-2 5. Reuters. China trial of Gilead’s potential coronavirus treatment suspended. Published April 15, 2020. Accessed April 16, 2020. https://www.reuters.com/article/us-health-coronavirus-gilead-remdesivir/china-trial-of-gileads- potential-coronavirus-treatment-suspended-idUSKCN21X2A2 6. London AJ, Omotade OO, Mello MM, Keusch GT. Ethics of randomized trials in a public health emergency. PLoS Negl Trop Dis. 2018;12(5):e0006313. doi:10.1371/journal.pntd.0006313 JAMA Network Open. 2020;3(7):e2015100. doi:10.1001/jamanetworkopen.2020.15100 (Reprinted) July 13, 2020 4/4

Journal

JAMA Network OpenAmerican Medical Association

Published: Jul 13, 2020

There are no references for this article.