Sample-size determination and adherence in randomised controlled trials published in anaesthetic journals

  • Editorial Office
  • M Nontshe University of KwaZulu-Natal
  • S Khan University of KwaZulu-Natal
  • T Mandebvu University of KwaZulu-Natal
  • B Merrifield University of KwaZulu-Natal
  • Reitze Rodseth University of KwaZulu-Natal
Keywords: anaesthesia, clinical trial, power calculations, sample size, treatment effect, type II error

Abstract

Background: Sample-size calculations are critical to ensure that randomised control trials return robust and reliable results. The estimated treatment effects used in these calculations is often significantly different from the actual treatment effect and can dramatically impact trial validity.

Methods: This study examined sample-size calculations in randomised controlled trials designed to show superiority between two-arm parallel groups with a single primary outcome that were published in the top five anaesthetic journals for 2014 (as per Thomson Reuters impact factors). In particular, it sought to determine treatment effect estimations used in a priori sample-size calculations and compare them with actual treatment effects.

Results: A PubMed search identified 209 possible articles; 52 were drawn for full text review; and 28 were included in the final analysis. The relative difference between expected and actual event rates was greater than 20% in 80% of trials and greater than 50% in 44% of trials.

Conclusions: Unrealistic assumptions of treatment effects in randomised controlled trials published in anaesthesia journals are common. Trial sample sizes should be calculated thoughtfully and realistically and should be fully reported in both trial protocols and publications. Researchers should be aware of the opportunity cost as well as the possible dangers to patients when unrealistic assumptions are made. Where possible researchers should collaborate to achieve meaningful trial sample sizes to ensure robust clinical findings.

(Full text available online at www.medpharm.tandfonline.com/ojaa)

South Afr J Anaesth Analg 2018; DOI: 10.1080/22201181.2018.1439602

Author Biographies

M Nontshe, University of KwaZulu-Natal
Metropolitan Department of Anaesthetics, Critical Care and Pain Management University of KwaZulu-Natal Pietermaritzburg
S Khan, University of KwaZulu-Natal
Metropolitan Department of Anaesthetics, Critical Care and Pain Management University of KwaZulu-Natal Pietermaritzburg
T Mandebvu, University of KwaZulu-Natal
Metropolitan Department of Anaesthetics, Critical Care and Pain Management University of KwaZulu-Natal Pietermaritzburg
B Merrifield, University of KwaZulu-Natal
Metropolitan Department of Anaesthetics, Critical Care and Pain Management University of KwaZulu-Natal Pietermaritzburg
Reitze Rodseth, University of KwaZulu-Natal
Metropolitan Department of Anaesthetics, Critical Care and Pain Management University of KwaZulu-Natal Pietermaritzburg; and Outcomes Research Consortium Cleveland Clinic Cleveland Ohio United States of America
Published
2018-04-03
Section
Research Articles