This article appears in the following Journal of Antimicrobial Chemotherapy issue: The British Society for Antimicrobial Chemotherapy Resistance Surveillance Project 1999/2000-2006/7 [View the issue table of contents]
Articles |
Analysis, power and design of antimicrobial resistance surveillance studies, taking account of inter-centre variation and turnover
1 Department of Medical Microbiology, Southmead Hospital, Southmead Road, Bristol BS10 5NB, UK 2 Centre for Biostatistics and Genetic Epidemiology, Department of Health Sciences, University of Leicester, 2nd Floor Adrian Building, University Road, Leicester LE1 7RH, UK
* Corresponding author. Tel: +44-117-959-4080; Fax: +44-117-959-3154; E-mail: rreynolds{at}bsac.org.uk
Objectives: Logistic regression is commonly used to analyse resistance surveillance studies, but variation between collecting centres undermines its assumption that isolates are independent. We studied the impact of this problem and the ability of alternative methods to overcome it. We also investigated different study designs and estimated the statistical power of the BSAC Resistance Surveillance Programmes.
Methods: We simulated datasets with various combinations of study design, inter-centre variation, annual centre turnover, initial resistance level and odds ratio, and analysed 1000 repetitions of each for trends in resistance by five variants of logistic regression.
Results: Traditional analysis by unadjusted logistic regression was invalid because it gave very high type 1 (false-positive) error rates, up to 49%, in the presence of high levels of inter-centre variation and turnover. Of the other methods investigated, logistic regression with random effects for centre performed best: it had appropriate error rates for all study designs assessed and generally had higher power than fixed-effects or cluster-robust approaches. A ‘Diffuse’ study with more centres contributing fewer isolates was less susceptible to the ill-effects of inter-centre variation than a study of equal overall size with fewer centres contributing more, and had slightly higher power.
Conclusions: Unadjusted logistic regression, ignoring inter-centre variation, is unsuitable for the analysis of trends in typical resistance surveillance studies, often leads to erroneous conclusions and should be avoided. Random effects logistic regression is an appropriate, widely applicable alternative, available in most standard statistical software. Collecting isolates from a larger number of centres has both statistical and scientific advantages.
Keywords: trend , random effects model , simulation , type 1 error , statistical analysis
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  R. Reynolds Antimicrobial resistance in the UK and Ireland J. Antimicrob. Chemother., September 1, 2009; 64(suppl_1): i19 - i23. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Reynolds, R. Hope, L. Williams, and on behalf of the BSAC Working Parties on Resistanc Survey, laboratory and statistical methods for the BSAC Resistance Surveillance Programmes J. Antimicrob. Chemother., November 1, 2008; 62(suppl_2): ii15 - ii28. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. M. Livermore, R. Hope, G. Brick, M. Lillie, R. Reynolds, and on behalf of the BSAC Working Parties on Resistanc Non-susceptibility trends among Enterobacteriaceae from bacteraemias in the UK and Ireland, 2001-06 J. Antimicrob. Chemother., November 1, 2008; 62(suppl_2): ii41 - ii54. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. F. J. Brown, R. Hope, D. M. Livermore, G. Brick, K. Broughton, R. C. George, R. Reynolds, and on behalf of the BSAC Working Parties on Resistanc Non-susceptibility trends among enterococci and non-pneumococcal streptococci from bacteraemias in the UK and Ireland, 2001-06 J. Antimicrob. Chemother., November 1, 2008; 62(suppl_2): ii75 - ii85. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. J. Farrell, D. Felmingham, J. Shackcloth, L. Williams, K. Maher, R. Hope, D. M. Livermore, R. C. George, G. Brick, S. Martin, et al. Non-susceptibility trends and serotype distributions among Streptococcus pneumoniae from community-acquired respiratory tract infections and from bacteraemias in the UK and Ireland, 1999 to 2007 J. Antimicrob. Chemother., November 1, 2008; 62(suppl_2): ii87 - ii95. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
I. Morrissey, K. Maher, L. Williams, J. Shackcloth, D. Felmingham, R. Reynolds, and on behalf of the BSAC Working Parties on Resistanc Non-susceptibility trends among Haemophilus influenzae and Moraxella catarrhalis from community-acquired respiratory tract infections in the UK and Ireland, 1999-2007 J. Antimicrob. Chemother., November 1, 2008; 62(suppl_2): ii97 - ii103. [Abstract] [Full Text] [PDF]
|
|