JAC Advance Access originally published online on March 26, 2007
Journal of Antimicrobial Chemotherapy 2007 59(5):990-995; doi:10.1093/jac/dkm014
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Successful use of feedback to improve antibiotic prescribing and reduce Clostridium difficile infection: a controlled interrupted time series
1 Academic Department of Geriatrics, Hampstead Campus, Royal Free and University College Medical School, University College, London NW3 2PF, UK 2 Department of Statistics, Modelling and Economics, Health Protection Agency, Centre for Infections, London, UK 3 Department of Pharmacy, Royal Free NHS Trust, Hampstead, London, UK 4 Department of Medical Microbiology, Royal Free Hampstead NHS Trust, London, UK
* Corresponding author. Tel: +44-7801258061; Fax: +44-2078302378; E-mail: s.stone{at}medsch.ucl.ac.uk
Received 31 July 2006; returned 12 September 2006; revised 21 December 2006; accepted 11 January 2007
| Abstract |
|---|
|
|
|---|
Objectives: To investigate the effect of reinforcing a narrow-spectrum antibiotic policy on antibiotic prescription and Clostridium difficile infection (CDI) rates by feedback of antibiotic use to doctors, as part of a departmental audit and feedback programme.
Design: A prospective controlled interrupted time-series (ITS) study, with pre-defined pre- and post-intervention periods, each of 21 months.
Setting: Three acute medical wards for elderly people in a teaching hospital.
Participants: Six thousand one hundred and twenty-nine consecutive unselected acute medical admissions aged
80 years.
Interventions: A narrow-spectrum antibiotic policy (reinforced by an established programme of audit and feedback of antibiotic usage and CDI rates) was introduced, following an unplanned rise in amoxicillin/clavulanate (Augmentin) use. It targeted broad-spectrum antibiotics for reduction (cephalosporins and amoxicillin/clavulanate) and narrow-spectrum antibiotics for increase (benzyl penicillin, amoxicillin and trimethoprim). Changes in the use of targeted antibiotics (intervention group) were compared with those of untargeted antibiotics (control group) using segmented regression analysis. Changes in CDI rates were examined by the Poisson regression model. Methicillin-resistant Staphylococcus aureus (MRSA) acquisition rates acted as an additional control.
Results: There was a reduction in the use of all targeted broad-spectrum antibiotics and an increase in all targeted narrow-spectrum antibiotics, statistically significant for sudden change and/or linear trend. All other antibiotic use remained unchanged. CDI rates fell with incidence rate ratios of 0.35 (0.17, 0.73) (P = 0.009). MRSA incidence did not change [0.79 (0.49, 1.28); P = 0.32].
Conclusions: This is the first controlled prospective ITS study to use feedback to reinforce antibiotic policy and reduce CDI. Multicentre ITS or cluster randomized trials of this and other methods need to be undertaken to establish the most effective means of optimizing antibiotic use and reducing CDI.
Keywords: C. difficile , safety , antibiotic-associated diarrhoea , antibiotic policy , infection control , quality assurance , prescription rates , nosocomial infections , cephalosporins , antibiotic prescription
| Introduction |
|---|
|
|
|---|
Clostridium difficile infection (CDI) is an increasingly common healthcare-associated infection, affecting primarily elderly patients, and is subject to mandatory surveillance in the UK.13 It is a consequence of rising broad-spectrum antibiotic use, such as third-generation cephalosporins and amoxicillin/clavulanate.1 National guidelines recommend narrow-spectrum antibiotic policies13 and suggest a variety of methods to ensure these are implemented, commenting that despite the apparent increased awareness of CDI and its link with antibiotic use, levels of infection are still rising and prescribing behaviour needs to be addressed.1 The Health Care Commission surveyed all NHS Trusts in 2005 and reported that 38% did not restrict broad-spectrum antibiotic use.4 Systematic review of interventions to improve prescribing,5 including those that examine the effect on CDI6 showed that nearly all were poor-quality unplanned studies with no control groups or outcomes and inadequate statistical analysis. Well-designed interrupted time-series (ITS) studies with control outcomes would provide much stronger evidence of the effectiveness of interventions, facilitate synthesis of evidence from different studies and help prioritize interventions for definitive multicentre randomized controlled trials (RCTs).7,8 Systematic reviews9,10 suggest feedback may change healthcare workers' implementation of evidence-based guidelines, although feedback is not mentioned in national guidelines as a way of addressing prescribing behaviour.1 We have previously described the use of feedback in this context11 and now report a subsequent prospective controlled interrupted time-series study, arising from our department's clinical audit programme, which investigated the effect of reinforcing a narrow-spectrum antibiotic policy by feeding back the use of antibiotics and CDI rates to doctors working on acute-care medical wards for the elderly where CDI was endemic.
| Materials and methods |
|---|
|
|
|---|
Setting
Three acute-care wards for the elderly (78 beds), admitting consecutive, unselected general medical emergency admissions over the age of 80 years, where a cephalosporin restrictive antibiotic policy with audit and feedback of antibiotic use and CDI rates was in place to reduce levels of CDI.11
Population, infection control policies and resources and case definitions
Figure 1 gives details of these throughout the study, during which only the antibiotic policies (Figure 2) changed.
|
|
Rationale for the study
From September 1999, use of amoxicillin/clavulanate (an antibiotic not in the department's antibiotic policy) had begun and became commonplace (Figure 3). This was an unplanned change in prescribing practice. The CDI rate had not increased, but in order to prevent a future rise, it was decided, in April 2001, upon routine review of the data in the audit programme, to introduce a new narrow-spectrum antibiotic policy starting in July 2001, without knowing the data from April, May and June 2001, by which time 21 months of data would have been collected, and to evaluate its effect at the end of March 2003, after an equal period of time (21 months) had elapsed.
|
Intervention
The new policy (Figure 2) recommended less use of amoxicillin/clavulanate, increased use of benzyl penicillin, trimethoprim and amoxicillin and further restricting cephalosporin use. There were also prompts for the use of metronidazole, ciprofloxacin and clarithromycin, but these were not targeted for any particular change, nor were flucloxacillin, gentamicin or teicoplanin. Doctors were given a laminated pocket version of the policy to carry and continued to receive feedback, every 812 weeks, of individual antibiotic usage (the number of notional 7 day courses per 100 admissions per month) together with CDI rates (cases per month) and methicillin-resistant Staphylococcus aureus (MRSA) cases (per month). Antibiotic usage was fed back in this format, rather than in defined daily doses per 1000 bed days, to help doctors visualize the percentage of patients treated with individual antibiotics.
The primary outcome was changes in the level and linear trend of prescribing of targeted antibiotics. Changes in untargeted antibiotic use acted as an additional control, strengthening the experimental design.7,8 The secondary outcome was monthly counts of CDI, adjusted for numbers of admissions. MRSA count data (new cases) acted as an additional control, as it was thought unlikely that this would change due to the intervention.
Monthly crude, but not infection specific, mortality was recorded.
Data were collected on the length of stay, alcohol hand-rub use and numbers of admissions, but not on bed-occupancy, staffing levels, agency rates, nor on numbers of inter-ward transfers, admissions from nursing homes or patients admitted with CDI. Case mix and laboratory methods for processing specimens were unaltered. In November 2000, a ward was reopened, explaining the rise in admissions.
Data collection was coordinated by the department's registrars, using routinely collected pharmacy, microbiology, trust, supplies and departmental death audit data, as part of their routine audit responsibility.
The effect of the intervention was assessed using a segmented regression analysis, as described elsewhere,5,7,12,13 to estimate changes between the pre-intervention (September 1999 to June 2001) and intervention phases (July 2001 to March 2003), accounting for both sudden step-wise changes in the level of antibiotic usage and changes in linear trends of antibiotic usage. Residuals of the fitted models indicated substantial heteroskedasticity but no autocorrelation. To obtain robust variance estimates, we therefore used the HuberWhite sandwich estimator. The time series of count data corresponding to CDI and new MRSA acquisitions were analysed by the Poisson regression model to estimate the incidence rate ratio (IRR) associated with the intervention, adjusting for changing numbers of admissions [if
j is the expected number of acquisitions in month j, and ln(
j) = ß0+ß1x1+ln(Aj), where x1 is an the indicator variable taking the value of 1 in the second phase and zero in the first, Aj represents the exposure given by the number of admissions in month j and ß1 are the estimated coefficients of the regression model, then the IRR associated with the intervention is given by exp(ß1)]. Exploratory analysis of the count data with models including exponential trends was also performed. To account for the autocorrelation seen in these time series, we used weighted empirical adaptive variance estimators.14 We considered P values
0.05 to be statistically significant. Analysis was performed in Stata 815 and R 1.7.1.16
This was an audit study and was part of the department's clinical governance programme. It used anonymized confidential routinely collected data, and the new antibiotic policy was discussed with colleagues in the Public Health Laboratory Service and the Royal Free NHS Trust's Infection Control Committee. The policy of our institution is that ethical approval is not required for audit projects.
| Results |
|---|
|
|
|---|
Table 1 shows a reduction in the use of antibiotics targeted for reduction (amoxicillin/clavulanate and cephalosporins), significant for both sudden change in level and continuing long-term linear trend for decreased use. In those targeted for increased use, there was a significant increase in the long-term trend for benzyl penicillin and in sudden change for amoxicillin, which was not reversed long term. For trimethoprim there was no evidence of change, although there was a marked trend for increased use before the intervention, which continued after the intervention. Non-targeted antibiotics acted as a control and showed no evidence of changes in either trend or level post-intervention.
|
The Poisson regression showed a significant fall in CDI associated with the intervention [IRR 0.35 (0.17, 0.73), P = 0.009], but not in MRSA (control outcome) [0.79 (0.49, 1.28); P = 0.32] (Figures 3 and 4). Further modelling, which allowed for exponential trends in the MRSA and CDI incidence, again showed a significant effect on CDI (the best fitting model showed a significant decreasing exponential trend in CDI following the intervention, but no trend before). In contrast, there was no decrease in level or trend for MRSA following the intervention (the best fitting model showed a significant decreasing exponential trend throughout the study, with a sudden step-wise increase immediately following the intervention).
|
Crude mortality was unaltered, fluctuating randomly between 4.7% and 21% each month, with a pre- and post-intervention mean (median) of 14.6% (14.75%) and 13.6% (14.3%) each month. The length of stay fluctuated randomly between 11.93 and 13.53 days each month.
| Discussion |
|---|
|
|
|---|
The main findings of this study were that introduction of a narrow-spectrum antibiotic policy, reinforced by feedback, was associated with significant changes in targeted antibiotics and a significant reduction in CDI. This is the first planned prospective controlled ITS to evaluate an intervention to change antibiotic prescribing and the first to use feedback. It had pre-specified outcomes, a pre-defined endpoint, sufficient time points to allow trend analysis, appropriate statistical analyses and consideration of common potential confounders. In particular, the use of control outcomes unlikely to be affected by the intervention, in addition to the pre-intervention control phase, increases the strength of the evidence by protecting the study against the major threats to the validity of uncontrolled ITS designs.13,17,18 This is because most other changes (such as length of stay, case mix, seasonality, bed-occupancy, staffing levels or use of agency staff), apart from the intervention, which could have caused observed changes in the outcome measures, would also have been expected to affect the control outcomes. This controlled ITS design is therefore considered a strong quasi-experimental design,68,13,17,18 especially for evaluating interventions to change antibiotic use.13 The statistical methods used and the fact that the intervention was part of a planned study and not a response to unusually high infection or antibiotic usage rates protect the study against regression to mean effects, common in ITS studies.6,8,1719 The study design overcomes most weaknesses described in systematic reviews of interventions to improve antibiotic usage4 or to reduce levels of nosocomial infection.6,8,1921 Its reporting is compliant with, and intended to be an exemplar of, the consensus-agreed CONSORT equivalent for infection control studies, the ORION statement (Guidelines for Transparent Reporting of Outbreak Reports and Intervention Studies of Nosocomial Infection).21
Although the use of additional controls excludes most potential confounders as plausible alternative explanations of the fall in CDI, it does not exclude others, in particular, the numbers of patients admitted with CDI from the community. This could not be assessed, as routine microbiological data collection did not allow differentiation of community- and hospital-acquired CDI. However, CDI is considered largely nosocomial,1 and we were unaware of cases admitted with CDI unattributable to a previous admission. It was always possible to isolate cases of CDI, so an excess of unisolated cases in the pre-intervention cannot provide an alternative explanation for its fall in the post-intervention phase. Although we had access to alcohol hand-rub usage, which fluctuated at 4.56 mL per patient-bed-day throughout the study, we had no data on liquid soap usage, which would be more likely to affect CDI rates, as handwashing with soap and water removes C. difficile spores more effectively.22 However we do not think it likely that soap use would have risen sufficiently to effect such a change in CDI rates. The study only examined crude mortality, because of the lack of resources to examine infection-specific mortality such as that due to respiratory and urinary infections. Blinded assessment of this from notes review is hard to organize and depends on the quality of documentation. However, departmental monthly death audits, which independently audited the case notes of all patients who died, did not suggest a rise in deaths from either infection, and we think it is unlikely that this was obscured by a fall in directly attributable deaths from CDI, as the rate of CDI itself was low. The study is also limited by the absence of economic data, as it did not intend to examine cost-effectiveness.
Although we are aware of one other planned prospective ITS study12 that adequately assesses an antibiotic intervention (ward pharmacists successfully reviewing and modifying doctors' prescriptions each day), it did not use an additional control outcome and did not examine microbiological outcomes. Although national guidelines unequivocally report numerous examples of the success of restrictive antibiotic policies in reducing CDI, systematic reviews5,6 show nearly all to be methodologically flawed, with only five studies of sufficient quality for inclusion in the Cochrane systematic review of antibiotic interventions and their effect on microbiological outcomes.5,6 Only one of these showed a reduction in CDI associated with a significant decrease in broad-spectrum antibiotic use, including third-generation cephalosporins, although no specific data are provided on their use. The current study is therefore the best evidence to date that cephalosporin and amoxicillin/clavulanate restriction significantly reduced the use of each and the rate of CDI.
No study has adequately examined the use of feedback to change antibiotic prescribing. Our report is consistent with recent systematic reviews showing feedback helps healthcare workers adhere to clinical guidelines,9,10 a view consistent with current national recommendations,3,4,23 but it is not possible to tell the relative contributions of the laminated card and the feedback, although their combined use was highly effective and may provide a replicable simple intervention for acute care of the elderly units to reduce CDI rates. Given the national priority accorded to surveillance and reduction of CDI, a more virulent form of which has recently been reported,24 the findings are important.
The antibiotics chosen for the policy reflected local antibiotic susceptibilities for the main causative organisms. The use of cephalosporins in the pre-intervention phase was low compared with many hospitals, but the intervention was highly successful and might therefore be even more so in units with higher cephalosporin use.
The impact of interventions may also be dependent on the enthusiasm of local clinicians and, in this respect, the pharmacist review method described earlier12 may be of more general use. Generalizability can only be addressed by further research. The current study design is a strong one, potentially feasible and replicable in many hospitals, which would allow synthesis of results, confirm the reproducibility of the intervention and suggest interventions worth assessing in definitive controlled trials.
| Transparency declarations |
|---|
|
|
|---|
None to declare.
| Acknowledgements |
|---|
We thank Alexandra Wu, Dan Lee and Jacqueline Morris, Consultant Physicians, Department of Health Services for Elderly People, Royal Free NHS Trust, Pond Street, London NW3 2PG, for supporting and implementing the policy.
| References |
|---|
|
|
|---|
1 National Clostridium difficile Standards Group. (2004) Report to Dept Health Feb 2003. J Hosp Infect 56:138.[Web of Science][Medline]
2 Health Protection Agency. (2005) Results of the first year of mandatory Clostridium difficile reporting: January to December 2004. CDR Wkly 15:246.
3 Department of Health 2003. Winning Ways: Working Together to Reduce Healthcare Associated Infection in England www.dh.gov.uk/consultations 2 28 June 2006.
4 Healthcare Commission. Management, Prevention and Surveillance of Clostridium Difficile, 21 Dec 2005 www.healthcarecommission.org.uk 13 December 2006.
5 Davey P, Brown E, Hartman G, et al. (2005) Interventions to improve antibiotic prescribing practices for hospital inpatients. Cochrane Database Syst Rev 4:CD003543.[Medline]
6 Davey P, Brown E, Fenelon L, et al. (2006) Systematic review of antimicrobial drug prescribing in hospitals. Emerg Infect Dis 12:2116.[Web of Science][Medline]
7
Ramsay C, Brown E, Hartman G, et al. (2003) Room for improvement: a systematic review of the quality of evaluations of interventions to improve hospital antibiotic prescribing. J Antimicrob Chemother 52:76471.
8 Cooper BS, Stone SP, Kibbler CC, et al. (2003) Systematic review of isolation policies in the hospital management of methicillin-resistant Staphylococcus aureus: a review of the literature with epidemiological and economic modelling. Health Technol Assess 7:1194.[Medline]
9 Grimshaw J, Thomas R, Maclennan G, et al. (2004) Effectiveness and efficiency of guideline dissemination strategies. Health Technol Assess 8:184.[Medline]
10 Jamtvedt G, Young JM, Kristoffersen DT, et al. (2004) Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Sys Rev 2:CD000259.
11
Stone SP, Beric V, Quick A, et al. (1998) The effect of an enhanced infection-control policy on the incidence of Clostridium difficile infection and methicillin-resistant Staphylocccus aureus colonization on acute elderly medical patients. Age Ageing 27:5618.
12
Ansari F, Gray K, Nathwani D, et al. (2003) Outcomes of an intervention to improve hospital antibiotic prescribing: interrupted time series with segmented regression analysis. J Antimicrob Chemother 52:8428.
13 Wagner AK, Soumerai SB, Zhang F, et al. (2002) Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther 27:299309.[CrossRef][Web of Science][Medline]
14 Lumley T and Heagerty P. (1999) Weighted empirical adaptive variance estimators for correlated data regression. J R Stat Soc Ser B 61:459.[CrossRef]
15 Stata 8. (Stata Corporation, College Station, TX, USA).
16 Ihaka R and Gentleman R. (1996) a language for data analysis graphics. J Comput Graph Stat 5:299314.[CrossRef]
17 Cook TD and Campbell DT. (1979) Quasi Experimentation. Design & Analysis Issues for Field Settings First Edition (Houghton Mifflin Company, Boston, USA) pp. 1405.
18 Harris AD, Bradham DD, Baumgarten M, et al. (2004) The use and interpretation of quasi-experimental studies in infectious diseases. Clin Infect Dis 38:158691.[CrossRef][Web of Science][Medline]
19
Cooper BS, Stone SP, Kibbler CC, et al. (2004) Isolation measures in the hospital management of methicillin resistant Staphylococcus aureus (MRSA): systematic review of the literature. BMJ 329:533.
20 Harris AD, Lautenbach E, Perencevich E. (2005) A systematic review of quasi-experimental study designs in the fields of infection control antibiotic resistance. Clin Infect Dis 41:7782.[CrossRef][Web of Science][Medline]
21 Stone SP, Cooper BS, Kibbler CC, et al. (2007) The ORION statement: guidelines for transparent reporting of outbreak reports and intervention studies of nosocomial infection. J Antimicrob Chemother 57: doi: 10.1093/jac/dkm055.
22 Boyce JM and Pittet D. (2002) Guideline for hand hygiene in health-care settings. Recommendations of the Healthcare Infection Control Practices Advisory Committee and the HICPAC/SHEA/APIC/IDSA Hand Hygiene Task Force. MMWR 51:144.[Medline]
23 National Audit Office. (2000) The Management and Control of Hospital Acquired Infection in Acute NHS Trusts in England. (Stationery Office, London) (www.nao.gov.uk).
24 Health Protection Agency. (2005) Outbreak of Clostridium difficile infection in a hospital in southeast England. CDR Wkly 15:23.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
T. Gouliouris, D. R. Forsyth, and N. M. Brown Clostridium difficile-associated diarrhoea (CDAD): new and contentious issues Age Ageing, September 1, 2009; 38(5): 497 - 500. [Full Text] [PDF] |
||||
![]() |
T Monaghan, T Boswell, and Y R Mahida Recent advances in Clostridium difficile-associated disease Postgrad. Med. J., March 1, 2009; 85(1001): 152 - 162. [Abstract] [Full Text] [PDF] |
||||
![]() |
A S. Walker, D. Spiegelhalter, D. W Crook, D. Wyllie, J. Morris, and T. E A Peto Fairness of financial penalties to improve control of Clostridium difficile BMJ, November 20, 2008; 337(nov20_2): a2097 - a2097. [Full Text] |
||||
![]() |
N. Vernaz, H. Sax, D. Pittet, P. Bonnabry, J. Schrenzel, and S. Harbarth Temporal effects of antibiotic use and hand rub consumption on the incidence of MRSA and Clostridium difficile J. Antimicrob. Chemother., September 1, 2008; 62(3): 601 - 607. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Harbarth and M. H. Samore Interventions to control MRSA: high time for time-series analysis? J. Antimicrob. Chemother., September 1, 2008; 62(3): 431 - 433. [Abstract] [Full Text] [PDF] |
||||
![]() |
T Monaghan, T Boswell, and Y R Mahida Recent advances in Clostridium difficile-associated disease Gut, June 1, 2008; 57(6): 850 - 860. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Davey, S. Garner, and on behalf of the Professional Education Subgroup o Professional education on antimicrobial prescribing: a report from the Specialist Advisory Committee on Antimicrobial Resistance (SACAR) Professional Education Subgroup J. Antimicrob. Chemother., August 1, 2007; 60(suppl_1): i27 - i32. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||








