JAC Advance Access originally published online on November 28, 2006
Journal of Antimicrobial Chemotherapy 2007 59(2):175-183; doi:10.1093/jac/dkl477
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Systematic review |
Colorimetric redox-indicator methods for the rapid detection of multidrug resistance in Mycobacterium tuberculosis: a systematic review and meta-analysis
Mycobacteriology Unit, Institute of Tropical Medicine Nationalestraat 155, 2000 Antwerp, Belgium
*Corresponding author. Tel: +32-3-2476334; Fax: +32-3-2476333; E-mail: amartin{at}itg.be
Received 20 August 2006; returned 23 September 2006; revised 27 October 2006; accepted 29 October 2006
| Abstract |
|---|
|
|
|---|
Objectives: With the spread of multidrug-resistant tuberculosis (MDR-TB) there is increasing demand for new accurate and cost-effective tools for rapid drug susceptibility testing (DST), particularly for developing countries. The reference standard method used today for DST is very slow and cumbersome. Colorimetric assays using redox indicators have been proposed to be used in low-resource countries as rapid alternative culture methods for the detection of resistance especially to rifampicin and isoniazid. These methods appear as promising new tools but their accuracy has not been systematically evaluated.
Methods: We did a meta-analysis to evaluate the accuracy of the colorimetric assays for the detection of rifampicin and isoniazid-resistant tuberculosis among clinical isolates. We searched Medline, PubMed (NCBI), Global health-CAB, EJS-E (EbscoHost), ISI Web, Web of Science and IFCC databases and contacted authors if additional information was needed.
Results: Eighteen studies met our inclusion criteria for rifampicin resistance detection and 16 for isoniazid. We used a summary receiver operating characteristic (SROC) curve to perform meta-analysis and summarize diagnostic accuracy. For both drugs, all studies had a sensitivity and specificity that ranged between 89% and 100%.
Conclusions: There is evidence that colorimetric methods are highly sensitive and specific for the rapid detection of MDR-TB. These new tools could offer affordable technologies for TB laboratories especially in places where resources are limited and where the prevalence of MDR-TB is important and make TB control efforts more effective. Additional studies are needed in high MDR prevalence countries and cost-effectiveness analysis to have more evidence on the utility of these methods. Future developments to detect resistance directly from smear-positive sputum specimens should be taken into consideration to speed up the process.
Keywords: DST , MDR-TB , Alamar blue , resazurin , MTT
| Introduction |
|---|
|
|
|---|
Tuberculosis is a major public health problem, particularly in developing countries and multidrug-resistant strains of Mycobacterium tuberculosis (MDR-TB), defined as resistance to at least rifampicin and isoniazid, constitute a serious problem for the efficacy of TB control programmes.1 With the spread of MDR-TB there is increasing demand for new accurate tools for rapid drug susceptibility testing (DST). Conventional tests for the detection of drug resistance are slow and cumbersome. Laboratory diagnosis is complicated by the fastidious growth requirements of the bacillus. For reference laboratories in high-burden countries, culture is the first step to perform DST. Current conventional methods for DST include the proportion method (PM), the absolute concentration method, the resistance ratio method and the radiometric BACTEC.25 The classical Löwenstein-Jenssen (LJ) or the agar-based medium requires a minimum of 36 weeks to produce definitive results.24 The commercial liquid-medium BACTEC 460-TB reduces the turnaround time (TAT) but is expensive and places higher demands on equipment to be routinely used in poor-resource countries.5,6
During recent years, a number of studies have evaluated the accuracy of colorimetric methods using different growth indicators for detecting especially rifampicin and isoniazid resistance in M. tuberculosis in diverse geographical settings. These methods are faster than the conventional DST method. Colorimetric methods are based on the reduction of a coloured indicator added to the culture medium after M. tuberculosis has been exposed in vitro to different antibiotics. Resistance is detected by a change in colour of the indicator, which is directly proportional to the number of viable mycobacteria in the medium.710 Different indicators have been evaluated giving comparable results in agreement with the reference standard PM. Among the different growth indicators used are the tetrazolium salts: XTT [2,3-bis(2-methoxy-4-nitro-5-sulfophenyl)-2H-tetrazolium-5-carboxanilide] and MTT [3(4,5-dimethylthiazol-2-yl)-2,5-diphenyltetrazoliumbromide] and the redox indicators Alamar blue and resazurin.
Figure 1 shows a diagram of the microtitre plate assay to perform DST: different concentrations of rifampicin and isoniazid are prepared directly on the plate for MIC determination, and then the bacteria suspension is incubated with the drugs for a few days, followed by the addition of the redox-indicator and visual reading. The most common indicators used to perform the colorimetric assay are: Alamar blue, MTT and resazurin, and no differences in results using these indicators have been observed.
|
We conducted a systematic review to evaluate the overall accuracy of the colorimetric assays in the detection of rifampicin and isoniazid-resistant TB using a summary receiver operating characteristic (SROC) curve and the area under the curve (AUC) which represents the performance of a diagnostic test based on data from a meta-analysis. The Q* index was used to define the point on the SROC curve where sensitivity and specificity are equal. Systematic reviews of primary studies are becoming important for summarizing evidence about the accuracy of diagnostic tests.11
| Methods |
|---|
|
|
|---|
Search strategy
Data for this review were identified by searches of Medline, PubMed (NCBI), Global health-CAB, EJS-E (EbscoHost), ISI Web, Web of Science and IFCC databases. Search terms (free text, keywords) were Mycobacterium tuberculosis, tuberculosis drug susceptibility, rifampicin, isoniazid colorimetric Alamar blue, resazurin, MTT, redox indicator for papers published in English from 1966 onwards. All retrieved titles and abstracts were scrutinized for relevant studies about DST of M. tuberculosis using the colorimetric methods (MTT, Alamar blue, resazurin or other indicators). In a first step, we did not exclude any study on the basis of a small sample size or not enough data reported.
Study selection
The search through electronic databases returned 28 studies using different kinds of indicator for the rapid detection of rifampicin and isoniazid resistance in M. tuberculosis.
We included studies that met the following pre-determined criteria: comparison of the colorimetric assay with a reference standard method12 (including PM on LJ or Middlebrook agar medium and radiometric BACTEC 460-TB method). Two independent reviewers examined the titles and the abstracts of all identified studies to confirm they had fulfilled the above-defined inclusion criteria. We did not consider studies that did not compare the assay with a reference standard method1317 or compared the assay with a method not accepted as reference standard method such as the Alamar blue,18,19 and viability studies using only the reference strain2023 were not included in this review. Two studies24,25 where the authors used spectrophotometric reading to measure the optical density units (RODU) of the assays instead of a visual reading were also excluded. One study performed the test directly with smear-positive sputum26 and was not considered in this analysis. The heterogeneity of data was addressed by performing a subgroup analysis with the different redox indicators used. Eighteen reported studies for rifampicin and 16 for isoniazid met eligibility criteria and were included in this review.
Data extraction
Two reviewers independently identified the eligible studies that had fulfilled the above criteria. Data of each article were extracted by one reviewer and a sample of these was assessed by a second reviewer to check accuracy in data extraction. We classified data according to the following parameters included in Tables 1 and 2: the indicator used in the assay, the number of isolates tested, the reference standard method used, the sample size, the outcome data (sensitivity and specificity as determined by comparison with the reference standard), the TAT that evaluates the speed of the colorimetric assay which means in how many days results were available.
|
|
Data synthesis and meta-analysis
We used standard methods for the diagnostic meta-analysis and performed data analysis using the Meta-DiSc software (version 1.4).27
We focused on sensitivity and specificity as measures of diagnostic accuracy of the colorimetric assay. For each article, we created a two by two table of the colorimetric assay rifampicin and isoniazid susceptibility results and cross-tabulated. Sensitivity (true positive rate, TPR) was defined as the proportion of isolates determined to be rifampicin or isoniazid resistant by the reference method correctly identified as rifampicin or isoniazid resistant by the colorimetric method. Specificity (true negative rate or false positive rate, FPR) was defined as the proportion of isolates determined to be rifampicin or isoniazid susceptible by the reference method correctly identified as rifampicin or isoniazid susceptible by the colorimetric method.
We created a forest plot to estimate the accuracy of each test. The receiver operating characteristic (ROC) curve is well established as a method of summarizing the performance of a diagnostic test within a single study. It indicates the relationship between the TPR and the FPR of the test. The SROC curve is similar to the ROC curve for a single study except that the data points for the SROC curve are obtained from a set of studies being used for an overview and meta-analysis. The AUC represents an overall summary of the performance of a test. AUC ranges from 1 for a perfect test that always correctly diagnoses, to 0 for a test that never correctly diagnoses. The Q* index represents a summarization of test performance where sensitivity and specificity are equal.28,29
Quality assessment of included studies
The quality assessment of individual studies was performed by using the QUADAS tool.30 See Tables S1 and S2 [available as Supplementary data at JAC Online (http://jac.oxfordjournals.org/)]
| Results |
|---|
|
|
|---|
Detection of rifampicin resistance
Table 1 describes the characteristics of the 18 included studies for the detection of rifampicin resistance. All studies tested the colorimetric assay on culture isolates. Four studies37,3941 are listed twice because the authors tested two different colorimetric indicators and data were extracted and analysed separately. The reference standard method used to compare the assay was either the BACTEC TB-460 or the PM on LJ medium or Middlebrook agar medium. Only two studies31,43 used the radiometric BACTEC 460-TB system as a reference standard.
Figure 2 illustrates a forest plot that estimates the sensitivity and specificity based on results of the 18 included studies. Figure 3 is a SROC curve of the same data. Of the 18 studies, 11 studies reported sensitivity and specificity of 100%, 4 studies >95%, 2 studies >90% and only 1 study reported sensitivity of 89% and specificity of 98%.
|
|
The SROC curve shows an AUC of 0.99 and Q* of 0.97, indicating a high level of overall accuracy.
Detection of isoniazid resistance
Table 2 describes the characteristics of the 16 included studies for the detection of isoniazid resistance. In this case, three studies3941 are listed twice because the authors tested two different colorimetric indicators and data were extracted and analysed separately. Figure 4 illustrates a forest plot that estimates the sensitivity and specificity based on results of the 16 included studies. Figure 5 is a SROC curve of the same data. Of the 16 studies, 4 reported sensitivity and specificity of 100%, 8 studies >95%, 2 studies >90%. One additional study reported sensitivity of 99% and specificity of 89% while another, sensitivity of 100% and specificity of 88%.
|
|
The SROC curve shows an AUC of 0.99 and Q* of 0.97, indicating a high level of overall accuracy.
Colorimetric method performed directly on sputum
We found only one study that tested the colorimetric assay directly on smear-positive clinical specimens for the rapid detection of rifampicin resistance using MTT as indicator. This study showed a sensitivity and specificity of 98.5%.26
| Discussion |
|---|
|
|
|---|
The immediate goal of DST in tuberculosis is the early detection of drug resistance, especially to rifampicin and isoniazid, the two most effective drugs currently available for the treatment of the disease. This allows the early detection of MDR-TB and a better management and treatment of patients. Many developing countries have serious difficulties for obtaining drug susceptibility information on M. tuberculosis isolates due to financial or technical constraints. Conventional DST such as the PM on LJ or agar and the BACTEC TB-460 system are time-consuming or need expensive material. This meta-analysis suggests that the colorimetric methods are highly sensitive and specific for the rapid detection of rifampicin and isoniazid resistance in culture isolates. The majority of the studies have a sensitivity of 95%. Although one of the studies40 provided one-quarter of the pooled results, it did not affect the overall accuracy of the analysis (data not shown).
We are confident that our review did not miss any major study recorded in the databases searched. The limitation was the language search since we excluded studies not available in English, which could introduce a bias.
All studies reported the TAT to demonstrate that the colorimetric assays are rapid methods. The average time to have first results was between 7 and 14 days compared with the reference standard method which takes 36 weeks. The colorimetric assays are performed on culture isolates, this means that a primary isolation is needed to do the test requiring a minimum of 26 extra weeks.
All studies gave similar conclusions in the effort for their implementation in countries with limited resources. These methods can be useful to identify patient populations in which MDR-TB is strongly suspected.
Preliminary calculations indicate that the costs of the colorimetric methods are in the same order of the reference PM.
The overall quality of the included studies was good according to the analysis performed with the QUADAS tool30 recently described for the assessment of studies of diagnostic accuracy. Additional studies are needed to establish the cost-effectiveness of the colorimetric assays over the conventional method. Studies are also needed to measure the performance of the test in countries with a high prevalence of MDR-TB. Finally, additional research is needed to establish the accuracy of the colorimetric methods applied directly to clinical specimens since only one study is reported in the literature. It will save a great deal of time if tests for MDR-TB can be performed directly on sputum samples.
| Transparency declarations |
|---|
|
|
|---|
Conflicts of interest: none declared.
| Supplementary data |
|---|
|
|
|---|
Tables S1 and S2, and a colour version of Figure 1 are available as Supplementary data at JAC Online (http://jac.oxfordjournals.org/).
| Acknowledgements |
|---|
We thank Joris Menten for his advice in statistical analysis. This study was supported in part by the EC LIFESCHIHEALTH-3 (project LSHP-CT-2004-516028) and by the Damien Foundation, Brussels, Belgium.
| References |
|---|
|
|
|---|
1 World Health Organization. (2004) Anti-tuberculosis Drug Resistance in the World: Report No. 3. Prevalence and Trends. The WHO/IUATLD Global Project on Anti-tuberculosis Drug Resistance Surveillance. WHO/HTM/TB/2004.343. Geneva, Switzerland: WHO.
2 Canetti G, Fox W, Khomenko A, et al. (1969) Advances in techniques of testing mycobacterial drug sensitivity, and the use of sensitivity tests in tuberculosis control programmes. Bull World Health Organ 41:2143.[Web of Science][Medline]
3 Canetti G, Froman S, Grosset J, et al. (1963) Mycobacteria: laboratory methods for testing drug sensitivity and resistance. Bull World Health Organ 29:56578.[Web of Science][Medline]
4 Kent PT and Kubica GP. (1985) Public Health Mycobacteriology. A Guide for the Level III Laboratory(US Department of Health and Human Services, Centers for Disease Control and Prevention, Atlanta).
5 Heifets LB and Cangelosi GA. (1999) Drug susceptibility testing of Mycobacterium tuberculosis: a neglected problem at the turn of the century. Int J Tuberc Lung Dis 3:56481.[Web of Science][Medline]
6
Palomino JC. (2005) Nonconventional and new methods in the diagnosis of tuberculosis: feasibility and applicability in the field. Eur Respir J 26:33950.
7 Liu D. (1981) A rapid biochemical test for measuring chemical toxicity. Bull Environ Contam Toxicol 26:1459.[CrossRef][Web of Science][Medline]
8 Tengerdy RP, Nagy JG, Martin B. (1967) Quantitative measurement of bacterial growth by the reduction of tetrazolium salts. Appl Microbiol 15:9545.[Web of Science][Medline]
9 Ali-Vehmas T, Louhi M, Sandholm M. (1991) Automation of the resazurin reduction test using fluorometry of microtitration trays. Zentralbl Veterinarmed B 38:35872.[Medline]
10 Yajko DM, Madej JJ, Lancaster MV, et al. (1995) Colorimetric method for determining MICs of antimicrobial agents for Mycobacterium tuberculosis. J Clin Microbiol 33:23247.[Abstract]
11 Walter SD. (2002) Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data. Stat Med 21:123756.[CrossRef][Web of Science][Medline]
12 World Health Organization. (2003) Guidelines for Surveillance of Drug Resistance in Tuberculosis (WHO/CDS/CSR/RMD/2003.3). Geneva, WHO.
13 Kumar M, Khan IA, Verma V, et al. (2005) Rapid, inexpensive MIC determination of Mycobacterium tuberculosis isolates by using microplate nitrate reductase assay. Diagn Microbiol Infect Dis 53:1214.[CrossRef][Web of Science][Medline]
14 Pracharktam R, Angkananukool K, Vibhagool A. (2001) In vitro susceptibility testing of levofloxacin and ofloxacin by microtiter plate Alamar blue against multidrug and non-multidrug resistant Mycobacterium tuberculosis in Thailand. J Med Assoc Thai 84:12415.[Medline]
15 Sungkanuparph S, Pracharktam R, Thakkinstian A, et al. (2002) Correlation between susceptibility of Mycobacterium tuberculosis by microtiter plate alamar blue assay and clinical outcomes. J Med Assoc Thai 85:8204.[Medline]
16 Kumar RA, Laiza Paul K, Indulaskshimi R, et al. (2001) Analysis of drug susceptibility in Mycobacterium tuberculosis isolated from Thiruvananthapuram using Alamar Blue. Curr Sci 80:703.
17
Caviedes L, Lee TS, Gilman RH, et al. (2000) Rapid, efficient detection and drug susceptibility testing of Mycobacterium tuberculosis in sputum by microscopic observation of broth cultures. The Tuberculosis Working Group in Peru. J Clin Microbiol 38:12038.
18
Caviedes L, Delgado J, Gilman RH. (2002) Tetrazolium microplate assay as a rapid and inexpensive colorimetric method for determination of antibiotic susceptibility of Mycobacterium tuberculosis. J Clin Microbiol 40:18734.
19
Moore DA, Mendoza D, Gilman RH, et al. (2004) Microscopic observation drug susceptibility assay, a rapid, reliable diagnostic test for multidrug-resistant tuberculosis suitable for use in resource-poor settings. J Clin Microbiol 42:44327.
20 Collins L and Franzblau SG. (1997) Microplate alamar blue assay versus BACTEC 460 system for high-throughput screening of compounds against Mycobacterium tuberculosis and Mycobacterium avium. Antimicrob Agents Chemother 41:10049.[Abstract]
21
Mshana RN, Tadesse G, Abate G, et al. (1998) Use of 3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyl tetrazolium bromide for rapid detection of rifampin-resistant Mycobacterium tuberculosis. J Clin Microbiol 36:121419.
22 Abate G, Mshana RN, Miörner H. (1998) Evaluation of a colorimetric assay based on 3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyl tetrazolium bromide (MTT) for rapid detection of rifampicin resistance in Mycobacterium tuberculosis. Int J Tuberc Lung Dis 2:101116.[Web of Science][Medline]
23 De Logu A, Uda P, Pellerano ML, et al. (2001) Comparison of two rapid colorimetric methods for determining resistance of Mycobacterium tuberculosis to rifampin, isoniazid, and streptomycin in liquid medium. Eur J Clin Microbiol Infect Dis 20:339.[CrossRef][Web of Science][Medline]
24 De Logu A, Pellerano ML, Sanna A, et al. (2003) Comparison of the susceptibility testing of clinical isolates of Mycobacterium tuberculosis by the XTT colorimetric method and the NCCLS standards method. Int J Antimicrob Agents 21:24450.[CrossRef][Web of Science][Medline]
25 De Logu A, Borgna R, Uda P, et al. (2003) The 2,3-bis(2-methoxy-4-nitro-5-sulfophenyl)-2H-tetrazolium-5-carboxanilide (XTT) assay as rapid colorimetric method for determination of antibiotic susceptibility of clinical Mycobacterium tuberculosis isolates in liquid medium. Clin Lab 49:35765.[Medline]
26
Abate G, Aseffa A, Selassie A, et al. (2004) Direct colorimetric assay for rapid detection of rifampin-resistant Mycobacterium tuberculosis. J Clin Microbiol 42:8713.
27 Zamora J, Abraira V, Muriel A, et al. (2006) Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 6:31.[CrossRef][Medline]
28 Walter SD and Macaskill P. (2004) SROC Curve. Encyclopedia of Biopharmaceutical Statistics(Marcel Dekker, New York).
29 Walter SD. (2005) The partial area under the summary ROC curve. Stat med 24:202540.[CrossRef][Web of Science][Medline]
30 Whiting P, Rutjes AW, Reitsma JB, et al. (2003) The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 3:25.[CrossRef][Medline]
31
Franzblau SG, Witzig RS, McLaughlin JC, et al. (1998) Rapid, low-technology MIC determination with clinical Mycobacterium tuberculosis isolates by using the microplate Alamar Blue assay. J Clin Microbiol 36:3626.
32 Palomino JC and Portaels F. (1999) Simple procedure for drug susceptibility testing of Mycobacterium tuberculosis using a commercial colorimetric assay. Eur J Clin Microbiol Infect Dis 18:3803.[CrossRef][Web of Science][Medline]
33 Foongladda S, Roengsanthia D, Arjrattanakool W, et al. (2002) Rapid and simple MTT method for rifampicin and isoniazid susceptibility testing of Mycobacterium tuberculosis. Int J Tuberc Lung Dis 6:111822.[Web of Science][Medline]
34
Palomino JC, Martin A, Camacho M, et al. (2002) Resazurin microtiter assay plate: simple and inexpensive method for detection of drug resistance in Mycobacterium tuberculosis. Antimicrob Agents Chemother 46:27202.
35 Luna-Herrera J, Martinez-Cabrera G, Parra-Maldonado R, et al. (2003) Use of receiver operating characteristic curves to assess the performance of a microdilution assay for determination of drug susceptibility of clinical isolates of Mycobacterium tuberculosis. Eur J Clin Microbiol Infect Dis 22:217.[Web of Science][Medline]
36
Banfi E, Scialino G, Monti-Bragadin C. (2003) Development of a microdilution method to evaluate Mycobacterium tuberculosis drug susceptibility. J Antimicrob Chemother 52:796800.
37
Lemus D, Martin A, Montoro E, et al. (2004) Rapid alternative methods for detection of rifampicin resistance in Mycobacterium tuberculosis. J Antimicrob Chemother 54:1303.
38
Reis RS, Neves I Jr, Lourenco SL, et al. (2004) Comparison of flow cytometric and Alamar Blue tests with the proportional method for testing susceptibility of Mycobacterium tuberculosis to rifampin and isoniazid. J Clin Microbiol 42:22478.
39
Montoro E, Lemus D, Echemendia M, et al. (2005) Comparative evaluation of the nitrate reduction assay, the MTT test, and the resazurin microtitre assay for drug susceptibility testing of clinical isolates of Mycobacterium tuberculosis. J Antimicrob Chemother 55:5005.
40 Martin A, Morcillo N, Lemus D, et al. (2005) Multicenter evaluation of colorimetric assays using MTT and resazurin for rapid susceptibility testing of Mycobacterium tuberculosis to first-line drugs. Int J Tuberc Lung Dis 9:9016.[Web of Science][Medline]
41 da Silva PA, Boffo M, Mattos I, et al. (2005) Comparison of Redox and D29 phage methods for detection of isoniazid and rifampicin resistance in Mycobacterium tuberculosis. Clin Microbiol Infect 12:2858.[CrossRef]
42
Nateche F, Martin A, Baraka S, et al. (2006) Application of the resazurin microtitre assay for detection of multidrug resistance in Mycobacterium tuberculosis in Algiers. J Med Microbiol 55:85760.
43 Coban AY, Cekic Cihan C, Bilgin K, et al. (2006) Rapid susceptibility test for Mycobacterium tuberculosis to isoniazid and rifampin with resazurin method in screw-cap tubes. J Chemother 18:1403.[Web of Science][Medline]
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
A. I. de la Iglesia, E. J. Stella, and H. R. Morbidoni Comparison of the Performances of Two In-House Rapid Methods for Antitubercular Drug Susceptibility Testing Antimicrob. Agents Chemother., February 1, 2009; 53(2): 808 - 810. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Leonard, J. Coronel, M. Siedner, L. Grandjean, L. Caviedes, P. Navarro, R. H. Gilman, and D. A. J. Moore Inter- and Intra-Assay Reproducibility of Microplate Alamar Blue Assay Results for Isoniazid, Rifampicin, Ethambutol, Streptomycin, Ciprofloxacin, and Capreomycin Drug Susceptibility Testing of Mycobacterium tuberculosis J. Clin. Microbiol., October 1, 2008; 46(10): 3526 - 3529. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||






