- Research article
- Open access
- Published:
N-acetylcysteine supplementation for the prevention of atrial fibrillation after cardiac surgery: a meta-analysis of eight randomized controlled trials
BMC Cardiovascular Disorders volume 12, Article number: 10 (2012)
Abstract
Background
Atrial fibrillation is the most common type of arrhythmia after cardiac surgery. An increasing body of evidence demonstrates that oxidative stress plays a pivotal role in the pathophysiology of atrial fibrillation. N-acetylcysteine (NAC) is a free radical scavenger, and may attenuate this pathophysiologic response and reduce the incidence of postoperative AF (POAF). However, it is unclear whether NAC could effectively prevent POAF. Therefore, this meta-analysis aims to assess the efficacy of NAC supplementation on the prevention of POAF.
Methods
Medline and Embase were systematically reviewed for studies published up to November 2011, in which NAC was compared with controls for adult patients undergoing cardiac surgery. Outcome measures comprised the incidence of POAF and hospital length of stay (LOS). The meta-analysis was performed with the fixed-effect model or random-effect model according to the heterogeneity.
Results
Eight randomized trials incorporating 578 patients provided the best evidence and were included in this meta-analysis. NAC supplementation significantly reduced the incidence of POAF (OR 0.62, 95% CI 0.41 to 0.93; P = 0.021) compared with controls, but had no effect on LOS (WMD -0.07, 95% CI -0.42 to 0.28; P = 0.703).
Conclusions
The prophylactic NAC supplementation may effectively reduce the incidence of POAF. However, the overall quality of current studies is poor and further research should focus on adequately powered randomized controlled trials with POAF incidence as a primary outcome measure.
Background
Postoperative atrial fibrillation (POAF) is the most frequent arrhythmia encountered following cardiac surgery, affecting approximately 25-40% of patients [1–3]. Although the majority of POAF are benign and self-limiting, it has been associated with an increase in both hospital length of stay (LOS) and total hospital costs [1, 2, 4, 5]. The efficacy of pharmacologic interventions on preventing POAF has been extensively researched [6, 7]. Recent guidelines for the prevention and management of POAF were published in 2011 jointly by the American College of Cardiology, the AHA, and the European Society of Cardiology [8]. Nevertheless, none of them are effective for all patients and all of them have significant limitations, the best prophylaxis to prevent POAF remains to be established [9]. Despite the extensive studies, the pathphysiology of POAF are for the moment far from being fully elucidated. In the past few years, a growing body of evidence suggests that oxidative stress has been found to play a pivotal role in the pathophysiology of POAF [10]. Oxidative stress may be one of a possible pathogenesis of POAF [11].
Antioxidant N-acetylcysteine (NAC) seemed a promising and novel measure for the prevention of POAF. In a prospective, randomized, placebo-controlled pilot study in patients undergoing coronary artery bypass and/or valve surgery, NAC significantly reduced the incidence of POAF [12]. However, the results have contrasted in seven other randomized controlled trials [13–19] in which the effectiveness of NAC was assessed in patients undergoing cardiac surgery. We therefore conducted a meta-analysis based on relevant and available randomized controlled trials to assess the efficacy of NAC supplementation on the prevention of POAF for adult patients undergoing cardiac surgery.
Methods
Literature search and selection criteria
A comprehensive search was undertaken to identify all published randomized controlled trials of NAC versus controls during cardiac surgery. Medline and Embase were searched from the date of their inception to November 1, 2011. Search terms included: "N-acetylcysteine", "NAC", "acetylcysteine", "mucomyst" and "cardiac surgery", "cardiothoracic surgery","heart surgery", "cardiopulmonary bypass", "CPB", "coronary artery bypass graft", "CABG", "CAB", "valve surgery", and "valvular surgery". Results were limited to human subjects and randomized controlled trials. We screened the reference lists of included studies and related publications. The results were then hand searched for eligible trials. We did not include abstracts or meeting's proceedings. This search strategy was performed iteratively until no new potential citations could be found on review of the reference lists of retrieved articles.
We included studies in all languages irrespective of blinding when the following inclusion criteria were met: adult patients undergoing cardiac surgery; randomized allocation to NAC group or control group (placebo or routine treatment); and reporting data on the incidence of POAF. Exclusion criteria included age < 18 years old, and known allergy or hypersensitivity to NAC.
Data extraction and quality assessment
Two investigators (Wan-Jie Gu and Zhen-Jie Wu) independently extracted the following information from each study: first author's name, surgery type (coronary artery bypass graft [CABG], valve, or combination surgery), study design (RCT, prospective or not), type of controls (placebo or not), type of blinding (double-blinding or not), NAC regimen, sample size, mean age, percentage male, the incidence of POAF, and length of hospital stay in each group. Disagreements were resolved through discussion and consensus.
The methodological quality of the studies included in the meta-analysis was independently scored by Wan-Jie Gu and Zhen-Jie Wu using validated Jadad 5 point scale. The scale consists of three items describing randomization (0-2 points), masking (0-2 points), and dropouts and withdrawals (0-1 points) in the report of a randomized controlled trial [20]. A score of 1 is given for each of the points described. A further point is obtained where the method of randomization and/or blinding is given and is appropriate; whereas it is inappropriate a point is deducted. Higher scores indicate better reporting.
Statistical analysis
We assessed the overall efficacy of NAC supplementation on the prevention of POAF based on the data from the eight randomized trials. The incidences of POAF were treated as dichotomous variables and were expressed as odds ratio (OR) with 95% CI for each study. LOS was treated as a continuous variable. For comparison of LOS, the weighted mean difference (WMD) with 95% CI was calculated as the difference between the mean values of LOS in treatment and control groups. Pooled estimates of efficacy were calculated using the Man-tel-Haenszel fixed-effects model [21]. If there was heterogeneity, the following methods were used to deal with it: (a) subgroup analysis; (b) sensitivity analysis performed by excluding the trials which potentially biased the results. If the heterogeneity still potentially existed, the DerSimonian and Lair random-effects model was used. A test for heterogeneity, defined as variation among the results of individual trials for a given treatment beyond that expected from chance, was used to assess whether the magnitude of a given treatment effect varied between the trials. We assessed heterogeneity with I2, which describes the percentage of total variation across studies due to heterogeneity rather than chance. I2 can be calculated as: I2 = 100% × (Q-df)/Q(Q = Cochrane's heterogeneity statistics, df = degrees of freedom). Negative values of I2 equaled zero, so that I2 ranged between 0% (ie, no observed heterogeneity) and 100%. High values would show increasing heterogeneity [22]. The presence of publication bias was evaluated by using the Begg and Egger tests [23, 24]. A two-tailed P-value of less than 0.05 was judged as statistically significant. All statistical analyses were performed using Stata version 11 (Stata Corporation, College Station, TX, USA).
Results
Identification of eligible studies
Eighty-three reports were identified by the initial literature retrieval, with limiting to human subjects and randomized controlled trials. Through various means, we accessed all the full texts. After screening the title, abstract and full texts, however, 75 studies were excluded because they did not provide available data. Consequently, the remaining 8 trials (n = 578 patients) provided best evidence and were included in the current meta-analysis [12–19]. The flow chart of search strategy is shown in Figure 1.
Characteristics of eligible studies
The baseline characteristics of the included studies are shown in Table 1 and design characteristics are presented in Table 2. Of the 8 included trials, four were done in Turkey [12–14, 18], two in Canada [15, 17], one in Germany [16], and one in Korea [19]. The number of participants ranged from 20 [13, 14] to 175 [17]. All trials included both men and women. Five studies [13–15, 18, 19] in this meta-analysis enrolled patients undergoing CABG only. The remaining three studies [12, 16, 17] included patients undergoing valvular or combination CABG with valvular surgery, or both. NAC was administered orally and/or intravenously by different regimens and formulations. Seven studies [12–14, 16–19] used an intravenous route to administer NAC during the perioperative period, and one study [15] used an oral dose before surgery followed by intravenous administration postoperatively. The overwhelming majority of studies used weight-based dosing and started NAC just a few hours prior to surgery. The overall incidence of POAF varied between 5% [14] and 61.7% [17]. A total of 289 patients were allocated randomly to NAC group and 289 to control group. The quality of the included studies was assessed by the Jadad score. The median Jadad score of the studies included was 4 (range from 3 to 5).
POAF
POAF data were reported in all eight studies [12–19] (578 patients; Table 2), and POAF was the primary end point in one study [12]. Details of POAF outcome definition and assessment are presented in Table 3.
Analysis of pooled prevalence of preoperative patient group characteristics revealed that no difference was observed for history of coexistence of basic diseases (e.g. diabetes mellitus, hypertension, congestive heart failure), routine prophylactic therapies (e.g. β-blocker, angiotensin-converting enzyme inhibitor or angiotensin receptor blocker, and calcium channel blocker; Table 4).
Pooling all eight randomized trials, 28.4% (82 of 289) of patients given NAC and 36.0% (104 of 289) of controls developed POAF. Meta-analysis of eight trials using a fixed-effects model showed that NAC supplementation significantly reduced the incidence of POAF (OR 0.62, 95% CI 0.41 to 0.93; P = 0.021; Figure 2) compared with controls, with little statistical heterogeneity between the trials (I2 = 8.3%, heterogeneity P = 0.366).
A trial conducted by Haase et al. [16] reported some patients with pre-existing atrial fibrillation. The pooled results didn't significantly change when this trial was excluded (OR 0.52, 95% CI 0.33 to 0.82; P = 0.005), and no evidence of heterogeneity was observed among the remaining seven studies (I2 = 0.0%, heterogeneity P = 0.622).
Hospital LOS
Five trials [12, 14–16, 19] reported the effect of NAC on LOS, but only 4 trials [12, 14, 15, 19] provided available data (expressed as mean ± standard deviation) with a total of 283 patients. The pooled analysis using a fixed-effects model showed that NAC supplementation did not significantly reduce LOS (WMD -0.07, 95% CI -0.42 to 0.28; P = 0.703; Figure 3), with no statistical heterogeneity between the trials (I2 = 0.0%, heterogeneity P = 0.922).
Publication bias
Assessment of publication bias using Egger's and Begg's tests showed that there was no potential publication bias among the included trials (Egger's test, P = 0.275; Begg's test, P = 0.536, Figure 4).
Discussion
To the best of our knowledge, this is the first meta-analysis to assess the efficacy of NAC supplementation on the prevention of atrial fibrillation after cardiac surgery. Meta-analysis of all eight included trials using a fixed-effects model illustrates that NAC supplementation can effectively reduce the incidence of POAF in adult patients undergoing cardiac surgery. In a recent meta-analysis, Harling et al. [5] evaluated antioxidant vitamins as a prophylactic method against POAF. This intervention reduced POAF significantly with OR of 0.43 (95% CI 0.21 to 0.89). Our results suggest that antioxidant NAC supplementation is as effective as antioxidant vitamins in reducing POAF, with OR in the similar range, being vitamins slightly more effective achieving this purpose than NAC. In addition, one problem with the use of antioxidant NAC to prevent POAF is that the majority of patients does not develop POAF after cardiac surgery but would still be exposed to possible side effects. In this meta-analysis, three trials [12, 17, 18] reported NAC-related adverse effects and the incidence of postoperative complications was similar in both NAC and control groups.
The mechanisms that antioxidant NAC supplementation reduces the incidence of POAF are not entirely known. However, there is now an increasing body of evidences that oxidative stress [11], inflammation [25, 26], and rennin-angiotensin system [27, 28] are involved in the pathogenesis of POAF.
The potential role of oxidative stress in the genesis and perpetuation of POAF is an interesting subject. NAC is a glutathione precursor; by entering cells and being hydrolyzed to cysteine, it stimulates glutathione synthesis, scavenges free radicals, and terminates the propagation of free radical reactions [29]. In addition, it also has potent anti-inflammatory effects by reducing the production of pro-inflammatory cytokines [30, 31] and blocks rennin-angiotensin system and/or atrial remodelling via its anti-inflammatory and antioxidant actions [32].
Aranki et al. [33] demonstrated that atrial fibrillation is a major predictor of longer hospitalization and found that it was independently associated with LOS extended by 4.9 days. NAC supplementation did not significantly reduce the LOS in this meta-analysis. The total incidence of POAF is 32.2% (156 of 578), fewer than half of patients develop POAF and still fewer develop prolonged atrial fibrillation, so the effect of NAC on LOS in patients prone to atrial fibrillation would have to be very large to be able to detect an effect of LOS in the total population. In addition, a relatively small number of samples (only four studies) provided available data on LOS, additional studies or data are warranted.
This meta-analysis has several potential limitations that should be taken into account. First, we acknowledged that the meta-analysis included the relatively small number of patients in the individual studies (n < 50 in four studies [13, 14, 18, 19]) and is limited by the lack of complete availability of relevant data, particularly for LOS. Second, only one study [12] included in the present meta-analysis has used POAF as a primary outcome measure, but for the remaining seven studies [13–19], POAF is only one of the clinically significant end points consistently reported rather than a primary outcome measure. Next, these studies lack homogeneity in both the method of postoperative monitoring and in their definition of POAF. This leads to potential underestimation and/or overestimation of the true incidence of POAF. Finally, because of sparse and inconsistent reporting across trials, we were unable to assess the impact of variations in the use of routine prophylactic therapies (e.g. statins, diuretics, NSAID or COX-2 inhibitor, and aspirin etc.), coexistence of basic diseases (e.g. myocardial infarction etc.), and other factors on our meta-analytic conclusions.
Future research should therefore focus on an adequately powered multicentre large-scale double-blind placebo-controlled randomized trial. Furthermore, novel studies should aim to treat the incidence of POAF as a primary outcome measure, and standardize POAF reporting criteria and antioxidant protocol. It is also need to exclude the synergistic effects of other coexisted drugs and antioxidant NAC on POAF.
Conclusion
This meta-analysis indicates that prophylactic NAC supplementation effectively reduces the incidence of POAF for adult patients undergoing cardiac surgery. Further research should focus on adequately powered RCTs with POAF incidence as a primary outcome measure.
References
Mathew JP, Fontes ML, Tudor IC, Ramsay J, Duke P, Mazer CD, Barash PG, Hsu PH, Mangano DT: A multicenter risk for atrial fibrillation after cardiac surgery. JAMA. 2004, 291: Investigators of the Ischemia Research and Education Foundation; Multicenter Study of Perioperative Ischemia Research Group):1720-1729
Fuster V, Ryden LE: ACC/AHA/ESC Guidelines for the management of patients with atrial fibrillation: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and Policy Conference. American Heart Association. 2002 Heart and Stroke Statistical Update. 2001, Dallas, Texas: American Heart Association, (accessed 8/7/02)
Ommen SR, Odell JA, Stanton MS: Atrial arrhythmias after cardiothoracic surgery. N Engl J Med. 1997, 336: 1429-1434. 10.1056/NEJM199705153362006.
Mariscalco G, Klersy C, Zanobini M, Banach M, Ferrarese S, Borsani P, Cantore C, Biglioli P, Sala A: Atrial fibrillation after isolated coronary surgery affects late survival. Circulation. 2008, 118: 1612e-18. 10.1161/CIRCULATIONAHA.108.777789.
Harling L, Rasoli S, Vecht JA, Ashrafian H, Kourliouros A, Athanasiou T: Do antioxidant vitamins have an anti-arrhythmic effect following cardiac surgery? A meta-analysis of randomised controlled trials. Heart. 2011, 97: 1636-1642. 10.1136/heartjnl-2011-300245.
Davis EM, Packard KA, Hilleman DE: Pharmacologic prophylaxis of postoperative atrial fibrillation in patients undergoing cardiac surgery: beyond beta-blockers. Pharmacotherapy. 2010, 30 (749): 274e-318e.
Koniari I, Apostolakis E, Rogkakou C, Baikoussis NG, Dougenis D: Pharmacologic prophylaxis for atrial fibrillation following cardiac surgery: a systematic review. J Cardiothorac Surg. 2010, 5: 121-10.1186/1749-8090-5-121.
Fuster V, Rydén LE, Cannom DS, Crijns HJ, Curtis AB, Ellenbogen KA, Halperin JL, Kay GN, Le Huezey JY, Lowe JE, Olsson SB, Prystowsky EN, Tamargo JL, Wann LS: 2011 ACCF/AHA/HRS focused updates incorporated into the ACC/AHA/ESC 2006 Guidelines for the management of patients with atrial fibrillation: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines developed in partnership with the European Society of Cardiology and in collaboration with the European Heart Rhythm Association and the Heart Rhythm Society. J Am Coll Cardiol. 2011, 57: e101-e198.
Ho KM, Lewis JP: Prevention of atrial fibrillation in cardiac surgery: time to consider a multimodality pharmacological approach. Cardiovasc Ther. 2010, 28: 59-65. 10.1111/j.1755-5922.2009.00117.x.
Korantzopoulos P, Kolettis TM, Galaris D, Goudevenos JA: The role of oxidative stress in the pathogenesis and perpetuation of atrial fibrillation. Int J Cardiol. 2007, 115: 135-143. 10.1016/j.ijcard.2006.04.026.
Huang CX, Liu Y, Xia WF, Tang YH, Huang H: Oxidative stress: a possible pathogenesis of atrial fibrillation. Med Hypotheses. 2009, 72: 466-467. 10.1016/j.mehy.2008.08.031.
Ozaydin M, Peker O, Erdogan D, Kapan S, Turker Y, Varol E, Ozguner F, Dogan A, Ibrisim E: N-acetylcysteine for theprevention of postoperative atrial fibrillation: A prospective, randomized, placebo-controlled pilot study. Eur Heart J. 2008, 29: 625-631. 10.1093/eurheartj/ehn011.
Eren N, Cakir O, Oruc A, Kaya Z, Erdinc L: Effects of N-acetylcysteine on pulmonary function in patients undergoing coronary artery bypass surgery with cardiopulmonary bypass. Perfusion. 2003, 18: 345-350. 10.1191/0267659103pf696oa.
Orhan G, Yapici N, Yuksel M, Sargin M, Şenay S, Yalçin AS, Aykaç Z, Aka SA: Effects of N-acetylcysteineon myocardial ischemia-reperfusion injury in bypass surgery. Heart Vessels. 2006, 21: 42-47. 10.1007/s00380-005-0873-1.
El-Hamamsy I, Stevens LM, Carrier M, Pellerin M, Bouchard D, Demers P, Cartier R, Page P, Perrault LP: Effect of intravenous N-acetylcysteine on outcomes after coronary artery bypass surgery: A randomized, double-blind, placebo-controlled clinical trial. J Thorac Cardiovasc Surg. 2007, 133: 7-12. 10.1016/j.jtcvs.2006.05.070.
Haase M, Haase-Fielitz A, Bagshaw SM, Reade MC, Morgera S, Seevenayagam S, Matalanis G, Buxton B, Doolan L, Bellomo R: Phase II, randomized, controlled trial of high-dose N-acetylcysteine in high-risk cardiac surgery patients. Crit Care Med. 2007, 35: 1324-1331. 10.1097/01.CCM.0000261887.69976.12.
Wijeysundera DN, Beattie WS, Rao V, Granton JT, Chan CT: N-acetylcysteine for preventing acute kidney injury in cardiac surgery patients with preexisting moderate renal insufficiency. Can J Anaesth. 2007, 54: 872-881. 10.1007/BF03026790.
Peker O, Peker T, Erdogan D, Ozaydin M, Kapan S, Sutcu R, Ibrisim E: Effects of intravenous N-acetylcysteine on periprocedural myocardial injury after on-pump coronary artery by-pass grafting. J Cardiovasc Surg (Torino). 2008, 49: 527-531.
Kim JC, Hong SW, Shim JK, Yoo KJ, Chun DH, Kwak YL: Effect of N-acetylcystein on pulmonary function in patients undergoing off-pump coronary artery bypass surgery. Acta Anaesthesiol Scand. 2011, 55: 452-459. 10.1111/j.1399-6576.2011.02407.x.
Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.
Sutton AJ, Abrams KR, Jones DR: Methods for Meta-analysis in Medical Research. 2000, Chichester: Wiley
Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.
Begg CB, Mazumdar M: Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994, 50: 1088-1101. 10.2307/2533446.
Egger M, Davey Smith G, Schneider M, Minder C: Bias in meta-analysis detected by a simple, graphical test. Br Med J. 1997, 315: 629-634. 10.1136/bmj.315.7109.629.
Kumagai K, Nakashima H, Saku K: The HMG-CoA reductase inhibitor atorvastatin prevents atrial fibrillation by inhibiting inflammation in a canine sterile pericarditis model. Cardiovasc Res. 2004, 62: 105-111. 10.1016/j.cardiores.2004.01.018.
Ozaydin M, Dogan A, Varol E, Kucuktepe Z, Dogan A, Ozturk M, Altinbas A: Statin use before by-pass surgery decreases the incidence and shortens the duration of postoperative atrial fibrillation. Cardiology. 2007, 107: 117-121. 10.1159/000094589.
Dilaveris P, Giannopoulos G, Synetos A, Stefanadis C: The role of renin angiotensin systemblockade in the treatment of atrial fibrillation. Curr Drug Targets Cardiovasc Haematol Disord. 2005, 5: 387-403. 10.2174/156800605774370317.
Boos CJ, Anderson RA, Lip GY: Is atrial fibrillation an inflammatory disorder?. Eur Heart J. 2006, 27: 136-149.
Carnes CA, Janssen PM, Ruehr ML, Nakayama H, Nakayama T, Haase H, Bauer JA, Chung MK, Fearon IM, Gillinov AM, Hamlin RL, Van Wagoner DR: Atrial glutathione content, calcium current, and contractility. J Biol Chem. 2007, 282: 28063-28073. 10.1074/jbc.M704893200.
Korantzopoulos P, Kolettis TM, Kountouris E, Dimitroula V, Karanikis P, Pappa E, Siogas K, Goudevenos JA: Oral vitamin Cadministration reduces early recurrence rates after electrical cardioversion of persistent atrial fibrillation and attenuates associated inflammation. Int J Cardiol. 2005, 102: 321-326. 10.1016/j.ijcard.2004.12.041.
Goettea A, Lendeckel U: Nonchannel drug targets in atrial fibrillation. Pharmacol Ther. 2004, 102: 17-36. 10.1016/j.pharmthera.2004.01.001.
van der Harst P, Volbeda M, Voors AA, Buikema H, Wassmann S, Bohm M, Nickenig G, van Gilst WH: Vascular response to angiotensin II predicts long-term prognosis in patients undergoing coronary artery bypass grafting. Hypertension. 2004, 44: 930-934. 10.1161/01.HYP.0000147823.50497.a9.
Aranki SF, Shaw DP, Adams DH, Rizzo RJ, Couper GS, VanderVliet M, Collins JJ, Cohn LH, Burstin HR: Predictors of atrial fibrillation after coronary artery surgery. Current trends and impact on hospital resources. Circulation. 1996, 94: 390-397.
Pre-publication history
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2261/12/10/prepub
Acknowledgements
This study was supported by the Science Foundation of Guangxi Returned Oversea Scholars (No: 0991004).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
WJG conceived the study, participated in the design, collected the data, and drafted the manuscript. ZJW collected the data, and performed statistical analyses. PFW and LHHA helped to collect the data. RXY conceived the study, participated in the design, and helped to draft the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Gu, WJ., Wu, ZJ., Wang, PF. et al. N-acetylcysteine supplementation for the prevention of atrial fibrillation after cardiac surgery: a meta-analysis of eight randomized controlled trials. BMC Cardiovasc Disord 12, 10 (2012). https://doi.org/10.1186/1471-2261-12-10
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1471-2261-12-10