Skip to main content
Download PDF

The sham effect of invasive interventions in chronic coronary syndromes: a systematic review and meta-analysis

BMC Cardiovascular Disorders volume 22, Article number: 223 (2022) Cite this article

Abstract

Background

Some patients with chronic coronary syndromes undergo invasive procedures but the efficacy of such interventions remains to be robustly established by randomised sham-controlled trials (RCTs).

Purpose

To determine the sham effect in patients with chronic coronary syndromes enrolled in RCTs by performing a systematic review and meta-analysis.

Methods

In April 2022, we performed a literature search for published patient-blind RCTs (CENTRAL, MEDLINE®, PsycINFO, and reference lists) with sham procedures, reporting the pre-post effects in the invasive sham arm among patients with Canadian cardiovascular society (CCS) angina or angina equivalents.

Results

16 RCTs were included with 546 patients in the sham arm. Pooled results showed that sham interventions were associated with: improvement of 7% (95% CI 2–11%; I2 = 0%) in exercise time; decrease of 0.78 (95% CI − 1.10 to − 0.47; I2 = 75%) in CCS angina class; decrease of 53% (95% CI 24–71%; I2 = 96%) and 25% (95% CI 20–29%; I2 = 0%) in anginal episodes and nitroglycerine (NTG) use, respectively. Pooled results also showed an improvement in the physical functioning, angina frequency, treatment satisfaction, and disease perception domains of the Seattle Angina Questionnaire (SAQ).

Conclusion

Sham interventions in patients with chronic coronary syndromes were associated with a significant decrease in anginal episodes, NTG use, and CCS angina class and increased SAQ quality of life and exercise time. These results highlight the need for previous non sham-controlled trials to be interpreted with caution, and the importance of new invasive interventions to be evaluated versus a sham procedure.

Peer Review reports

Background

There are diverse clinical scenarios of chronic coronary syndromes that comprise both symptomatic and asymptomatic patients who have been diagnosed or suspected to have coronary artery disease (CAD). Symptomatic patients may present with angina (due to CAD, vasospastic, or microvascular disease) and/or other angina equivalent symptoms, as well as heart failure related with CAD [1]. A recent review of studies published between 2010 and 2017 estimated the worldwide prevalence of CAD to be approximately 5–8% [2].

The mainstays of treatment for chronic coronary syndromes are antiplatelet agents and aggressive management of risk factors to improve prognosis, and antianginal drugs for symptom relief. Certain patients undergo invasive treatments such as revascularisation procedures (either percutaneous coronary intervention [PCI] or coronary artery bypass graft [CAGB]) depending on the extent of ischaemia, severity, and location of the coronary plaques and/or due to how refractory symptoms are to medical treatment [1, 3, 4]. However, these interventions have not been shown to offer prognostic efficacy compared with sham interventions [5]. Throughout the history of CAD, remarkable benefits of certain interventions have been reported in non-controlled clinical trials, later failing to be shown efficacious against placebo in controlled trials. This emphasises the importance of placebo-controlled studies in recommending efficacious interventions [6].

In 1961, Shapiro defined the term placebo as any therapeutic procedure which, either deliberately or unknowingly, has an effect on a patient, symptom, syndrome, or disease but which is objectively without specific activity for the condition being treated [7]. Nowadays, the term placebo is commonly used to describe inactive pills. For other types of interventions, when the actual procedure is mimicked, it is called a sham procedure.

Angina is the most representative symptom of CAD and, along with exercise time, is often evaluated in clinical trials of chronic coronary syndromes. However, these types of outcomes are prone to the Hawthorne effect whereby a participant modifies their behaviour in reaction to being enrolled in a study and interacting with clinical trial staff, resulting in a possible enhancement of the placebo/sham effect.

In this systematic review, we aimed to evaluate and quantify the magnitude of the sham effect associated with invasive procedures among patients with chronic coronary syndromes.

Methods

This systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines for reporting systematic reviews evaluating healthcare interventions [8]. The protocol was registered with PROSPERO (reference: CRD42021224700).

Eligibility criteria

For inclusion, we considered published randomised, patient-blind, controlled clinical trials (RCTs) with a sham procedure. A sham procedure is defined here as a procedure performed as a control that is similar to but omits a key therapeutic element of the treatment under investigation. RCTs were required to evaluate invasive treatments (PCI, CABG, coronary sinus reducer, myocardial laser revascularisation, or intramyocardial/coronary injection) for chronic coronary syndromes in patients with Canadian Cardiovascular Society (CCS) class I-IV angina, including refractory angina and angina equivalents. We excluded observational studies, conference abstracts, and congresses proceedings.

Our primary outcome was the relative change (measured as a percentage) in exercise time as recorded in a standardised exercise stress test. Secondary outcomes were the standardised mean differences in exercise time, CCS angina class, number of anginal episodes per week, nitroglycerine use (NTG) per week, and quality of life (QoL) assessment using the Seattle Angina Questionnaire (SAQ) [9]. The SAQ is a sensitive and specific instrument that includes a measure of QoL in CAD, the score ranges between 0 and 100, with higher scores indicating better function. To be included, studies had to report the pre-post difference in the sham procedure arm for at least one of the outcomes of interest.

Information sources and search method

An electronic search for potentially eligible studies was performed in April 2022 using the Cochrane Central Register of Controlled Trials, MEDLINE®, and PsycINFO. OpenGrey was also searched. The search strategy is outlined in the Additional file 1. No language restrictions were applied. The reference lists of included studies and other literature reviews were also examined.

Study selection, data collection process, and risk of bias assessment

Two authors independently screened titles and abstracts of the retrieved records. To ensure that the inclusion criteria were met, the full-text versions of the selected studies were assessed. Two authors independently extracted study characteristics and outcomes into a pre-established data collection form. Any disagreements were resolved through consensus. The reasons for exclusion were recorded at the full-text screening stage (see supplementary material).

Whenever data were only available in a plot, these were retrieved using the Plot Digitizer V.2.6.8. When studies presented different estimates for the outcome of interest, we extracted the most precise or adjusted measures. If an outcome was reported as a median value and interquartile range, we converted these values to mean ± standard deviations (SD) using the Wan Method [10]. If an outcome was reported as a mean change ± SD, we converted this to mean, lower, and upper confidence intervals. Mean ± standard errors were converted to mean ± SD. If data were obtained over several follow-ups, we analysed the estimate from putative sham/placebo effects as the most favourable effect registered in the follow-up.

The risk of bias was independently evaluated by two authors using the Cochrane risk of bias tool [11], whereby answering signalling questions in five domains enables an algorithm to generate a risk of bias judgement such as “Low risk”, “High risk” or “Some Concerns”.

All disagreements between reviewers throughout the different steps of the systematic review were resolved by consensus or by the decision of a third independent reviewer.

Statistical analysis

Software Review Manager (RevMan) Version 5.4.1, Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2020 was used to obtain the estimates of individual studies, the pooled analysis, and to retrieve the forest plots.

Our first approach for the outcomes exercise time, anginal episodes, and nitroglycerine administration was to convert the absolute post-sham values into relative change (RC) values (RC was obtained by dividing the absolute value reported after the sham intervention by the absolute value reported before the sham intervention) compared with the baseline. Relative measures appear to be more stable than absolute measures across populations of patients who have different occurrence rates of the outcome under evaluation.

Next, we calculated the mean difference (MD) of the outcomes (MD was obtained by subtracting the absolute value after the sham intervention with the absolute value reported before the intervention) and 95% confidence intervals (95% CI) to estimate pooled results. While several studies assessed exercise time, this outcome was measured in a variety of ways, we, therefore, estimated the results for this outcome according to the measurement method and calculated the standardised mean difference (SMD) and 95% CI. Cohen's rule of thumb for effect size was used, with 0.2 considered a small effect, 0.5 a moderate effect, and 0.8 a large effect. Meta-analyses used random-effects models to pool the results.

Heterogeneity was assessed with the I2 test, which measures the percentage of total variation attributed to inter-study heterogeneity rather than chance [12]. The inverse of variance method with random-effects model was used by default, independently of the existence or not of statistical heterogeneity between study results, as we anticipated the inclusion of studies with different clinical and methodological characteristics.

We also planned to conduct subgroup analyses according to the type of sham procedure, mean left ventricular ejection fraction (< 50% or more than 33% of patients with heart failure vs. ≥ 50%/LVEF not reported), as well as a sensitivity analysis by excluding studies at a higher risk of bias. When feasible, meta-regression was performed for primary outcomes against age, the proportion of men, and the proportion of diabetic patients. Bubble graphs were plotted with STATA 17.0. The Jackknife leave-one-out sensitivity analysis [13] was also performed to evaluate the impact of a single study as responsible for the heterogeneity.

Publication bias was assessed through visual inspection of funnel plot asymmetry with Egger’s test [14]. If a small-study effect was suspected by visual inspection of the funnel plot or Egger’s test results, we planned to follow the trim and fill method to assess publication/small-study effects bias in the meta-analysis [15].

We used the Grading of Recommendations, Assessment and Evaluation (GRADE) framework to report the overall quality of evidence for primary outcomes [16]. The GRADE approach was independently assessed by two investigators and discrepancies were solved by consensus.

Results

Included studies

A total of 16 articles were retained for both qualitative and quantitative syntheses. No unpublished studies were retrieved (Fig. 1).

Fig. 1
figure 1

Study flow diagram

Full size image

Sixteen randomised controlled trials were included with a total of 1340 participants (sample sizes between 10 and 298), in which 546 were allocated to the sham arm [5, 17,18,19,20,21,22,23,24,25,26,27,28,29,30,31]. Table 1 shows the characteristics of the included studies. Publication dates ranged from 1959 to 2017. All studies included patients with angina or equivalent symptoms. The mean age of the patients ranged from 57.8 to 67.8 years and the percentage of men ranged from 51 to 91%.

Table 1 Characteristics of the included randomised controlled trials (n = 16)
Full size table

In eleven studies, the intervention was an intramyocardial injection [18, 21,22,23,24,25,26,27,28,29, 31] (four containing plasmids [18, 21, 22, 28], four containing autologous CD34 + cells [23, 26, 27, 31], two containing bone marrow cells [24, 25] and one containing autologous aldehyde dehydrogenase bright stem cells [29]) and all had a sham procedure as the control arm. The remaining five studies evaluated other interventions such as PCI (ORBITA trial [5]), coronary sinus reducer (COSIRA trial [30]), myocardial laser revascularisation (Salem [19], Leon [20]), and internal mammary artery ligation (Cobb [17]) versus a sham comparator.

Regarding the sham comparators, seven studies used a placebo solution [22, 25,26,27,28,29, 31], five studies used a sham intervention [5, 17, 19, 20, 30], two studies injected a saline solution in the sham intervention arm [18, 23], one study used a placebo plasmid [21], and one study injected autologous plasma [24].

Risk of bias

In the risk of bias assessment most of the studies (11 of 16) had moderate (‘some concerns’) risk of bias. Most of these studies were considered to have risk of selection bias of the reported outcomes. Due to the nature of our question/review, this selection is unavoidable because we are searching for the best response in the sham arm. Additionally, we judged three of the sixteen RCTs to have further risks of bias: one due to not having a pre-specified analysis plan; one due to not having a pre-specified analysis plan, and for having baseline imbalances (medication usage) between groups [22]; and one due to lack of information about the allocation sequence and its concealment [20] (Additional file 1).

Exercise time

The sham intervention arm of thirteen RCTs [5, 17,18,19,20, 22,23,24, 26,27,28, 30, 31] (n = 13) contributed data for exercise time as the primary outcome. This outcome was measured in six studies with the Treadmill Bruce protocol [5, 17, 19, 22, 23, 26], in five studies with the Treadmill modified Bruce protocol [18, 20, 24, 27, 31], and in two studies with the bicycle protocol (28, 30). Although the study by Fuchs et al. (2006)[22] used the asymptomatic cardiac ischaemia pilot (ACIP) protocol, we considered it to be very similar to the Bruce treadmill protocol and, therefore, we included it in the Treadmill Bruce subgroup. Two of the sixteen included studies did not report data for this outcome [21, 29], and in another study [25] that used a bicycle protocol, the exercise outcome was measured in watts, not in time. We were not able to include two studies [23, 27] for the relative measurement of change since these studies did not present the pre and post-sham values, only mean differences.

Pooled estimates showed an overall significant increase in exercise time with sham, corresponding to 7% using the relative change measure (RC 1.07; 95% CI 1.02–1.11; I2 = 0%; Fig. 2) and a Cohen d of 0.22 (SMD 0.22; 95% CI 0.09–0.35; I2 = 0%; Fig. 3). There were no differences between subgroups defined according to the way this outcome was measured.

Fig. 2
figure 2

Forest plot for relative change of exercise time

Full size image
Fig. 3
figure 3

Forest plot for standardised mean exercise difference

Full size image

In absolute terms, the sham intervention significantly increased the exercise time as measured by the modified Bruce protocol (MD 56.03; 95% CI 26.92–85.14, I2 = 0%), but not when measured by the Bruce (MD 27.10; 95% CI − 12.99 to 67.19, I2 = 0%) or bicycle exercise protocols (MD 23.04; 95% CI − 51.07 to 97.16; I2 = 0%) (Additional file 2).

CCS class, frequency of anginal episodes and nitroglycerine use

Overall, ten RCTs [18, 21,22,23,24,25,26, 28,29,30], six RCTs [18, 23, 26,27,28, 31], and five RCTs [18, 23, 26,27,28] contributed data for the outcomes CCS angina class, anginal episodes per week, and nitroglycerine use, respectively.

In absolute terms, there was a mean decrease in CCS angina class (MD − 0.78; 95% CI − 1.10 to − 0.47; I2 = 75%; Additional file 2).

Sham procedures were associated with a mean 53% and 25% relative decrease in anginal episodes (RC 0.47; 95% CI 0.29–0.76; I2 = 96%; Fig. 4) and NTG use (RC 0.75; 95% CI 0.71–0.80; I2 = 0%; Fig. 4), respectively.

Fig. 4
figure 4

Forest plot for the relative change regarding anginal episodes and nitroglycerine use per week

Full size image

In absolute terms, there was a significant decrease in anginal episodes per week (MD − 10.29; 95% CI − 13.04 to − 7.54; I2 = 0%; supplementary material). The weekly use of NTG was significantly decreased after sham intervention (MD − 3.98; 95% CI − 5.14 to − 2.82; I2 = 0%; Additional file 2).

Quality of life—Seattle Angina Questionnaire

Overall, seven RCTs [5, 19, 20, 22, 23, 27, 30] contributed data for pre-post evaluation of QoL using SAQ within the sham arm of an RCT.

The sham intervention significantly improved SAQ scores regarding physical functioning (MD 10.67; 95% CI 5.47–15.88; I2 = 42%), angina frequency (MD 17.21; 95% CI 10.48–23.94; I2 = 70%;), treatment satisfaction (MD 6.43; 95% CI 2.51–10.35; I2 = 0%), and disease perception (MD 10.98; 95% CI 6.53–15.44; I2 = 0%) (Fig. 5).

Fig. 5
figure 5

Forest plot for Seattle Angina Questionnaire (SAQ). Subgroups: Physical Limitation, Angina Stability, Angina Frequency, Treatment Satisfaction, and Disease Perception

Full size image

Publication bias risk assessment

The visual interpretation of the funnel plots (Additional file 3) does not suggest the existence of small-study effects or publications bias for all outcomes. A similar interpretation was supported by the results of the Egger’s test (p-value > 0.10) (Additional file 3). In addition, the trim-fill analyses of all outcomes did not substantially change the outcome measures.

Subgroup/exploratory analyses and heterogeneity investigation

We performed an analysis of relative change in exercise time according to the type of sham intervention: pure sham intervention (RC 1.05; 95%CI 1.01–1.11; I2 = 0%) or sham intervention plus placebo solution (RC 1.12; 95%CI 0.98–1.27; I2 = 6%), and we did not find any differences between the two subgroups (p-value for interaction 0.42) (Additional file 4).

The subgroup analysis of relative change in exercise time according to the mean reported LVEF showed no difference (p-value for subgroup interaction 0.24) among LVEF < 50% (RC 1.11, 95%CI 1.02–1.19; 2 studies) and LVEF ≥ 50% or LVEF not reported (RC 1.04, 95%CI 0.99–1.10) (Additional file 4).

We also performed meta-regression of relative change in exercise time with age, the proportions of men and diabetic patients. The meta-regression showed that for each year of increase in average population age a relative decrease of 2.3% can be expected in exercise time (− 2.3%, 95% CI − 4.5 to − 1%). The results of meta-regression for men and diabetic patients’ proportions were not significant (Additional file 4).

The measures of exercise time change, both as a relative change (primary outcome) and as SMD (Cohen d) did not have substantial heterogeneity. The analyses that had important statistical heterogeneity were angina episodes frequency (I2 = 95%), CCS class analysis (I2 = 70%), and nitroglycerine use (I2 = 95%). The investigation showed that estimates of the subgroup of patients with lower LVEF/HF patients (RC 0.66, 95%CI 0.41–1.06; two studies) did not have substantial heterogeneity (I2 = 0% for angina episodes and CCS class, I2 = 46% for nitroglycerine use) and the reduction in the CCS class was still statistically significant, but not different from LVEF > 50% (p-value for interaction 0.21).

For SAQ outcomes, angina stability (I2 = 89%) and angina frequency (I2 = 70%) showed substantial heterogeneity. Similar to previous outcomes, heterogeneity was reduced in the subgroup of patients with lower LVEF/HF (27% for SAQ angina stability and 0% for SAQ angina frequency). SAQ angina stability did not show substantial heterogeneity in the subgroup sham intervention plus placebo solution.

The exclusion of studies at higher risk of bias only improved the heterogeneity of SAQ angina frequency (I2 = 0%).

Certainty of evidence for exercise time using GRADE

We evaluated the certainty of the pooled evidence for the exercise time using the GRADE framework. The certainty about evidence was low due to the pre-post evaluation of outcomes in the sham arm and due to the selective reporting bias risk inherent to search of the best response within trial as an equivalent of a sham/placebo effect. The GRADE table is depicted in Table 2.

Table 2 GRADE assessment of pooled evidence
Full size table

Discussion

This systematic review and meta-analysis showed that a sham intervention in chronic coronary syndromes can increase the exercise time in a stress test by 7%, halve the number of episodes of angina, improve CCS class, and reduce nitroglycerine in 25% of patients. The sham intervention also improved domains covered by the SAQ, namely physical functioning, angina frequency, treatment satisfaction, and disease perception.

The average increase in exercise for the stress test was 7% but different types of stress tests were included in this outcome making it difficult to ascertain the clinical significance of this effect. To overcome this limitation, we also used the Cohen D (SMD) and the pooled analysis sought a statistically significant increase of SMD in exercise trials by 0.22, which is deemed to be a change of small magnitude.

In our systematic review, we determined that, for the modified Bruce treadmill protocol, the pooled effect was 56 s (27 s for the Bruce protocol and 23 s for bicycle protocols). One of the included studies, Leon [20], considered that 1 min was the minimal clinically relevant difference in exercise time in the modified Bruce protocol, when comparing an intervention with a sham comparator. This means that minimal clinically relevant difference, in this case, would double the sham effect. Nevertheless, it is worth noting that the sham and Hawthorne effects in this context were able to improve exercise time, which is a relevant prognostic factor in patients with chronic coronary syndromes [32], but no referral should be made on this basis. Despite these considerations, and in the presence of negative results in most invasive studies, our data should be used to emphasise the importance of sham-controlled studies and to perform sample size calculations based on our assumptions. There are some examples, namely in ablation procedures for renal denervation in arterial hypertension [33, 34] that show that it might be worth performing sham-controlled trials to assess the ‘real’ value of the intervention.

Comparing our results with the placebo effect in placebo-controlled trials (where ranolazine and ivabradine were tested) [35, 36] using the same methods, the placebo effect revealed heterogeneous increases between 1.5% and 15%. These results are not very far from the 95% confidence intervals and the factors associated with placebo effects might be similar to those associated with sham effects.

The sham effect was also substantial in decreasing anginal episodes, CCS class, and nitroglycerine consumption as a surrogate to angina severity. The most impressive estimate in this set of outcomes relies on the halving of angina episodes. The most important drawback of this result concerns statistical heterogeneity. However, it is worth noting that when we considered only the two studies with lower left ventricular ejection fraction/higher proportion of heart failure patients, the results did not yield statistical heterogeneity and still showed a significant reduction in anginal episodes of 44%. The CCS class mean reduction was 0.78, which means that most patients improved by at least one class. A decrease of just one class could mean that a patient could walk a longer distance and perform more activities, which correlates with a better QoL. In light of these data, the reduction in nitroglycerine consumption was expected. This can be interpreted as a severity marker of angina but this threshold to treatment with nitroglycerine is an outcome that can be influenced by expectations and thus responsive to the sham effect.

Most of the domains of the SAQ, except for angina stability, were significantly improved after sham interventions. The relevance of our results once again emphasises the need for sham-controlled trials to interpret the outcomes. For example, an open-label trial showed that percutaneous coronary revascularisation compared with optimal medical treatment significantly improved SAQ in the domains of physical limitation, angina frequency, and disease perception by 5.2, 5.2, and 6.6 points respectively [37]. A pre-post evaluation of percutaneous coronary revascularisation in this context also showed an increase of 13.1 points in physical limitation, 14.6 in angina frequency, and 21.3 for disease perception/QoL. The results of our systematic review showed that sham interventions can increase these SAQ domains to 10.67, 17.21, and 10.98, respectively. All the significant comparisons with the optimal medical treatment had a magnitude lower than the sham effect, and within the intervention, the SAQ physical limitation and angina frequency had results within the 95% confidence intervals of the sham effects. We are not claiming that the intervention has no additional therapeutic value, but conclude that any fair evaluation (even for the intervention in case of efficacy) would require a sham arm for adequate interpretation, however, we recognise the additional challenges in performing such studies.

Overall, these results showed that patients with chronic coronary syndromes improve after a sham invasive procedure. This seems to call into question the meaning of the relief reported by patients with angina submitted to invasive interventions and requires that we re-think the role of placebo in contributing to this relief. In cardiovascular medicine there are examples of treatments considered clearly beneficial where an initial placebo-controlled trial was rejected, before, years later, an exploratory/pragmatic trial (such as ORBITA) shakes the validity of some of these principles and triple-blinded (patient, physician, outcome assessor) placebo/sham-controlled trials are valued and required [5].

Current recommendations point to revascularisation as having a central role in the management of CCS when angina persists despite treatment with an antianginal drug, but also recommend that individual benefit-risk ratio be considered and that decision-making be shared with the patient [1], keeping in mind comparisons of an intervention to a sham intervention or placebo, while integrating the values and preferences of the patient, for example, their aversion to invasive treatment.

The results of this systematic review also highlight the need for randomised controlled trials to evaluate the efficacy of invasive treatments in patients with CCS and establish, for the measured outcomes, an assumed effect that should account for this sham effect in future trials. Also, the efficacy of blinding, for both patients and investigators, should be considered a mandatory outcome to report in these trials. In the ORBITA trial, the authors reported a blinding index and raw data of arm guessing. The blinding index was significant in the PCI arm, but raw data show that 47.6% of PCI patients guessed their allocation arm correctly, 28.6% were wrong and the remainder did not know. In the placebo/sham arm, only 37.4% guessed their arm.

Limitations

The results and conclusions of this systematic review must account for the limitations of the individual studies included here. Most of the studies presented their results as study-level data and not as individual patient data, which can lead to biased assessments and limited interpretation of the data. In addition, eleven of the studies were judged as having a risk of bias.

We were also limited by the variety of interventions and types of sham in published studies, which is also partially responsible for the heterogeneous population. Another limitation concerns the standardised mean difference analyses of exercise time, which reported only a small change, diminishing the robustness of our results. Besides, most of our outcomes are subjective patient-reported outcomes which makes them prone to being modulated by a putative placebo/sham effect.

Furthermore, in clinical practice, therapeutic adjustments are made, according to the individual patient’s necessities and these adjustments can alter the manifestations of the disease, possibly resulting in an improvement of symptoms or other disease classification parameters. Throughout the follow-up periods of the selected trials, which varied from 6 weeks to 12 months, medication adjustments could have been undertaken, affecting the results of the measured outcomes, which cannot be accounted for or adjusted. We also considered the follow-up periods to be short-term observation times, which prevented us from drawing conclusions about the effect over a longer period.

Our results could be affected, not only by the therapeutic adjustments, but also by the natural progression of the disease and (its) regression to the mean since it is expected that the invasive treatments are proposed for the most symptomatic patients.

Finally, we were limited by the lack of studies presenting another control group, with no intervention and no blind placebo.

Conclusions

This systematic review suggests that sham invasive interventions in patients with chronic coronary syndromes are associated with a significant decrease in anginal episodes per week, NTG use per week and CCS angina class, and increases in exercise time and SAQ QoL scores. These results indicate we need to be cautious when interpreting previous clinical trials that are not placebo-controlled, and reinforce the importance of evaluating the efficacy of new invasive treatments against a placebo procedure.

Availability of data and materials

All data generated or analysed during this study are included in this published article and its Additional files.

Abbreviations

ACIP:

Asymptomatic cardiac ischaemia pilot

CAD:

Coronary artery disease

CCS:

Canadian cardiovascular society

CI:

Confidence interval

EET:

Exercise tolerance test

HF:

Heart failure

LV:

Left ventricle

LVEF:

Left ventricle ejection fraction

MD:

Mean difference

NTG:

Nitroglycerine

NYHA:

New York heart association

PCI:

Percutaneous coronary intervention

PMLR:

Percutaneous myocardial laser revascularisation

QoL:

Quality of life

RC:

Relative change

RCT:

Randomised clinical trial

rEF:

Reduced ejection fraction

SAQ:

Seattle angina questionnaire

SD:

Standard deviation

SMD:

Standardised mean difference

SPECT:

Single-photon emission computerised tomography

References

  1. Knuuti J, Wijns W, Achenbach S, Agewall S, Barbato E, Bax JJ, et al. 2019 ESC guidelines for the diagnosis and management of chronic coronary syndromes. Eur Heart J. 2020;41(3):407–77.

    Article  Google Scholar 

  2. Bauersachs R, Zeymer U, Brière JB, Marre C, Bowrin K, Huelsebeck M. Burden of coronary artery disease and peripheral artery disease: a literature review. Cardiovasc Ther. 2019;2019.

  3. Boden W, O’Rourke R, Teo K, Hartigan P, Maron D, Kostuk W, et al. Optimal medical therapy with or without PCI for stable coronary disease. N Engl J Med. 2007;356(15):1503–16.

    Article  CAS  Google Scholar 

  4. De Bruyne B, Pijls NHJ, Kalesan B, Barbato E, Tonino PAL, Piroth Z, et al. Fractional flow reserve-guided PCI versus medical therapy in stable coronary disease. N Engl J Med. 2012;367(11):991–1001.

    Article  Google Scholar 

  5. Al-Lamee R, Thompson D, Dehbi HM, Sen S, Tang K, Davies J, et al. Percutaneous coronary intervention in stable angina (ORBITA): a double-blind, randomised controlled trial. The Lancet. 2017;391(10115):31–40.

    Article  Google Scholar 

  6. Bleich H, Moore M, Benson H, McCallie D. Angina pectoris and the placebo effect. N Engl J Med. 1979;300(25):1424–9.

    Article  Google Scholar 

  7. Shapiro AK. Factors contributing to the placebo effect, their implications for psychotherapy. Am J Psychother. 1961;18:73–88.

    Article  Google Scholar 

  8. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, The PRISMA, et al. statement: an updated guideline for reporting systematic reviews. The BMJ. 2020;2021:372.

    Google Scholar 

  9. Chan PS, Jones PG, Arnold SA, Spertus JA. Development and validation of a short version of the seattle angina questionnaire. Circ Cardiovasc Quality Outcomes. 2014;7(5):640–7.

    Article  Google Scholar 

  10. Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14(1):1–13.

    Article  Google Scholar 

  11. Sterne J, Savović J, Page M, Elbers R, Blencowe N, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366(14898):526.

    Google Scholar 

  12. Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539–58.

    Article  Google Scholar 

  13. Salkind N. Encyclopedia of research design. California: Thousand Oaks; 2010.

    Book  Google Scholar 

  14. Egger M, Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–34.

    Article  CAS  Google Scholar 

  15. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method. Biometrics. 2000;56(June):455–63.

    Article  CAS  Google Scholar 

  16. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. Chin J Evid Based Med. 2009;9(1):8–11.

    Google Scholar 

  17. Cobb LA, Thomas GI, Dillard DH, Meredino A, Bruce RA. An evaluation of internal-mammary-artery ligation by a double-blind technic. N Engl J Med. 1959;260(22):1115–8.

    Article  CAS  Google Scholar 

  18. Losordo DW, Vale PR, Hendel RC, Milliken CE, Fortuin FD, Cummings N, et al. Phase 1/2 placebo-controlled, double-blind, dose-escalating trial of myocardial vascular endothelial growth factor 2 gene transfer by catheter delivery in patients with chronic myocardial ischemia. Circulation. 2002;105(17):2012–8.

    Article  CAS  Google Scholar 

  19. Salem M, Rotevatn S, Stavnes S, Brekke M, Vollset SE, Nordrehaug JE. Usefulness and safety of percutaneous myocardial laser revascularization for refractory angina pectoris. Am J Cardiol. 2004;93(9):1086–91.

    Article  Google Scholar 

  20. Leon MB, Kornowski R, Downey WE, Weisz G, Baim DS, Bonow RO, et al. A blinded, randomized, placebo-controlled trial of percutaneous laser myocardial revascularization to improve angina symptoms in patients with severe coronary disease. J Am Coll Cardiol. 2005;46(10):1812–9.

    Article  Google Scholar 

  21. Kastrup J, Jørgensen E, Rück A, Tägil K, Glogar D, Ruzyllo W, et al. Direct intramyocardial plasmid vascular endothelial growth factor-A 165 gene therapy in patients with stable severe angina pectoris: A randomized double-blind placebo-controlled study: The Euroinject One trial. J Am Coll Cardiol. 2005;45(7):982–8.

    Article  CAS  Google Scholar 

  22. Fuchs S, Dib N, Cohen BM, Okubagzi P, Diethrich EB, Campbell A, et al. A randomized, double-blind, placebo-controlled, multicenter, pilot study of the safety and feasibility of catheter-based intramyocardial injection of AdVEGF121 in patients with refractory advanced coronary artery disease. Catheter Cardiovasc Interv. 2006;68(3):372–8.

    Article  Google Scholar 

  23. Losordo DW, Schatz RA, White CJ, Udelson JE, Veereshwarayya V, Durgin M, et al. Intramyocardial transplantation of autologous CD34+ stem cells for intractable angina: A phase I/IIa double-blind, randomized controlled trial. Circulation. 2007;115(25):3165–72.

    Article  Google Scholar 

  24. Tse HF, Thambar S, Kwong YL, Rowlings P, Bellamy G, McCrohon J, et al. Prospective randomized trial of direct endomyocardial implantation of bone marrow cells for treatment of severe coronary artery diseases (PROTECT-CAD trial). Eur Heart J. 2007;28(24):2998–3005.

    Article  Google Scholar 

  25. van Ramshorst J, Bax JJ, Beeres SLMA, Dibbets-Schneider P, Roes SD, Stokkel MPM, et al. Intramyocardial Bone Marrow Cell Injection for Chronic Myocardial Ischemia. JAMA. 2009;301(19):1997.

    Article  Google Scholar 

  26. Wang S, Cui J, Peng W, Lu M. Intracoronary autologous CD34+ stem cell therapy for intractable angina. Cardiology. 2010;117(2):140–7.

    Article  Google Scholar 

  27. Losordo DW, Henry TD, Davidson C, Sup Lee J, Costa MA, Bass T, et al. Intramyocardial, autologous CD34+ cell therapy for refractory angina. Circ Res. 2011;109(4):428–36.

    Article  CAS  Google Scholar 

  28. Kastrup J, Jorgensen E, Fuchs S, Nikol S, Botker HE, Gyongyosi M, et al. A randomised, double-blind, placebo-controlled, multicentre study of the safety and efficacy of BIOBYPASS (AdGVVEGF121.10NH) gene therapy in patients with refractory advanced coronary artery disease: the NOVA trial. EuroIntervention. 2011;6(7):813–8.

    Article  Google Scholar 

  29. Perin EC, Silva GV, Zheng Y, Gahremanpour A, Canales J, Patel D, et al. Randomized, double-blind pilot study of transendocardial injection of autologous aldehyde dehydrogenase-bright stem cells in patients with ischemic heart failure. Am Heart J. 2012;163(3):415-421.e1.

    Article  CAS  Google Scholar 

  30. Verheye S, Jolicœur EM, Behan MW, Pettersson T, Sainsbury P, Hill J, et al. Efficacy of a device to narrow the coronary sinus in refractory Angina. N Engl J Med. 2015;372(6):519–27.

    Article  CAS  Google Scholar 

  31. Povsic TJ, Henry TD, Traverse JH, Fortuin FD, Schaer GL, Kereiakes DJ, et al. The RENEW trial: efficacy and safety of intramyocardial autologous CD34+ cell administration in patients with refractory angina. JACC Cardiovasc Interv. 2016;9(15):1576–85.

    Article  Google Scholar 

  32. Mark BD, Hlatky MA, Harrell FEJ, Lee KL, Califf RM, Pryor DB. Exercise treadmill score for predicting prognosis in coronary artery disease. Ann Intern Med. 1987;106(6):793–800.

    Article  CAS  Google Scholar 

  33. Esler MD, Krum H, Sobotka PA, Schlaich MP, Schmieder RE, Böhm M, et al. Renal sympathetic denervation in patients with treatment-resistant hypertension (The Symplicity HTN-2 Trial): A randomised controlled trial. The Lancet. 2010;376(9756):1903–9.

    Article  Google Scholar 

  34. Bhatt DL, Kandzari DE, O’Neill WW, D’Agostino R, Flack JM, Katzen BT, et al. A controlled trial of renal denervation for resistant hypertension. N Engl J Med. 2014;370(15):1393–401.

    Article  CAS  Google Scholar 

  35. Chaitman BR, Skettino SL, Parker JO, Hanley P, Meluzin J, Kuch J, et al. Anti-ischemic effects and long-term survival during ranolazine monotherapy in patients with chronic severe angina. J Am Coll Cardiol. 2004;43(8):1375–82.

    Article  CAS  Google Scholar 

  36. Tardif JC, Ponikowski P, Kahan T. Efficacy of the If current inhibitor ivabradine in patients with chronic stable angina receiving beta-blocker therapy: A 4-month, randomized, placebo-controlled trial. Eur Heart J. 2009;30(5):540–8.

    Article  CAS  Google Scholar 

  37. Werner GS, Martin-Yuste V, Hildick-Smith D, Boudou N, Sianos G, Gelev V, et al. A randomized multicentre trial to compare revascularization with optimal medical therapy for the treatment of chronic total coronary occlusions. Eur Heart J. 2018;39(26):2484–93.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal

    Catarina Palma

  2. Laboratory of Clinical Pharmacology and Therapeutics, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal

    Cláudio David, Ricardo M. Fernandes, João Costa, Joaquim J. Ferreira & Daniel Caldeira

  3. Instituto de Medicina Molecular, Faculty of Medicine, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal

    Cláudio David, Ricardo M. Fernandes, João Costa & Joaquim J. Ferreira

  4. Centro Cardiovascular da Universidade de Lisboa (CCUL@RISE), Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal

    Cláudio David, Fausto J. Pinto & Daniel Caldeira

  5. Department of Pediatrics, Santa Maria Hospital, Centro Hospitalar Univesitário Lisboa Norte (CHULN), Centro Académico de Medicina de Lisboa (CAML), Lisbon, Portugal

    Ricardo M. Fernandes

  6. Cardiology Department, Hospital Santa Maria, Centro Hospitalar Univesitário Lisboa Norte (CHULN), Centro Académico de Medicina de Lisboa (CAML), Lisbon, Portugal

    Fausto J. Pinto & Daniel Caldeira

  7. CNS – Campus Neurológico Sénior, Torres Vedras, Portugal

    Joaquim J. Ferreira

Authors
  1. Catarina Palma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cláudio David
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ricardo M. Fernandes
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fausto J. Pinto
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. João Costa
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joaquim J. Ferreira
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Daniel Caldeira
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CP and DC contributed to the study conception and design. Data collection and analyses were performed by CP, CD and DC. The first draft of the manuscript was written by CP and all authors commented and contributed significantly to the current version of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Daniel Caldeira.

Ethics declarations

Ethics approval and consent to participants

This article does not contain any studies with human participants or animals performed by any of the authors.

Consent for publication

Not applicable.

Competing interests

DC has participated in educational meetings and/or attended conferences or symposia (including travel, accommodation, and/or hospitality) with Bristol-Myers Squibb, Bayer, Boehringer Ingelheim, Daiichi Sankyo, Merck Serono, Ferrer, Pfizer, Novartis, and Roche > 3 years; no conflicts of interest < 3 years. JJF had speaker and consultant fees with Grünenthal, Fundação MSD (Portugal), TEVA, MSD, Allergan, Medtronic, GlaxoSmithKline, Novartis, Lundbeck, Solvay, BIAL, Merck Serono, Merz, Ipsen, Biogen, Acadia, Allergan, Abbvie, Sunovion-Pharmaceuticals. FJP had consultant and speaker fees with Astra Zeneca, Bayer, BMS, Boehringer Ingelheim and Daiichi Sankyo. There is no any other conflict of interest by the rest of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

 Search strategy, study selection and risk of bias.

Additional file 2:

 Analyses of exercise time (measured as mean difference, and subgroup analyses), CCS class change and anginal episodes.

Additional file 3:

 Publication bias.

Additional file 4:

 Sensitivity analyses and meta-regressions.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Palma, C., David, C., Fernandes, R.M. et al. The sham effect of invasive interventions in chronic coronary syndromes: a systematic review and meta-analysis. BMC Cardiovasc Disord 22, 223 (2022). https://doi.org/10.1186/s12872-022-02658-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12872-022-02658-x

Keywords

BMC Cardiovascular Disorders

ISSN: 1471-2261

Contact us