Skip to main content

Thrombolysis implementation intervention and clinical outcome: a secondary analysis of a cluster randomized trial

Abstract

Background

Multiple studies have attempted to increase the rate of intravenous thrombolysis for ischemic stroke using interventions to promote adherence to guidelines. Still, many of them did not measure individual-level impact. This study aimed to make a posthoc comparison of the clinical outcomes of patients in the “Thrombolysis ImPlementation in Stroke (TIPS)” study, which aimed to improve rates of intravenous thrombolysis in Australia.

Methods

A posthoc analysis was conducted using individual-level patient data. Excellent (Three-month post treatment modified Rankin Score 0–2) and poor clinical outcome (Three-month post treatment modified Rankin Score 5–6) and post treatment parenchymal haematoma were the three main outcomes, and a mixed logistic regression model was used to assess the difference between the intervention and control groups.

Results

There was a non-significant higher odds of having an excellent clinical outcome of 57% (odds ratio: 1.57; 95% CI: 0.73–3.39) and 33% (odds ratio: 1.33; 95% CI: 0.73–2.44) during the active-and post-intervention period respectively, for the intervention compared to the control group. A non-significant lower odds of having a poor clinical outcome was also found in the intervention, relative to control group of 4% (odds ratio: 0.96; 95% CI: 0.56–2.07) and higher odds of having poor outcome of 44% (odds ratio: 1.44 95% CI: 0.61–3.41) during both active and post-intervention period respectively. Similarly, a non-significant lower odds of parenchymal haematoma was also found for the intervention group during the both active- (odds ratio: 0.53; 95% CI: 0.21–1.32) and post-intervention period (odds ratio: 0.96; 95% CI: 0.36–2.52).

Conclusion

The TIPS multi-component implementation approach was not effective in reducing the odds of post-treatment severe disability at 90 days, or post-thrombolysis hemorrhage.

Trial registration

Clinical Trial Registration-URL: http://www.anzctr.org.au/ Unique Identifier: ACTRN12613000939796.

Peer Review reports

Background

Internationally and in Australia, stroke is a leading cause of death and disability [1, 2]. Improved outcomes after Acute Ischemic Stroke (AIS) can be achieved with intravenous thrombolysis administered within 4.5 h of symptom onset [3]. Despite being the guideline-recommended treatment option for AIS, the average rate of intravenous thrombolysis implementation was only 7% across Australia at the time this health systems trial was conducted [2] and much lower in regional hospitals [4]. Several pre and in-hospital barriers have been identified as contributing to the poor implementation of intravenous thrombolysis, including sub-optimal triage, lack of appropriate infrastructure and expertise, and physicians’ uncertainty in prescribing intravenous thrombolysis [5].

The Thrombolysis Implementation in Stroke (TIPS) study, was a cluster-randomized trial which aimed to improve thrombolysis rates through a multi-level, multi-component, in-hospital intervention which was implemented in 10 of 20 study hospitals across Australia [6]. The trial resulted in a transient uplift in intravenous thrombolysis rates in the intervention hospitals. However, the primary outcome of the trial was an overall non-significant increase in thrombolysis rates in the intervention versus control sites which was not sustained beyond the 16- month intervention period [7]. As described in the main trial outcome paper [7], there were challenges with intervention implementation at some regional hospitals, and the uptake of “best practice” knowledge translation strategies was limited by clinical leadership availability and staffing constraints [8]. However, despite the non-significant change in overall thrombolysis rates seen in the trial, it was considered possible that the TIPS intervention may have had a positive effect on individual patient clinical outcomes, for example, influencing improved selection of cases for thrombolysis treatment and streamlining of workflows [9]. A posthoc analysis of the TIPS database provides a unique opportunity to explore whether differences in individual patient clinical outcomes occurred within and between study groups.

This posthoc analysis of the TIPS data tested the hypothesis that the three-month clinical outcomes of disability (measured through modified Rankin Scale, mRS) and post-thrombolysis hemorrhage would show more favourable profiles in patients managed at the hospitals exposed to the TIPS intervention, relative to control hospitals.

Methods

TIPS was a clustered randomized controlled trial that involved 20 hospitals from three Australian states: Victoria, New South Wales, and Queensland. All hospitals that participated in the TIPS study had either a Stroke Care Unit or staffing equivalent to a stroke physician and a nurse, and an emergency department. Ethical approval for the TIPS study was obtained from relevant human research ethics committees in each state, from each participating hospital, and The University of Newcastle Human Research Ethics Committee. The study adheres to CONSORT guidelines (Supplement 1).

Hospitals were randomized, stratified by baseline intravenous thrombolysis rate, either to receive a multi-component multi-disciplinary collaborative intervention, which focused on the safe use of intravenous thrombolysis therapy for AIS patients; or to continue with standard care. Blinding was not possible because of the involvement of staff in the intervention activities. Pre-intervention data were collected for each hospital for 12–24 months before implementation of the intervention. Following the pre-intervention period, a 16-month active intervention period occurred during which intervention hospitals received the intervention while control hospitals continued with standard care. The intervention was then withdrawn, and outcomes monitored during a 12-month post-intervention period.

Measures

Data on all thrombolysed cases were entered into a TIPS study-specific database in a de-identified form by the hospital staff. The variables of interest were pre- and three-month post-thrombolysis mRS and rates of post-thrombolysis parenchymal haematoma as detected in routine clinical practice following guideline based post-thrombolysis imaging recommendations [10]. Hospital staff entering data were trained in the Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) characteristics of the European Cooperative Acute Stroke Study 2 (ECASS 2) classification system and were asked to review source imaging in the classification of haemorrhagic transformation [11]. The TIPS study-specific database included questions and an algorithm to ensure consistency in the classification of the mRS. At 90 days post-admission, patients were contacted by hospital staff to record the mRS either by phone or in a clinic. We used two dichotomous definitions of the 90-day clinical mRS outcome to reflect the most favourable and most catastrophic outcomes: excellent clinical outcome (mRS 0–1 vs 2–6), and poor outcomes (mRS 5–6 vs. 0–4). Patients who were thrombolysed also had their baseline, and where available follow-up, imaging recorded; all patients received a baseline non-contrast CT at a minimum. Hospital staff for the presence of a hemorrhage using the ECASS 2 scoring system assessed all 24-h imaging [11].

Haemorrhagic events were classified according to clinical and CT criteria. Haemorrhagic infarction 1 (HI1) was defined as small petechiae along the margins of the infarct; haemorrhagic infarction 2 (HI2) as confluent petechiae within the infarcted area but no space-occupying effect; parenchymal haemorrhage (PH1) defined as blood clots in 30% or less of the infarcted area with some slight space-occupying effect; and parenchymal haemorrhage (PH2) defined as blood clots in more than 30% of the infarcted area with substantial space-occupying effect [11]. For our study, we defined both PH1 and PH2 as post-treatment parenchymal haematoma (PH).

Other data of interest included age, gender, pre-stroke mRS, pre- and post-thrombolysis National Institutes of Health Stroke Scale (NIHSS) which measures the severity of stroke; and pre-thrombolysis systolic blood pressure (SBP) on admission which is a risk factor for poor outcome.

Intervention

The intervention was a multi-component, collaborative intervention that was based on a knowledge translation approach and the behavioural change wheel [12] (Fig. 1). The intervention sites signed a written collaborative agreement and then participated in a site-specific situational analysis which was followed by a collaborative workshop, teleconferences, feedback, and monitoring as detailed in Fig. 1. The control sites were not provided with any intervention and could be considered a ‘usual care’ condition.

Fig. 1
figure1

Legend: Framework of interventional activity

Statistical analysis

The main study was powered to detect a difference in thrombolysis rates between the two groups [6]. Assuming the same parameters as the original power calculation (cluster coefficient of variation = 0.4; alpha = 0.05; 10 clusters per arm), this secondary analysis of all thrombolysed cases (n = 1559) had 80% power to detect absolute differences in these key secondary outcomes between intervention and control groups of between 22 and 33% for outcomes with prevalence’s ranging from 50 to 75%. The analysis population is all those that were treated with intravenous thrombolysis. Data was not available on patients that were considered for intravenous thrombolysis but not thrombolysed. Primary analyses compared outcomes between intervention and control group at the active intervention and post-intervention phases. Three mixed effects logistic regression models were used to assess the difference in the study outcomes, proportion of patients with excellent and poor clinical outcome and with PH, between the intervention and control arm during the both active and post intervention period separately. These three models included fixed effects for baseline thrombolysis rates (site-level), pre-morbid mRS, baseline NIHSS; treatment group. Another three mixed-effects logistic regression models were used to determine the effect of the educational intervention on changes in clinical outcomes from pre to active and pre to post-intervention period. These three models included fixed effects for baseline thrombolysis rates (site-level), pre-morbid mRS, baseline NIHSS; treatment group, period (pre vs post) and the interaction between treatment and period. All the above mentioned models included a random intercept for hospital site to account for correlations of individuals within the same site. Due to missing data on mRS outcome, multiple imputation analyses using the chained regression equations method were performed. The missing data was imputed based on hospital site, pre-morbid mRS, NIHSS, age and gender. The imputation process (n = 200 imputations) was conducted assuming the data were missing at random and combined using Rubin’s method. Statistical significance was defined as a two-tailed p-value of < 0.05. Statistical analyses were programmed using SAS v9.4 (SAS Institute, Cary, North Carolina, USA).

Results

From January 2011 to December 2015, data on 1559 patients who received intravenous thrombolysis were recorded from the 20 hospitals that participated in the TIPS study. This included pre-intervention period data from 599 (38%) patients, active-intervention period data from 538 (35%) patients and post-intervention period data from 422 (27%) patients. Finally, a total of 1184 (76%) patient’s data were included. The pattern of missing data for 3 month post treatment mRS between intervention and control groups is reported in Fig. 2. The pattern of missing values related to patient characteristics has been described in Supplement 2. Overall, the mean (Standard Deviation; SD) age was 71.34 (14.55) years, and 533 (54%) were male; 70% (n = 393) of patients reported no pre-stroke disability (mRS = 0) during the pre-intervention phase, with the corresponding proportions being 64% (n = 318) in the active-intervention period and 55% (n = 188) in the post-intervention period. A detailed description of patient characteristics has shown in Table 1. No differences in the patient selection were observed among intervention and control hospitals at each time point. A table comparing the clinical and demographic features of patients with vs without mRS at 90 days has been added in Supplement 3.

Fig. 2
figure2

Legend: Distribution of patients within two study arms over three study periods

Table 1 Description of patient characteristics based on intervention and intervention implementation phase

Disability outcomes (mRS)

There was a non-significantly higher odds of having an excellent clinical outcome of 57% (odds ratio: 1.57; 95% CI: 0.73–3.39; Table 2) during the active intervention period and 33% (odds ratio: 1.33; 95% CI: 0.73–2.44) during the post-intervention period. The intervention was associated with a non-significantly lower odds of having a poor clinical outcome of 4% (odds ratio: 0.96; 95% CI: 0.56–2.07;) during the active intervention period and a higher odds of 44% (odds ratio: 1.44; 95% CI: 0.61–3.41;) during the post-intervention period, compared to the control group. The within-group analysis compared to baseline and the comparison between the intervention and control arm for both active and post-intervention period are shown in Table 3, and the effects remained non- significant. The disability outcome result also remained non-significant, even after applying the multiple imputation method (Supplement 4).

Table 2 Odds ratio (OR) with 95% Confidence Interval (CI) between intervention vs control during active and post intervention period
Table 3 Within group and between group change between pre vs. Active and pre vs. post intervention period for the both intervention and control

Parenchymal Haematoma (PH)

During active and post-intervention period, the intervention group showed a non-significant decrease in the odds of having post-treatment PH by 47% (OR: 0.53, 95% CI: 0.21–1.32) and 4% (OR: 0.96, 95% CI: 0.36–2.52), during active and post-intervention period respectively (Table 2).

The within-group analysis compared to baseline and the comparison between the intervention and control arm for both active and post-intervention period are shown in Table 3, and the effects remained non- significant. The outcome result was also non-significant after applying the multiple imputation method to explore the impact of various assumptions regarding the missing data (Supplement 5).

Discussion

Although the TIPS trial did observe a significant but transient increase in thrombolysis rates (OR = 1·6; 95% CI; 1·1–2·3) during the initial 16-month active intervention period [7], this posthoc analysis at the individual patient level, found that the intervention promoting thrombolysis implementation did not result in any significant difference in excellent or poor outcome between patients treated at intervention versus control hospitals. A non-significant decrease in the rate of hemorrhages following intravenous thrombolysis was seen during both active and post-intervention period. Therefore, our hypothesis that exposure to the TIPS intervention may have resulted in enhanced care and more favourable outcomes for thrombolysis patients treated in the intervention hospitals is not supported by the data. This lack of influence on individual patient clinical outcomes may be due to several factors. The first may be purely related to the size of the available sample and available power to detect a statistically significant change. Our point estimates indicate a possible increase in excellent outcomes and a potential decrease in poor outcomes and haemorrhages. However, despite an efficient statistical analytical method using baseline data, these proportions did not reach statistical significance. Of course, the main trial was designed to identify a change in the implementation of best evidence practice (i.e. the proportion of stroke cases receiving thrombolysis) rather than a change in clinical outcome.

A second factor is the trend throughout the trial for increasingly favourable outcome rates in the control group. The control group demonstrated an increase in the proportion of patients with excellent outcomes in both the active and post-intervention periods. Such results could have several explanations. In Australia, from 2010, several national-level health policy initiatives were released with the intent to improve the management of stroke broadly including intravenous thrombolysis [13]. The revised Clinical Guidelines for Stroke Management were released in 2010 by the NHMRC. The National Stroke Audit Reports for Acute Services (2011, 2013, 2015 and 2017) were delivered to the health professionals through online health portals [13]. A new Clinical Council was established by the National Stroke Foundation in 2011 to improve the quality of stroke care by ensuring that physicians were aware of the latest clinical evidence and initiatives relating to quality stroke care [13]. These programs and initiatives focused were active during the trial period and could have driven the secular trends observed in the outcomes of interest. It is also conceivable that there was some degree of contamination and some crossover of interventional material between control and intervention sites, despite all care being taken to avoid this occurrence, due to the relatively small and tight-knit community of stroke care providers in Australia.

Further interpretation of the negative results of this individual patient analysis aligns with the well-recognised difficulty in shifting clinician behaviour and the neutral outcome of the main trial, where a comprehensive and multifaceted package of support and education aimed at knowledge translation failed to substantially or sustained oblique change practice. This difficulty is mirrored in several previous studies such as the PRomoting ACute Thrombolysis in Ischemic StrokE (PRACTISE) trial. PRACTICE was a cluster randomised trial in The Netherlands which used the breakthrough approach aiming to improve the thrombolysis rates. PRACTISE intervention failed to achieve a significant overall increase in thrombolysis rates. The study also evaluated the rate of symptomatic intracranial bleeding complications, the good clinical outcome at 3 months (mRS < 3) and mortality, and the effect of PRACTICE intervention on clinical outcome was non-significant. Finally, the study concluded that unregistered comorbidities and risk factors might have contaminated the findings [14]. The INcreasing Stroke Treatment through INterventional Change Tactics (INSTINCT) cluster randomised controlled trial in the US used a multilevel, barrier assessment-interactive educational intervention [15]. This trial also showed non-significant between-group differences in thrombolysis rates [15]. It highlighted the difficulties of knowledge translational strategies due to local factors such as familiarity with and motivation to adhere to the guidelines [15]. However, the study did not perform any individual patient-level analysis [15]. Currently, therefore, to our knowledge, there is no clinical trial evidence to suggest that health systems interventions targeting implementation of best evidence practise in stroke thrombolysis can improve thrombolysis patients’ clinical outcomes.

It should also note that there is also uncertainty around the choice of clinical outcome of relevance in health systems trials such as TIPS. The limitations of the modified Rankin score are well recognised [16], and it is possible that other patient-reported outcome measures such as quality of life scores would be more relevant secondary outcome measures for trials of this type.

Conclusion

The TIPS multi-component implementation approach was not effective in improving the odds of the 90-day excellent outcome or reducing the odds of having 90 days post-treatment poor outcome and severe post-treatment haemorrhage. Further study of the clinical impact of efforts to improve thrombolysis rate is warranted.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AIS:

Acute ischemic stroke

CT:

Computed tomography

ECASS:

European cooperative acute stroke study

HI:

Haemorrhagic infarction

INSTINCT:

INcreasing stroke treatment through INterventional change tactics

MRI:

Magnetic resonance imaging

mRS:

Modified Rankin scale

NIHSS:

National Institute of health stroke scale

PH:

Parenchymal Haematoma

PRACTISE:

PRomoting ACute thrombolysis in ischemic StrokE

SBP:

Systolic blood pressure

References

  1. 1.

    Feigin VL, Norrving B, Mensah GA. Global Burden of Stroke. Circ Res. 2017;120(3):439–48.

    CAS  Article  Google Scholar 

  2. 2.

    World Stroke Organization (WSO). Facts and Figures about Stroke. https://www.world-stroke.org/component/content/article/16-forpatients/84-facts-and-figures-about-stroke Accessed 22 June 2018.

  3. 3.

    Emberson J, Lees KR, Lyden P, Balckwell L, Albers G, Bluhmki E, et al. Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischaemic stroke: a meta-analysis of individual patient data from randomized trials. Lancet. 2014;384(9958):1929–35.

    CAS  Article  Google Scholar 

  4. 4.

    Leyden JM, Chong WK, Kleinig T, Lee A, Field JB, Jannes J. A population-based study of thrombolysis for acute stroke in South Australia. Med J Aust. 2011;194(3):111–5.

    Article  Google Scholar 

  5. 5.

    Eissa A, Krass I, Bajorekt BV. Barriers to the utilization of thrombolysis in acute ischemic stroke. J Clin Pharm Ther. 2012;37(4):399–409.

    CAS  Article  Google Scholar 

  6. 6.

    Paul CL, Levi CR, D'Este CA, Parsons MW, Bladin CF, Lindley RI, et al. Thrombolysis ImPlementation in stroke (TIPS): evaluating the effectiveness of a strategy to increase the adoption of best evidence practice--protocol for a cluster randomised controlled trial in acute stroke care. Implement Sci. 2014;9:38.

    Article  Google Scholar 

  7. 7.

    Levi CR, Attia JR, D'Este CA, Ryan AE, Henskens F, Kerr E, et al. A cluster randomised trial of thrombolysis implementation support in metropolitan and regional Australian stroke centres; lessons for individual and systems behaviour change. J Am Heart Assoc. 2020;9(3):e012732.

    CAS  Article  Google Scholar 

  8. 8.

    Grimshaw JM, Eccles MP, Lavis JN, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50.

    Article  Google Scholar 

  9. 9.

    Miller DJ, Simpson JR, Silver B. Safety of thrombolysis in acute ischemic stroke: a review of complications, risk factors, and newer technologies. Neurohospitalist. 2011;1(3):138–47.

    Article  Google Scholar 

  10. 10.

    National stroke Foundation. Clinical guidelines for stroke management. 2017. https://informme.org.au/Guidelines/Clinical-Guidelines-for-Stroke-Management-2017 Accessed, 22 Jun 2018.

    Google Scholar 

  11. 11.

    Hacke W, Kaste M, Fieschi C, von Kummer R, Davalos A, Meier D, et al. Randomised double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke (ECASS II). Second European-Australasian acute stroke study investigators. Lancet. 1998;352(9136):1245–51.

    CAS  Article  Google Scholar 

  12. 12.

    Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.

    Article  Google Scholar 

  13. 13.

    National stroke Foundation. History. Celebrating 20 years of Stroke Foundation. [Online]. Available at: http://www.strokefoundation.com.au Accessed 22 Jun 2018.

  14. 14.

    Dirks M, Niessen LW, van Wijngaarden JD, Koudstaal PJ, Franke CL, van Oostenbrugge RJ, et al. Promoting thrombolysis in acute ischemic stroke. Stroke. 2011;42(5):1325–30.

    CAS  Article  Google Scholar 

  15. 15.

    Scott PA, Meurer WJ, Frederiksen SM, Kalbfleisch JD, Xu Z, Haan MN, et al. A multilevel intervention to increase community hospital use of alteplase for acute stroke (instinct): a cluster-randomised controlled trial. Lancet Neurol. 2013;12:139–48.

    Article  Google Scholar 

  16. 16.

    Ghandehari K. Challenging comparison of stroke scales. J Res Med Sci. 2013;18(10):906–10.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We are thankful to all staffs and patients from the participating hospitals for their kind participation and support during the study period.

Funding

This study was funded by the National Health and Medical Research Council (NHMRC) partnership grant (569328), part-funded by an NHMRC Practitioner Fellowship (1043913) and NHMRC Translating Research Into Practice fellowship, and included partnership grant contribution funding from Boehringer Ingelheim, in-kind support from Agency for Clinical Innovation Stroke Care Network/Stroke Services New South Wales (NSW), Stroke Foundation and NSW Cardiovascular Research Network-National Heart Foundation, with a cash contribution from the Victorian Stroke Clinical Network and infrastructure funding from the Hunter Medical Research Institute and The University of Newcastle. The funders had no input into the design, data collection, analysis, interpretation of study findings, or preparation of manuscript.

Author information

Affiliations

Authors

Contributions

MGH, CLP, AB and CRL designed and prepared the study concept. MGH and CO analysed the data with advise from CLP, JRA, AB and CDE. MGH drafted the manuscript with advice from CLP, JRA, AR, EK, CAD, CO, AB, AHM, IH and CRL on method of data analysis, presentation of results. CLP, JRA, AR, EK, CAD, CO, AB, AHM, IH and CRL were involved in critical revision of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Md Golam Hasnain.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained from the Hunter New England Human Research Ethics Committee and from the University of Newcastle, Human Research Ethics Committee. Written informed consent was not taken from the patients as the study collected anonymous patient data from the hospital record and the intervention was implemented at the hospital level.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1

: Supplement 1: CONSORT 2010 checklist of information to include when reporting a randomised trial. Supplement 2: Number and percentage of missing values, n (%), for each patient characteristics. Supplement 3: Table comparing the clinical and demographic features of patients with vs without mRS at 90 day. Supplement 4: Odds ratio after multiple imputation between intervention vs control during active and post intervention period. Supplement 5: Within group and between group change after multiple imputation between pre vs. Active and pre vs. post intervention period for the both intervention and control.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Hasnain, M.G., Paul, C.L., Attia, J.R. et al. Thrombolysis implementation intervention and clinical outcome: a secondary analysis of a cluster randomized trial. BMC Cardiovasc Disord 20, 432 (2020). https://doi.org/10.1186/s12872-020-01705-9

Download citation

Keywords

  • Ischemic stroke
  • Intravenous thrombolysis
  • Implementation intervention
  • Clinical outcome