Abstract
Objectives: To examine this association by comparing patient profiles in 2 closely affiliated hospitals and by examining their association with quality metrics.
Methods: We performed a retrospective cohort study comparing a university level comprehensive stroke centers (CSC) with its teaching hospital and local stroke unit (LSU) using routinely collected quality assurance data over a 2 year period. Both hospitals were closely affiliated, shared important resources and medical staff rotated amongst both hospitals. We compared patient profiles as well as internationally recognized quality metrics and examined the association of profiles with quality metrics.
Results: A total of 2,462 patients were treated in the CSC and 726 in the LSU. The LSU had a longer door-to-image and door-to-needle times. Rate of systemic thrombolysis was lower in the LSU. Patient profiles differed significantly and were associated with door-to-image and door-to-needle times as well as intravenous thrombolysis rates, even when adjusted for stroke service level. The diagnostic procedures for stroke work-up were similar. Discharge management differed strongly.
Conclusion: Although LSUs and CSCs are the primary care providers in their respective regions, differences in patient profiles may contribute to differences in performance parameters. Adjusting for patient profiles may improve the comparability of the quality of stroke care provided by hospitals belonging to different stroke service levels.
Stroke remains a devastating disease causing severe disability and high mortality rates despite novel treatments and overall declining death rates in developed countries.1 Improvement of treatment standards through optimization and standardization of treatment is an essential tool to further decrease death rates and improve outcomes. Concepts to reduce both prehospital and in-house delays to increase intravenous thrombolysis (IVT) rates have been explored extensively in recent years and continue to be refined.2-4
The introduction of specialized stroke units contributed significantly to better outcomes and lower mortality for stroke patients by setting requirements for training of staff, patient monitoring, diagnostic work-up and by improving discharge practices.5-7 In addition to setting internationally recognized standards for treatment of stroke patients, standardization of treatment and introduction of comparable quality metrics allowed for both routine data collection and benchmarking of hospitals, admission wards and treatment regimes. This can be used to further improve care and outcomes. However, differences in quality metrics remain significant between primary stroke care providers despite standardization of care. This is in part attributable to differences in in-house standards and local treatment practices. Large-scale studies have suggested that quality metrics such as rates of IVT and endovascular treatments are higher in comprehensive stroke centers (CSC) than primary care centers (LSU) and risk-adjusted mortality rates can be different as well.8 Other studies comparing CSCs and LSUs have confirmed that clinical outcomes are dependent on the level of stroke care.9 Most studies have suggested that individual hospital profiles have a significant impact on patient outcomes, mostly attributed to availability of stroke units and patient volumes.10 However, these studies considered hospitals that function mostly independently and with significant disparities in training of medical staff which may affect quality of treatment while little is known about the causes for differences in quality metrics seen among closely affiliated hospitals that share similar resources and operating procedures. We believe that patient profiles may affect quality metrics such as door-to-needle and door-to-image times significantly and relevant differences in patient profiles may contribute to differences in other quality metrics for stroke care in otherwise similar hospitals.
We explored differences in-between a major urban university hospital, which is a CSC, and its closely affiliated rural teaching hospital with its LSU both in terms of patient profiles and quality metrics. We hypothesized that, although both hospitals are primary stroke care providers for their respective regions and both share a similar basic clinical infrastructure and rotating medical staff, patient profiles contribute to differences in quality metrics of stroke care.
Methods
A retrospective cohort study comparing a university hospital and CSC with its closely affiliated teaching hospital which is in itself a LSU was performed. Both hospitals belong to the same stroke network, are located in close proximity (40 km) to one another and provide similar standards of stroke unit care with 24/7 access to CT angiography. Medical staff (both residents and attending physicians) rotate in-between both hospitals and therefore receive similar training and have a similar level of expertise. Close cooperation between the 2 hospitals includes both teleneurology and teleradiology services during nights and on weekends. The CSC covers all aspects of acute stroke care including a subspecialized emergency room (ER) for neurological patients and 24/7 endovascular therapy. All other forms of treatment and diagnostic workups are also provided in the teaching hospital. The ER in the teaching hospital is staffed by a consultant neurologist during office hours and by internal medicine residents at night and on weekends with teleneurology services being provided by trained staff at the CSC. Only patients requiring endovascular interventions were transferred to the CSC.
Data was collected as part of a prospective stroke registry of stroke patients treated as in-house patients in the federal state Baden-Wuerttemberg of Germany. Patients were recruited consecutively over a 2 year period. All hospitals must supply quality metrics data to this registry for patients aged ≥18 years admitted within 7 days of symptom onset with the diagnosis of stroke (10th revision of the International Classification of Diseases) as outlined in the German Social Code V, 112, so patient consent to data collection is not necessary (collected data is anonymized). Participating hospitals receive annual quality reports, which incorporate a benchmarking of the hospital regarding quality metrics. Plausibility checks of data are carried out regularly by local authorities and accuracy of raw data is examined in random samples. If the data reported by a hospital does not meet the strict quality criteria measures such as financial penalties may be introduced to improve documentation and transmission rates.11 Details on data collection and quality can be found elsewhere.11
Standardized documentation for the stroke registry was filled out by treating physicians and nursing staff. Data collected included demographic parameters; past medical history; mode of hospital admission; time of hospital admission; admission ward (intensive care unit, stroke unit, normal ward); admission to a neurology or internal medicine department; timing and type of diagnostic procedures; rtPA treatment rates and door-to-needle time; treatment complications; discharge information; and intra-hospital mortality. The pre-stroke modified Rankin Scale (pmRS) score was estimated at admission. Only patients eligible for IVT were included in comparisons of IVT rates and door-to-needle times. We classified ICD-10 codes I61 and I62 as intracranial hemorrhage and I63 as ischemic stroke. Severity of stroke was assessed with the National Institutes of Health Stroke Scale (NIHSS).12 Information on comorbidities was also collected. We were not able to collect follow up information as this was not intended as part of the stroke registry and data privacy laws in Germany prohibit collection of follow-up data without patient consent. The analysis was approved by the Medical Faculty Heidelberg, University of Heidelberg (S339-2012). This study was conducted according to the principles of the Helsinki declaration.
Part of the source data is automatically transferred from the electronic medical records or is documented manually in the electronic patient management system. Source files were filled out by the treating physicians. Incoming data were checked based on plausibility checks, raw data are checked by random sampling. A structured dialogue, an instrument of quality improvement, is initiated if a hospital shows abnormal quality aspects namely, rate of data transmission or consistency of data.
Statistical analysis
Data are presented as means and standard deviations (SD), as relative frequencies in the form of percentages or median with interquartile range in the text. Relative frequencies were always described as values of the CSC versus LSU in the text. For the statistical analysis, Fisher’s exact test and Chi-squared tests were used to determine differences of frequencies and the t-test and Mann-Whitney-U-Test were used to determine differences of means and medians. P-values <0.05 were considered to show a significant difference. Association of patient profiles with quality metrics was calculated using binary regression analysis expressed as adjusted odds ratios for stroke service level of the admitting hospital. Unadjusted regression analysis demonstrating association of the hospital of admission with quality metrics was included for comparison.
Results
We analyzed data from 2 annual quality assurance reports over 2 years, one from a university hospital with a CSC and one from a community hospital with an LSU.
Patient profiles and mode of admission
Altogether, 2,462 patients from the CSC and 726 patients from the LSU fulfilled the inclusion criteria for acute stroke treatment. The proportion of patients with intracerebral hemorrhage (ICH) was higher in the CSC (18% versus 4%), while higher proportions of patients with cerebral ischemia (66% versus 73%) and transient ischemic attack (TIA; 17% versus 23%) were treated in the LSU. Mean age was significantly lower in the CSC (68.6 years [14.2] versus 73.8 years [12.1]). Patients in the CSC were more frequently male than in the LSU (57% versus 49%). A higher proportion of patients with low stroke severity, measured as NIHSS score of 0, were found in the LSU (14% versus 25%). Self-referral was more frequent in the LSU (15% versus 24%), while a higher proportion of patients admitted to the CSC came via emergency physicians and emergency medical services (43% versus 32%). Referral from other hospitals occurred more often in the CSC than in the LSU. Comorbidities, such as prior stroke, arterial hypertension, atrial fibrillation, diabetes mellitus, and hypercholesterolemia were more frequent in the LSU. Patients had a lower pre-stroke Rankin Scale in the CSC (Table 1).
Performance in quality parameters regarding acute stroke management
The proportion of patients receiving acute stroke treatment (namely, IVT) is a quality parameter of stroke care. It is defined as the proportion of all patients between 18-80 years receiving IVT. This was over 4 times higher in the CSC than in the LSU (17% versus 4%; Table 2). The quality parameter of door-to-needle-time is defined as the proportion of patients having a door-to-needle-time of less than one hour. Fewer patients were treated with a short door-to-needle-time in the LSU (≤60 min: 69% [CSC] versus 29% [LSU]). The time to initial imaging (door-to-image-time) is regarded as part of the door-to-needle-time and is also a quality parameter of stroke care. Again, door-to-image times were shorter in the CSC (within 30 min of admission: 38% versus 22%).
Regression analysis showed that, in addition to stroke service level, patient profiles such as stroke severity assessed by NIHSS, state of consciousness, aphasia at admission and duration of symptoms were associated with door-to-needle-times, door-to-image-times and IVT rates (Table 4). We found a number of factors such as age, pmRS, NIHSS, duration of symptoms and specific clinical symptoms at admission that were strongly associated with door-to-image times. Atrial fibrillation was associated significantly with both door-to-image time and increased the odds significantly for treatment with IVT. Previous stroke significantly decreased the odds for being treated with IVT. All other comorbidities were not associated with quality metrics.
Performance in quality parameters of stroke work-up
Details of stroke etiology work-up and intrahospital stroke care are summarized in Table 3. The proportion of patients that received neurosonography (extra- and intracranial) were comparable in the 2 hospitals, although symptomatic carotid stenosis was found more often in the CSC (10% versus 6%). Transthoracic- or transesophageal-echocardiography was performed slightly more often in the LSU (77% versus 87%). The LSU had slightly higher rates of early secondary stroke prevention with platelet inhibitors (66% for the CSC versus 75% for the LSU), platelet inhibitors at discharge (59% CSC versus 68% LSU), and oral anticoagulation (23% CSC versus 28% LSU). Prophylaxis of thrombosis was more often initiated at the CSC (95% versus 77%), but more CSC patients suffered from complications such as pneumonia and thrombosis (15% versus 8%). Symptomatic intracerebral hemorrhage as a complication of thrombolytic therapy occurred to about the same extent in both hospitals.
Discharge management
Information about discharge are summarized in Table 3. A higher proportion of patients in the CSC were transferred to other hospitals (32% versus 7%). The LSU had higher rates of regular discharge home (49% versus 68%). The quality parameter of direct discharge to rehabilitation (11% to 19%) was achieved in a higher proportion of patients in the LSU. Discharge to a nursing home was more frequent in the LSU (0% versus 3%). Mean length of hospital stay were lower in the CSC (mean 6.2 days in the CSC versus 7.1 days in the LSU).
Discussion
Our main findings were as follows: between the 2 hospitals we found 1) differences in patient profiles, especially in baseline characteristics, stroke symptoms and severity at admission; 2) relevant differences in quality metrics for acute stroke care (namely, door-to-needle-time and door-to-image-time); 3) evidence that patient profiles affect results of quality metrics; 4) comparable coverages of stroke work-up in both hospitals, but differences in discharge management.
Our results suggested that patient profiles at the CSC and LSU differed significantly. Patients admitted to the rural LSU were older with higher pmRS and lower stroke severity as assessed by NIHSS score at admission. Rural communities in developed countries have been found to have a different age distribution, higher frequency of comorbidities and less effective risk factor control.13 It has been described that these factors, together with inferior access to centers offering high quality stroke care, could contribute to worse clinical outcomes in rural communities. Rural communities in the United States have therefore been described as an “underserved minority” in terms of stroke care and more comprehensive stroke networks have been established to increase coverage in these areas.13 Geographical distance to the next hospital is unlikely to have had a significant impact in our study, since both hospitals are located in relatively close proximity (within 40 km) with comparable size of catchment areas and similar basic infrastructure. Despite both hospitals being primary care providers in their regions, patients with more severe strokes were presented to the CSC explaining in part why stroke severity and IVT rates were greater in the CSC. This is likely to affect both quality metrics and patient outcomes and translates to higher complication rates in the CSC where more severely affected patients were treated.
We also found relevant differences in the quality metrics for acute stroke care. In particular the proportion of patients receiving IVT was 4 times higher in the CSC. This is in line with other analyses of IVT rates in relation to stroke service level,8,14 although it has been shown that a stroke network (consisting of LSUs) can achieve IVT rates similar to those of a CSC.15 Age and preexisting disabilities are known predictors of thrombolytic therapy, and both differed significantly between the LSU and CSC and can in part explain the differences in quality metrics found in-between both hospitals.16 The quality parameter of door-to-needle-time showed a higher proportion of patients with a door-to-needle-times of ≤1 hour in the CSC. A subgroup of patients (namely, those on oral anticoagulation) require specialized diagnostic procedures (namely, bedside coagulation testing), which is not available in the LSU and could account for some of the difference.17 In addition to other patient related factors (namely, history of hypertension, previous stroke, stroke severity), the main predictor of door-to-needle-time discussed in current literature is patient volume,18 which was smaller in the LSU. Similarly, door-to-image-times of >30 minutes were much more frequent in the LSU when compared to the CSC. However, stroke service level of the admitting hospital did not fully explain the observed differences in quality metrics observed in this study and it has been shown that similar door-to-needle-times are achievable in a stroke network, even if they include smaller stroke centers.16 Since both hospitals shared a number of important resources, in particular trained medical staff which rotated in-between hospitals and is an important contributor to quality of treatment, substantial differences in patient profiles or differences in in-house standards must therefore explain the difference. Although some of this difference can be explained by the fact that the CSC provides a specialized neurological emergency room, we believe that this does not fully explain the difference. We therefore performed a statistical analysis of our data to identify associations of patient profiles with quality metrics while adjusting for hospital of admission. We were able to demonstrate in this analysis that several patient characteristics were independently associated with quality metrics. This included patient age, pmRS, NIHSS at presentation, clinical symptoms at presentation, type of admission as well as stroke service level. Previous stroke and atrial fibrillation were also associated with IVT rates. Other comorbidities were not associated with quality metrics.
The subacute management and stroke work-up were similar in the CSC and the LSU (for exampe, rate of ultrasound examination of the vessels supplying the brain of echocardiography). As stroke work-up follows standardized diagnostic procedures, independent of patient profiles, the completeness of stroke-work up was comparable between the stroke service levels, suggesting that differences in the stroke-work up could be used as a parameter of quality of care. Also, there was a comparable rate of neurosonology. Overall, we found good evidence that the establishment of stroke units contributes to similar standards of care for hospitalized stroke patients in the CSC and LSU. In the CSC, more patients presented with symptomatic carotid stenosis (10% versus 6%), which may be attributable to the lower mean age.19 The higher rate of complications in the CSC (15% versus 8%) and the lower rate of patients on antithrombotic therapy or anticoagulation may be influenced by patient profiles, especially greater stroke severity and given the higher proportion of patients treated in an intensive care unit. The rate of hemorrhagic effacement after IVT was similar in both hospitals (8% versus 6% in LSU), representing similar confidence in the quality of IVT. The mean length of stay was longer in the LSU than in the CSC, possibly resulting from the higher rate of patients transferred to other hospitals from the CSC. More patients were directly transferred from the LSU to a rehabilitation facility or were discharged home. As a result of different transfer and discharge practices, the value of using the length of stay as a quality parameter to compare hospitals is reduced.
Importance of findings
We were able to show that baseline patient characteristics as well as other aspects of patient profiles can affect quality metrics significantly, even when adjusted for stroke service level. This is important, since adjustment for these factors in future studies could enhance the comparability of hospitals and quality metrics in future studies and in clinical routine. We were also able to demonstrate that, although the LSU and CSC in this study are closely affiliated, have a distance of only 40 km, and share important resources, relevant differences in both patient profiles and quality metrics can persist. Adjustment of the suggested factors and possibly for stroke service level should therefore be strongly considered in future studies. Future studies should also examine the reasons for differences in quality metrics and patient outcomes in-between stroke service levels further in an effort to optimize patient treatment in hospitals providing lower service levels in underserved communities.
Study limitations
We only compared a single LSU with a single CSC, and this limits the generalizability of the results, but our analysis aimed to show that (unadjusted) benchmarking in some quality metrics could be influenced by differences in patient profiles and we did not intend to estimate the magnitude of this effect. Stroke patients referred to other hospitals were not included. We could not investigate a possible impact of the exact distance to the treating hospital on quality metrics since we did not have this information. Not all parameters were documented for all patients (missing data) namely, for patients who had imaging before admission no admission-to-image-time could be calculated. We only compared the performance in selected quality metrics, which also limits the generalizability of the results. We performed a mostly descriptive data analysis with no means of stratifying for diverse markers such as age, comorbidities, or pre-stroke mRS. Although both the LSU and CSC share important resources such as medical staff, basic organization of stroke treatment and teleneurological and teleneuroradiological services during nights and on weekends, differences in logistics, in particular in the organization of emergency room care, do remain. We therefore adjusted all calculated odds ratios for stroke service level of the hospital of admission to account for this effect.
In conclusion, the direct comparison of relevant quality metrics of acute stroke care is limited by differences in patient profiles between CSCs and LSUs. A possible way to reduce bias in benchmarking of different hospitals would be to adjust for differences in patient profiles and to perform the benchmarking according to the stroke service level. The reasons for the lower overall performance in acute stroke management in the LSU should be further explored.
References
* References should be primary source and numbered in the order in which they appear in the text. At the end of the article the full list of references should follow the Vancouver style.
* Unpublished data and personal communications should be cited only in
the text, not as a formal reference.
* The author is responsible for the accuracy and completeness of references
and for their correct textual citation.
* When a citation is referred to in the text by name, the accompanying
reference must be from the original source.
* Upon acceptance of a paper all authors must be able to provide the full paper for each reference cited upon request at any time up to publication.
* Only 1-2 up to date references should be used for each particular point in the text.
Sample references are available from: http://www.nlm.nih.gov/bsd/uniform_requirements.html
Acknowledgment
We would like to thank Scribendi (www.scribendi.com) for English language editing.
Footnotes
Disclosure. Authors have no conflict of interests, and the work was not supported or funded by any drug company.
- Received October 29, 2019.
- Accepted May 7, 2020.
- Copyright: © Neurosciences
Neurosciences is an Open Access journal and articles published are distributed under the terms of the Creative Commons Attribution-NonCommercial License (CC BY-NC). Readers may copy, distribute, and display the work for non-commercial purposes with the proper citation of the original work.