| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Circulation. 2006;114:1565-1571.)
© 2006 American Heart Association, Inc.
Health Services and Outcomes Research |
From the Department of Medicine, Denver Health Medical Center, Denver, Colo (F.A.M., P.N.P.); Department of Medicine, University of Colorado at Denver and Health Sciences Center, Denver (F.A.M., P.M.H., P.N.P., J.S.R.); Colorado Health Outcomes Program, University of Colorado at Denver and Health Sciences Center, Aurora (F.A.M.); Clinical Research Unit, Colorado Permanente Medical Group, Denver (D.J.M., E.E.L., L.C.); Kaiser Permanente Medical Center, Roseville, Calif (D.R.V.); Department of Medicine, University of Rochester School of Medicine, Rochester, NY (A.J.H.); and Denver VA Medical Center, Denver, Colo (P.M.H., J.S.R.).
Correspondence to Frederick A. Masoudi, MD, MSPH, Division of Cardiology, MC 0960, Denver Health Medical Center, 777 Bannock St, Denver, CO 80204. E-mail fred.masoudi{at}uchsc.edu
Received February 27, 2006; revision received June 30, 2006; accepted August 4, 2006.
| Abstract |
|---|
|
|
|---|
Methods and Results In a retrospective cohort study of consecutive patients presenting to 5 EDs in California and Colorado from July 1, 2000, through June 30, 2002, with confirmed AMI (n=1684), we determined the frequency of the failure by the treating provider to identify significant ST-segment depressions, ST-segment elevations, or T-wave inversions on the presenting ECG. In multivariable models, we assessed the relationship between missed high-risk ECG findings and evidence-based therapy in the ED after adjustment for patient characteristics and site of care. High-risk ECG findings were not documented in 201 patients (12%). The failure to identify high-risk findings was independently associated with a higher odds of not receiving treatment among ideal candidates for aspirin (odds ratio [OR], 2.13; 95% confidence interval [CI], 1.51 to 2.94), ß-blockers (OR, 1.85; 95% CI, 1.14 to 3.03), and reperfusion therapy (OR, 7.69; 95% CI, 3.57 to 16.67). Among patients with missed high-risk ECG findings, in-hospital mortality was 7.9% compared with 4.9% among those without missed findings (P=0.1).
Conclusions The failure to identify high-risk ECG findings in patients with AMI results in lower-quality care in the ED. Systematic processes to improve ECG interpretation may have important implications for patient treatment and outcomes.
Key Words: diagnosis electrocardiography myocardial infarction
| Introduction |
|---|
|
|
|---|
Clinical Perspective p 1571
The interpretation of the ECG in the ED is central to the assessment of patients with possible cardiac ischemia.13 High-risk findings on the ECG inform the diagnosis and treatment of patients with suspected AMI. Several investigators have studied ECG interpretation by ED care providers,48 but the impact of these discrepancies on triage and treatment decisions has been debated.4,5 Although some studies suggest that ECG misinterpretation may result in inappropriate patient triage7,9 or missed opportunities to provide acute reperfusion therapy,10,11 little is known about the relationship of ECG interpretation to the quality of care for AMI delivered in the ED.
Accordingly, we assessed the frequency of failure to identify high-risk ECG findings in the ED setting in a multicenter cohort of patients presenting with AMI and the degree to which missed ECG findings were associated with the failure to provide therapy with aspirin, ß-blockers, or reperfusion therapy in ideal treatment candidates. The results of this study may have important implications for the process of ECG interpretation in the ED, the training of ED providers in ECG interpretation, and the development and testing of ED quality improvement interventions.
| Methods |
|---|
|
|
|---|
The 5 hospitals included in this study were members of not-for-profit health maintenance organizations and ranged in size from 115 to 456 beds. Three of the 5 had cardiac catheterization laboratories, and 2 provided percutaneous coronary interventions on site. Institutional Review Board approval was obtained for the conduct of the study at all participating sites.
Data Sources
Data were collected from the ED record on patient demographics, clinical history, including contraindications to reperfusion, ED providers ECG interpretation, and ED therapies. Chart reviews were conducted by 4 physician investigators using an electronic data abstraction tool. All abstractors were trained with regard to the content and coding of each data element, data handling and data transmission procedures, and protocols to address questions during the study. In the training period, abstractors coded 10 practice charts. The abstractors were not aware of the specific hypotheses evaluated in this analysis.
Multiple processes were instituted to enhance the accuracy and reliability of abstraction. A data manager monitored data collection activities, answered coding or eligibility questions, and maintained a log of all coding decisions throughout the project. After the abstraction was complete, the data manager verified case eligibility and confirmed the validity of responses. To assess interrater reliability, a random sample of 30 charts was coded by all abstractors, and the results of these abstractions were compared with a reference standard abstraction. For all variables used in this study, there was moderate to excellent interrater reliability for all abstractors (
=0.5 to 1.0).
ECG Interpretation
The interpretation of the ECG by the ED provider was abstracted from the medical record. These interpretations were categorized as indicating possible or definite ischemia/injury if there was mention of ST-segment elevation, ST-segment depression, or T-wave inversion, unless it was explicitly noted that the findings were "nonspecific." Other qualitative terms such as "acute MI," "acute injury," or "ischemia" also were considered to fulfill the criteria for possible or definite ischemia or injury.
Hard copies of each patients ECG tracing(s) obtained in the ED, and prior tracings if available, were reviewed by 1 of 4 cardiologists who were blinded to the patients clinical record and the ED providers interpretation. Using the American College of Cardiology/American Heart Association (ACC/AHA) guidelines to define high-risk ECG findings,1,2 these interpreters considered any of the following in
2 contiguous leads as indicative of possible or definite ischemia: ST-segment elevation of at least 0.1 mV, ST-segment depression of at least 0.05 mV, or T-wave inversion of at least 0.2 mV. If prior ECGs were available for review, index findings that had been present on an earlier ECG were considered nonspecific.
All cases in which the cardiologist identified possible or definite ischemia but the ED provider did not (n=209) were subsequently reviewed by a panel of 4 physicians to adjudicate the presence or absence of discordance. This adjudication process identified 8 cases (3.8%) in which the original cardiologists interpretation was overruled. The remaining 201 cases were confirmed as having a missed high-risk ECG finding during the ED encounter.
Definitions of Ideal Candidates for Evidence-Based Therapy
Patients were considered ideal candidates for a therapy if they were eligible for, and had no contraindication to, that therapy based on current ACC/AHA guidelines.1,2 Patients were eligible for aspirin therapy if they had a positive cardiac marker in the ED or had an adjudicated ED ECG demonstrating new ST-segment elevation. Patients also were eligible for aspirin if they presented to the ED with discomfort or pressure in the chest, arm, neck, or jaw and had an adjudicated ED ECG demonstrating new ST-segment depression or T-wave inversion or had an admission diagnosis of unstable angina or "rule-out" myocardial infarction. Eligible patients were considered ideal treatment candidates in the absence of contraindications to aspirin therapy, which included active bleeding on or before ED arrival, aspirin allergy or hypersensitivity, an international normalized ratio
3.5, or other reasons documented by the ED provider for not prescribing aspirin. Patients were counted as having received aspirin therapy if they received aspirin or other antiplatelet agent (eg, clopidogrel) in the ED or if there was documentation that they had taken one of these agents in the 24 hours before arriving at the ED.
Patients were eligible for ß-blocker therapy if they had a confirmed AMI while in the ED defined as either a positive cardiac marker in the ED or an adjudicated ED ECG demonstrating new ST-segment elevation. Eligible patients were considered ideal treatment candidates in the absence of contraindications to ß-blockers, which included heart rate <60 bpm, systolic blood pressure <100 mm Hg, second- or third-degree heart block, heart failure or pulmonary edema documented on physical examination or chest x-ray, a history of asthma, known allergy to ß-blockers, or any other reason documented by the ED provider for not prescribing a ß-blocker.
Patients were eligible for reperfusion therapy (either fibrinolysis or percutaneous coronary intervention) if they presented to the ED within 12 hours of AMI symptom onset and had an adjudicated ED ECG demonstrating ST-segment elevation of at least 0.1 mV in
2 contiguous leads. Eligible candidates were considered ideal for treatment in the absence of contraindications to reperfusion therapy, which included cardiac arrest with cardiopulmonary resuscitation or other traumatic resuscitation; noncompressible vascular puncture; aortic dissection; other active bleeding processes; refractory hypertension (blood pressure >180 mm Hg systolic or >100 mm Hg diastolic); acute stroke or a history of hemorrhagic stroke, ischemic stroke, transient ischemic attack, central nervous system neoplasm, or other central nervous system lesion; recent major trauma; history of surgery or head injury within 2 months; known bleeding disorder; history of gastrointestinal bleeding or other internal bleeding within the last month; pregnancy or within 1 week postpartum; chronic liver disease, infective endocarditis, active peptic ulcer, or oral anticoagulant therapy; or any other reason documented by the ED provider for not providing reperfusion therapy. Patients who were transferred for percutaneous coronary intervention were considered to have received reperfusion therapy.
Data Analysis
Characteristics of patients with missed high-risk ECG findings were compared with other study subjects using t tests for continuous variables and
2 tests for categorical variables. To identify factors independently associated with the failure to identify high-risk ECG findings, multivariable regression models were constructed with missed high-risk ECG as the dependent variable, adjusting for patient demographic and clinical characteristics (as listed in the Table) and for study site.
|
Subsequently, multivariable logistic models were constructed to assess the relationship between missed high-risk ECG findings and the use of aspirin, ß-blockers, and reperfusion therapy. In these models, treatment with the evidence-based intervention (aspirin, ß-blockers, or reperfusion therapy) was the dependent variable, and only ideal candidates for a treatment as defined above were included. After entering a variable indicating whether or not a high-risk ECG finding was missed, the models were expanded to include patient demographic and clinical characteristics and adjusted for site. All regression models were developed by applying backward selection to the demographic and clinical variables listed in the Table (P<0.10 for entry, P<0.05 to remain in model). Odds ratios (ORs) and 95% confidence intervals (CIs) were calculated for all covariates in the models. In the treatment models, ORs >1 indicate a lower likelihood of evidence-based treatment among ideal candidates.
Although the study was not powered to assess mortality differences, unadjusted in-hospital mortality rates were compared by use of
2 tests. All statistical analyses were performed with SAS version 8.0 (SAS, Inc, Cary, NC). The authors had full access to the data and take full responsibility for their integrity. All authors have read and agree to the manuscript as written.
| Results |
|---|
|
|
|---|
Prevalence and Correlates of Missed High-Risk ECG Abnormalities
A total of 201 patients (12%) had a high-risk ECG abnormality that was not detected by the ED provider. Rates of missed ECG findings by hospital ranged from 5.6% to 15.1%. Patients with missed ECG abnormalities were older, more commonly had a history of heart failure or other cardiac history, and less frequently had chest pain as a presenting symptom (Table). Missed high-risk findings were less common among patients with ST-segment elevation (39 of 488, 8%) than for those with T-wave inversion (68 of 485, 14%) or ST-segment depression (138 of 762, 18%). Compared with patients whose charts contained documentation of ST-segment elevation, those without documentation on average had fewer leads with at least 1-mm ST-segment elevation (3.2±1.2 versus 2.9±1.0; P=0.4), had lesser degrees of ST elevation in the most affected lead (2.53±1.9 versus 2.1±1.0 mm; P=0.5), and less frequently had reciprocal ST-segment depression (76% versus 66%; P=0.2). None of these differences were statistically significant.
In multivariable models adjusting for patient characteristics and site, patients with a history of heart failure (OR, 1.78; 95% CI, 1.19 to 2.66; P=0.005) and other cardiovascular history (OR, 1.44; 95% CI, 1.04 to 2.00; P=0.03) were significantly more likely to have a missed high-risk ECG abnormality, whereas patients presenting with chest pain (OR, 0.46; 95% CI, 0.32 to 0.64; P<0.001) were significantly less likely to have a missed high-risk abnormality. Other patient and admission variables were not independently correlated after multivariable adjustment. Among the subgroup of patients with ST-segment elevation, patients with chest pain at presentation were significantly less likely to have this high-risk ECG finding missed (OR, 0.12; 95% CI, 0.05 to 0.25).
Missed High-Risk ECG Findings, Therapy, and Mortality
Overall, 1631 patients (96.8%) were ideal candidates for aspirin, 757 (45.0%) for ß-blockers, and 403 (23.9%) for acute reperfusion therapy. Among ideal candidates, 81.4% were treated with aspirin, 60.9% were treated with ß-blockers, and 79.2% received reperfusion therapy. In absolute terms, ideal candidates with missed high-risk ECG abnormalities were 21% less likely to receive aspirin, 20% less likely to receive ß-blockers, and 48% less likely to receive reperfusion therapy (P<0.001 for all treatments; Figure). After adjustment for demographics, medical history, and admission characteristics, a missed high-risk ECG abnormality was associated with significantly higher odds of not receiving treatment among ideal candidates for aspirin (OR, 2.13; 95% CI, 1.51 to 2.94), ß-blockers (OR, 1.85; 95% CI, 1.14 to 3.03), and reperfusion therapy (OR, 7.69; 95% CI, 3.57 to 16.67). Among patients with missed high-risk ECG findings, in-hospital mortality was 7.9% compared with 4.9% among those without missed findings (P=0.1).
|
| Discussion |
|---|
|
|
|---|
Our study suggests that the misinterpretation of the ECG in the ED setting is relatively common and has a consistent and significant relationship with lower rates of use of clinically effective interventions that have been shown to improve health outcomes. Randomized clinical trials clearly support the prompt use of medical therapy in eligible patients with AMI. In clinical trials of AMI, treatment has been associated with absolute reductions in short-term mortality ranging from 2% to 5% with aspirin treatment, 0.5% to 1% for ß-blockers, and at least 3% for acute reperfusion.1,2,1418 Based on these trials, current guidelines consider these interventions in the acute setting as class I recommendations, or those for which there is evidence and/or general agreement that they are beneficial, useful, and effective.1,2 Although our study was designed to assess differences in quality of care and was not adequately powered to ascertain differences in mortality, it is reasonable to believe that the poorer-quality care provided to those patients with missed high-risk ECG features would result in worse outcomes for the population with AMI.
The absence of chest pain on presentation was an important correlate of the failure to identify high-risk ECG findings, suggesting that the absence of typical historical findings may inordinately reduce clinicians level of suspicion for AMI. Prior studies have demonstrated that patients with AMI, particularly the elderly, frequently present with atypical symptoms and may not have classic angina.1921 The findings of this study suggest that greater scrutiny should be dedicated to interpreting the ECG in the ED regardless of whether the patient presents with typical ischemic symptoms, particularly because the failure to identify high-risk findings is related to the failure to provide evidence-based therapy among patients likely to benefit from treatment.
Prior studies of ED care have assessed discrepancies in ECG interpretation, but the conclusions about the implications of these discrepancies have been mixed. In a single-center study of >700 patients with an abnormal ED ECG, the investigators found a discordance rate of nearly 60% but identified only 2 cases in which the discrepancy would alter patient care.5 In another study, ED interpretations were significantly discordant with cardiologist interpretations in almost 20%, but none of the missed abnormalities was considered potentially life-threatening.4 However, studies that consider all ECGs obtained in the ED regardless of the indication may understate the importance of ECG misinterpretation in care. Investigations limited to patients presenting with suspected AMI suggest that rates of ECG misinterpretation in this population are higher than in studies of general ED populations.7,9 Furthermore, misinterpretations in populations with chest pain have been associated with errors in triage, delays in reperfusion, or failures to provide reperfusion.7,911 In our study, providers failed to identify high-risk ECG findings in nearly 1 in 8 patients, and these failures had important implications for the quality of care.
Existing survey data suggest a perception that ECG interpretation skills by ED physicians are not an important target for improvement. ED training program directors generally consider the ECG training delivered to residents to be adequate,22 and most do not endorse the development of formal examinations to assess competency in ECG interpretation.23 However, the present study suggests otherwise, providing strong evidence that additional training in ECG interpretation and the assessment of competency may be a critical component of the education of physicians who care for patients presenting with AMI.
To this point, sustainable systematic solutions for increasing the accuracy of ECG interpretation in the ED that are acceptable to providers have been elusive. ECG-based instruments such as the thrombolytic predictive instrument24 or the acute cardiac ischemia time-insensitive predictive instrument25 have been studied in randomized trials and result in more prompt and appropriate therapy. Unfortunately, however, these instruments have been difficult to integrate consistently into clinical care. Studies of neural networks also show promise for enhancing ECG interpretation, but these systems have been experimental and have not been incorporated into clinical practice.26 The present study suggests, however, that innovative strategies to improve ECG interpretation in the ED that are acceptable for widespread implementation could result in substantial improvements in care for patients with AMI.
To our knowledge, the present study is the first to assess the relationship between the failure to identify high-risk ECG findings and the quality of ED care delivered to patients with AMI. Certain issues should be considered in the interpretation of the results, however. First, the study was conducted in 5 EDs, potentially limiting the generalizability of the results to other institutions. Furthermore, the study did not have adequate power to exclude clinically important differences in mortality that may have resulted from the failure of ECG interpretation. We found a strong relationship, however, between ECG interpretation and the provision of medical therapy that is known to improve health outcomes. Finally, we were not able to determine whether the gaps in care in the ED persisted during hospitalization. To the extent, however, that transitions in care may be a point where errors in care are transmitted and potentially amplified, the patterns identified in this study are likely important.
| Conclusions |
|---|
|
|
|---|
| Acknowledgments |
|---|
The EDQMI Study was funded by the Garfield Memorial Foundation. The funding source played no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; or preparation, review, or approval of the manuscript.
Disclosures
Dr Masoudi has served on speakers bureaus for Pfizer and AstraZeneca. The other authors report no conflicts.
| References |
|---|
|
|
|---|
Related Article:
Circulation 2006 114: 1555.
This article has been cited by other articles:
![]() |
G. W. Stone Angioplasty Strategies in ST-Segment-Elevation Myocardial Infarction: Part II: Intervention After Fibrinolytic Therapy, Integrated Treatment Recommendations, and Future Directions Circulation, July 29, 2008; 118(5): 552 - 566. [Full Text] [PDF] |
||||
![]() |
H. M. Krumholz Outcomes Research: Generating Evidence for Best Practice and Policies Circulation, July 15, 2008; 118(3): 309 - 318. [Full Text] [PDF] |
||||
![]() |
F. A. Masoudi Misinterpretation of Electrocardiograms and Cardiac Catheterization Laboratory Activations--Reply JAMA, April 23, 2008; 299(16): 1898 - 1898. [Full Text] [PDF] |
||||
![]() |
D. M. Larson, S. W. Sharkey, and T. D. Henry Misinterpretation of Electrocardiograms and Cardiac Catheterization Laboratory Activations--Reply JAMA, April 23, 2008; 299(16): 1897 - 1898. [Full Text] [PDF] |
||||
![]() |
H. M. Krumholz and F. A. Masoudi The Year in Epidemiology, Health Services Research, and Outcomes Research J. Am. Coll. Cardiol., December 4, 2007; 50(23): 2254 - 2262. [Full Text] [PDF] |
||||
![]() |
W. E. Boden, K. Eagle, and C. B. Granger Reperfusion Strategies in Acute ST-Segment Elevation Myocardial Infarction: A Comprehensive Review of Contemporary Management Options J. Am. Coll. Cardiol., September 4, 2007; 50(10): 917 - 929. [Abstract] [Full Text] [PDF] |
||||
![]() |
Failure to Identify High-Risk ECG Findings in AMI Patients Journal Watch Emergency Medicine, November 9, 2006; 2006(1109): 1 - 1. [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Circulation Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2006 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |