(Circulation. 2001;103:2550.)
© 2001 American Heart Association, Inc.
Clinical Investigation and Reports |
Combination Therapy With Abciximab Reduces Angiographically Evident Thrombus in Acute Myocardial Infarction
A TIMI 14 Substudy
From Harvard Clinical Research Institute, Boston, Mass (C.M.G., S.A.M., S.J.M.); the University of Texas Southwestern Medical Center, Dallas, Tex (J.A.d.L.); and the Department of Medicine, Brigham and Women’s Hospital, Boston, Mass (C.H.M., C.P.C., E.M.A., E.B.).
 |
Abstract |
|---|
 Top Abstract IntroductionMethodsResultsDiscussionReferences |
|---|
Background—Use of abciximab in combination with administration of thrombolytics has been shown to improve epicardial and microvascular coronary blood flow in acute myocardial infarction (AMI). As a potential mechanism, we hypothesized that combination therapy would reduce angiographically evident thrombus (AET) and would increase lumen diameter compared with thrombolytic monotherapy.
Methods and Results—Patients who received combination therapy in TIMI 14 (low-dose thrombolytic plus abciximab, n=732) were compared with patients who received thrombolytic monotherapy without abciximab in the TIMI 4, 10A, 10B, and 14 trials (n=1662). Thrombus burden was assessed 90 minutes after treatment, and quantitative angiography was performed in an angiographic core laboratory by investigators blinded to treatment assignment. The frequency of AET was reduced in patients who received abciximab combination therapy compared with thrombolytic monotherapy (26.6% versus 35.4%, P<0.001). Similar findings were observed when the analysis was restricted to patients with patent arteries (14.7% versus 20.8%, P=0.001). Residual percent diameter stenosis at 90 minutes was also improved in the abciximab therapy group both in patent arteries (64.6±16.6 versus 68.3±14.8, P<0.001) and between patent and occluded arteries (69.3±19.5 versus 73.8±17.9, P<0.001). The absence of AET was associated with an increased frequency of >70% ST-segment resolution by 90 minutes (37.2%, 110/296 versus 18.9%, 54/286, P<0.001).
Conclusions—Compared with thrombolytic monotherapy, combination therapy with abciximab reduces AET, which in turn is associated with reduced residual stenosis and improved ST-segment resolution in AMI. These data provide a pathophysiological link between platelet inhibition, reduced thrombus, and improvements in both epicardial and microvascular perfusion in AMI.
Key Words: thrombus • abciximab • blood flow • myocardial infarction • thrombolysis
|
Introduction |
|---|
|
TopAbstractIntroductionMethodsResultsDiscussionReferences |
|---|
Rupture of an atherosclerotic plaque and subsequent thrombus formation leading to reduced blood flow to the myocardium is the underlying pathophysiology of acute myocardial infarction (AMI). Abciximab, a glycoprotein (GP) IIb/IIIa inhibitor, in combination with administration of thrombolytics has been shown to improve epicardial and microvascular coronary blood flow in patients with AMI .1 2 3 Recent results from the PRISM-PLUS and CAPTURE trials demonstrated a reduction in thrombus burden among unstable angina/non–ST-segment elevation MI patients treated with 18 to 48 hours of GP IIb/IIIa therapy.4 5 The impact of abciximab in combination with reduced-dose thrombolytic therapy on angiographically evident thrombus (AET) and luminal narrowing in the setting of ST-segment elevation AMI, however, has not been described.
As a potential mechanism for the improved epicardial and microvascular coronary blood flow in ST-segment elevation MI that has been observed with combination therapy, we hypothesized that combination therapy would reduce AET. Furthermore, we hypothesized that reduced AET would in turn be associated with improved lumen diameters and improved ST-segment resolution compared with thrombolytic monotherapy.
|
Methods |
|---|
|
TopAbstractIntroductionMethodsResultsDiscussionReferences |
|---|
The Thrombolysis in Myocardial Infarction (TIMI) 14 trial compared full-dose thrombolytics (tissue plasminogen activator [tPA] or recombinant tPA [rtPA], n=337) versus abciximab plus a low-dose thrombolytic or abciximab alone (n=850).1 2 The TIMI 4 trial was a randomized, double-blind comparison of 3 thrombolytic regimens: anistreplase (Eminase) versus front-loaded rtPA (Activase or alteplase) versus combination therapy in 416 patients.6 The TIMI 10A trial was a nonrandomized, open-label, dose-escalation study of 8 ascending doses of tenectaplase in 113 patients.7 TIMI 10B was an 880-patient randomized trial comparing 30, 40, and 50 mg of tenectaplase versus front-loaded rtPA.8 In each of the trials, angiography was performed at 60, 75, and 90 minutes after administration of thrombolytics.1 2 6 7 8 Nitroglycerin (intravenous or sublingual) was administered every 15 minutes if the systolic blood pressure exceeded 110 mm Hg.1 2 6 7 8 All angiographic end points were prospectively assessed at 90 minutes. The TIMI flow grade, as previously defined,9 was assessed by a single observer (C.M.G.) who was blinded to treatment assignment and clinical outcome. The corrected TIMI frame count (CTFC) was converted when necessary to be based on the most common filming speed in the United States, 30 frames per second.10 11 Angiographic success for an interventional procedure was defined as a residual stenosis of <50% and achievement of TIMI 3 flow. ST-segment resolution 90 minutes after fibrinolysis was determined only in the TIMI 14 trial by previously defined methods.12
A patient was considered to have AET if TIMI thrombus grades
2 to 5 were present. In brief, in TIMI thrombus grade 0, no
cineangiographic characteristics of thrombus are present; in TIMI
thrombus grade 1, possible thrombus is present, with such
angiography characteristics as reduced contrast density, haziness,
irregular lesion contour, or a smooth convex "meniscus" at the site
of total occlusion suggestive but not diagnostic of
thrombus; in TIMI thrombus grade 2, there is definite thrombus, with
greatest dimensions 
1/2 the vessel diameter; in TIMI thrombus grade
3, there is definite thrombus but with greatest linear dimension >1/2
but <2 vessel diameters; in TIMI thrombus grade 4, there is definite
thrombus, with the largest dimension 
2 vessel diameters; and in TIMI
thrombus grade 5, there is total occlusion.
Analyses were performed with Stata statistical
software version 6.0.13
Variables were compared by Fisher’s exact test or the
2 test for categorical data. Student’s
t test or ANOVA was used for
the analysis of normally distributed continuous variables.
The nonparametric Wilcoxon rank sum test (for 2-way
comparisons) or the Kruskal-Wallis test (for 3-way comparisons) was
used to compare continuous variables when the data were not
normally distributed or when data were ascribed to an occluded vessel.
Data are presented as mean±SD.
|
Results |
|---|
|
TopAbstractIntroductionMethodsResultsDiscussionReferences |
|---|
Baseline and Angiographic Characteristics by AET
Thrombus was evaluable in 93.3% of patients (2394 of 2566). Among these, AET was present in 783 and not detectable in 1611. Patients with AET were slightly heavier and were more likely to have an inferior infarction (Table 1
). In an analysis of patent arteries,
epicardial flow as assessed by use of the CTFC and TIMI flow grade 3
was faster in patients without AET
(Table 1).
|
Relation of Treatment Assignment to AET and
Other Angiographic Characteristics
The prevalence of AET 90 minutes after therapy was
reduced in patients who received combination therapy with abciximab
compared with thrombolytic monotherapy (26.6% versus
35.4%, P<0.001)
(Figure 1). Similar findings were observed when the
analysis was restricted to patent arteries only (14.7% versus
20.8%, P=0.001). The residual
percent diameter stenosis at 90 minutes was reduced in the
combination therapy group both in patent arteries (64.6±16.6 versus
68.3±14.8, P<0.001) and in an
analysis of patent and occluded arteries combined (69.3±19.5
versus 73.8±17.9, P<0.001)
(Table 2). Likewise, in the combination therapy group,
minimum lumen diameters (MLDs) were larger both in patent arteries
(1.06±0.56 mm, n=610, versus 0.98±0.51 mm, n=1288,
P=0.001) and in an
analysis of patent and occluded arteries combined
(0.92±0.63 mm, n=722, versus 0.81±0.59 mm, n=1631,
P=0.0001).
|
|
In a multivariate model correcting for baseline differences in potential confounding variables (age, weight, left anterior descending coronary artery infarction, systolic blood pressure), combination therapy with abciximab remained a potent predictor of reduced AET (OR 0.69, P<0.001).
Thrombus and ST-Segment Resolution
The absence of AET was associated with an increased
frequency of complete (>70%) ST-segment resolution by 90 minutes
(37.2%, 110 of 296, versus 18.9%, 54 of 286,
P<0.001)
(Figure 2). Mean ST-segment resolution was lower in patients
with AET present (36.2±61.4%, n=164, versus 60.8±48.1%, n=418,
P<0.0001).
|
Post-PCI Angiographic Results
Post–percutaneous coronary
intervention (PCI) coronary flow was more rapid in the
abciximab combination therapy group than in the
thrombolytic monotherapy group (CTFC 26.3±19.8, n=238,
versus 31.0±25.6, n=339,
P=0.02)
(Table 3). In a multivariate model adjusting
for stenting, there was a trend for use of abciximab combination
therapy to be related to lower post-PCI CTFC
(P=0.13). In addition, post-PCI
stenosis was smaller and post-PCI MLD was larger in the
abciximab combination therapy group. Angiographic success was less
frequent in the thrombolytic monotherapy group (68.3%
versus 84.8%, P<0.001), even
after adjustment for stent use (OR 1.75,
P=0.012).
|
Post-PCI coronary flow was slower in patients with pre-PCI AET, as demonstrated by lower rates of TIMI grade 3 flow (79.5%, 294 of 370, versus 88.0%, 316 of 359, P=0.002) and higher CTFCs (31.1±24.0, n=287, versus 27.4±22.7, n=266, P=0.06). In a multivariate model controlling for pre-PCI patency, however, AET was not related to post-PCI flow.
|
Discussion |
|---|
|
TopAbstractIntroductionMethodsResultsDiscussionReferences |
|---|
The data presented here indicate that use of abciximab combination therapy for AMI reduces AET at 90 minutes after thrombolytic administration and reduces residual percent diameter stenosis both at 90 minutes and after PCI. Furthermore, post-PCI coronary flow and angiographic success were improved with the use of combination therapy in AMI patients. Finally, reduced AET was associated with improved ST-segment resolution by 90 minutes. Together, these data demonstrate the potential pathophysiological mechanism of the benefit of combination therapy in AMI (Figure 3
).
|
In Vitro Studies of GP IIb/IIIa and
Thrombus Formation
GP IIb/IIIa inhibitors interfere with the
final step of platelet aggregation, ie, the cross-linking of fibrin
strands. In vitro studies have shown that GP IIb/IIIa
inhibitors may also inhibit thrombin
formation,14 15
resulting in both an antiplatelet and an anticoagulant effect. One
such study by Reverter et
al14 examined the effects of
abciximab in a thrombin generation assay triggered by tissue factor.
Abciximab produced dose-dependent inhibition of thrombin generation and
inhibited thrombin-antithrombin complex formation, prothrombin fragment
F1-F2 generation, platelet-derived growth factor and platelet
factor 4 release, incorporation of thrombin into clots, and
microparticle generation.
A recent study by Hayes et al16 of patients who underwent PCI for unstable angina examined blood drawn before and after the intervention in an ex vivo perfusion chamber that mimics the conditions that develop in a coronary artery with mild stenosis and deep vascular injury. Thrombus formation was triggered by exposing medial components of the arterial wall to flowing blood. Abciximab administration for 12 hours resulted in a 58% reduction in thrombus formation compared with baseline thrombus (11 631±861 versus 4925±585 µm2, P<0.001); no significant reduction was seen in the placebo group. In addition, platelet aggregation was reduced and GP IIb/IIIa receptor occupancy was increased in patients who received abciximab but not in the placebo groups.
In the setting of unstable angina/non–ST-segment elevation MI, 2 angiographic substudies from the PRISM-PLUS and CAPTURE trials have demonstrated a reduction in thrombus burden in patients treated with 18 to 48 hours of GP IIb/IIIa therapy.4 5 In the PRISM-PLUS trial of patients with unstable angina or non–Q-wave MI, the combination of tirofiban plus heparin compared with heparin alone significantly reduced the frequency and severity of thrombus (OR 0.77, P=0.022), decreased the residual stenosis (P=0.037), and increased the frequency of TIMI flow grade 3 (P=0.002). In the CAPTURE trial of unstable angina patients, the prevalence of thrombus was significantly reduced among patients who received abciximab compared with placebo (P=0.033). The present study is the first study of ST-segment elevation MI patients to examine the impact of GP IIb/IIIa on AET. The magnitude in the reduction in thrombus was equally large despite a much shorter time from treatment to angiography in the present trial (90 minutes) compared with CAPTURE and PRISM-PLUS (18 to 48 hours).
Limitations
Data on AET were available in 93.3% (2394/2566) of
patients. The true prevalence of thrombus by angioscopy most likely
exceeds that observed on the angiogram. Data on ST-segment resolution
were available only in the TIMI 14 trial. The analysis of
post-PCI flow may have been confounded by a greater use of stents among
patients treated with abciximab in more recent trials of combination
therapy, but the impact of stenting was controlled for in a
multivariate model. Other unidentified confounders,
however, may have remained present.
Conclusions
Compared with thrombolytic monotherapy,
combination therapy with abciximab reduces AET, which is in turn
associated with reduced residual stenoses, larger MLDs, and
improved ST-segment resolution in AMI. These data provide a
pathophysiological link between platelet
inhibition, reduced thrombus, and improvements in both epicardial and
microvascular perfusion in
AMI.
|
Acknowledgments |
|---|
This study was supported in part by grants from SmithKline Beecham, Philadelphia, Pa (TIMI 4); Genentech, Inc, South San Francisco, Calif, and Boehringer Ingelheim, Germany (TIMI 10A and B); and Centocor, Malvern, Pa, and Eli Lilly Inc, Indianapolis, Ind (TIMI 14). Dr Gibson has received research grant support from Centocor and Eli Lilly Inc.
|
Footnotes |
|---|
Reprint requests to C. Michael Gibson, MS, MD, Harvard Clinical Research Institute, 900 Commonwealth Ave, 2nd Floor, Boston, MA 02215.
Received December 8, 2000; revision received March 12, 2001; accepted March 13, 2001.
|
References |
|---|
|
TopAbstractIntroductionMethodsResultsDiscussionReferences |
|---|
-
Antman EA,
Giugliano RP, Gibson CM, et al. Abciximab facilitates the rate and
extent of thrombolysis: results of the
Thrombolysis in Myocardial Infarction (TIMI) 14 Trial.
Circulation. 1999;99:2720–2732.
[Abstract/Free Full Text]
-
Antman EM, Gibson
CM, de Lemos JA, et al. Combination reperfusion therapy with abciximab
and reduced dose reteplase: results from TIMI 14.
Eur Heart J. 2000;21:1944–1953.
[Abstract/Free Full Text]
-
de Lemos JA, Antman
EM, Gibson CM, et al. Abciximab improves both epicardial flow and
myocardial reperfusion in ST-elevation myocardial infarction:
observations from the TIMI 14 trial.
Circulation. 2000;101:239–243.
[Abstract/Free Full Text]
-
Zhao XQ, Theroux P,
Snapinn SM, et al, for the PRISM-PLUS Investigators.
Intracoronary thrombus and platelet
glycoprotein IIb/IIIa receptor blockade with tirofiban in
unstable angina or non–Q-wave myocardial infarction: angiographic
results from the PRISM-PLUS trial (Platelet receptor inhibition for
ischemic syndrome management in patients limited by unstable
signs and symptoms).
Circulation. 1999;100:1609–1615.
[Abstract/Free Full Text]
-
van den Brand M,
Laarman GJ, Steg PG, et al. Assessment of coronary angiograms
prior to and after treatment with abciximab, and the outcome of
angioplasty in refractory unstable angina patients.
Eur Heart J. 1999;20:1572–1578.
[Abstract/Free Full Text]
-
Cannon CP, McCabe
CH, Diver DJ, et al. Comparison of front-loaded recombinant tissue-type
plasminogen activator, anistreplase and
combination thrombolytic therapy for acute myocardial
infarction: results of the Thrombolysis in Myocardial
Infarction (TIMI) 4 trial. J Am Coll
Cardiol. 1994;24:1602–1610.[Abstract]
-
Cannon CP, McCabe
CH, Gibson CM, et al. TNK-tissue plasminogen
activator in acute myocardial infarction: results of the
Thrombolysis in Myocardial Infarction (TIMI) 10A
dose-ranging trial.
Circulation. 1997;95:351–356.
[Abstract/Free Full Text]
-
Cannon CP, Gibson
CM, McCabe CH, et al. TNK-tissue plasminogen
activator compared with front-loaded alteplase in acute
myocardial infarction: results of the TIMI 10B trial.
Circulation. 1998;98:2805–2814.
[Abstract/Free Full Text]
-
TIMI Study Group.
The Thrombolysis in Myocardial Infarction (TIMI) trial.
N Engl J Med. 1985;31:932–936.
-
Gibson CM, Cannon
CP, Daley WL, et al. The TIMI frame count: a quantitative method of
assessing coronary artery flow.
Circulation. 1996;93:879–888.
[Abstract/Free Full Text]
-
Gibson CM, Murphy
SA, Rizzo MJ, et al. The relationship between the TIMI frame count and
clinical outcomes after thrombolytic administration.
Circulation. 1999;99:1945–1950.
[Abstract/Free Full Text]
-
de Lemos JA,
Antman EM, Giugliano RP, et al, Thrombolysis in Myocardial
Infarction (TIMI) 14 investigators. ST-segment resolution and
infarct-related artery patency and flow after
thrombolytic therapy.
Am J Cardiol. 2000;85:299–304.[Medline]
[Order article via Infotrieve]
-
Stata
Statistical Software: Release 6.0. College Station, Tex:
Stata Corp; 1999.
-
Reverter JC,
Beguin S, Kessels H, et al. Inhibition of platelet-mediated, tissue
factor-induced thrombin generation by the mouse/human chimeric 7E3
antibody: potential implications for the effect of c7E3 Fab treatment
on acute thrombosis and clinical restenosis.
J Clin Invest. 1996;98:863–874.[Medline]
[Order article via Infotrieve]
-
Keularts IM,
Beguin S, de Zwaan C, et al. Treatment with a GPIIb/IIIa
antagonist inhibits thrombin generation in platelet
rich plasma from patients. Thromb
Haemost. 1998;80:370–371.[Medline]
[Order article via Infotrieve]
-
Hayes R, Chesebro
JH, Fuster V, et al. Antithrombotic effects of abciximab.
Am J Cardiol. 2000;85:1167–1172. [Medline]
[Order article via Infotrieve]
This article has been cited by other articles:
 |
|
 |
|
  G. Niccoli, S. Giubilato, E. Russo, C. Spaziani, A. Leo, I. Porto, A. M. Leone, F. Burzotta, S. Riondino, F. Pulcinelli, et al. Plasma levels of thromboxane A2 on admission are associated with no-reflow after primary percutaneous coronary intervention Eur. Heart J., July 10, 2008; (2008) ehn325v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. Chechi, S. Vecchio, G. Vittori, G. Giuliani, A. Lilli, G. Spaziani, L. Consoli, G. Baldereschi, G. G.L. Biondi-Zoccai, I. Sheiban, et al. ST-segment elevation myocardial infarction due to early and late stent thrombosis a new group of high-risk patients. J. Am. Coll. Cardiol., June 24, 2008; 51(25): 2396 - 2402. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Isaaz Role of percutaneous coronary minimalist intervention in the management of acute ST-segment elevation myocardial infarction. J. Am. Coll. Cardiol., March 11, 2008; 51(10): 1046 - 1047. [Full Text] [PDF]
|
|
|
|
|
|
G. Sianos, M. I. Papafaklis, J. Daemen, S. Vaina, C. A. van Mieghem, R. T. van Domburg, L. K. Michalis, and P. W. Serruys Angiographic Stent Thrombosis After Routine Use of Drug-Eluting Stents in ST-Segment Elevation Myocardial Infarction: The Importance of Thrombus Burden J. Am. Coll. Cardiol., August 14, 2007; 50(7): 573 - 583. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. J. Kirtane, J. J. Vafai, S. A. Murphy, J. M. Aroesty, M. S. Sabatine, C. P. Cannon, C. M. Gibson, and for the TIMI Study Group Angiographically evident thrombus following fibrinolytic therapy is associated with impaired myocardial perfusion in STEMI: a CLARITY-TIMI 28 substudy Eur. Heart J., September 1, 2006; 27(17): 2040 - 2045. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
G. Niccoli, G. A. Lanza, S. Shaw, E. Romagnoli, D. Gioia, F. Burzotta, C. Trani, M. A. Mazzari, R. Mongiardo, M. De Vita, et al. Endothelin-1 and acute myocardial infarction: a no-reflow mediator after successful percutaneous myocardial revascularization Eur. Heart J., August 1, 2006; 27(15): 1793 - 1798. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Lefevre, E. Garcia, B. Reimers, I. Lang, C. di Mario, A. Colombo, F.-J. Neumann, M. V. Chavarri, P. Brunel, E. Grube, et al. X-Sizer for Thrombectomy in Acute Myocardial Infarction Improves ST-Segment Resolution: Results of the X-Sizer in AMI for Negligible Embolization and Optimal ST Resolution (X AMINE ST) Trial J. Am. Coll. Cardiol., July 19, 2005; 46(2): 246 - 252. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. M. Gibson, J. Karha, S. A. Murphy, J. A. de Lemos, D. A. Morrow, R. P. Giugliano, M. T. Roe, R. A. Harrington, C. P. Cannon, E. M. Antman, et al. Association of a pulsatile blood flow pattern on coronary arteriography and short-term clinical outcomes in acute myocardial infarction J. Am. Coll. Cardiol., April 7, 2004; 43(7): 1170 - 1176. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. T. Roe, C. L. Green, R. P. Giugliano, C. M. Gibson, K. Baran, M. Greenberg, S. T. Palmeri, S. Crater, K. Trollinger, K. Hannan, et al. Improved speed and stability of st-segment recovery with reduced-dose tenecteplase and eptifibatide compared with full-dose tenecteplase for acute st-segment elevation myocardial infarction J. Am. Coll. Cardiol., February 18, 2004; 43(4): 549 - 556. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Napodano, G. Pasquetto, S. Sacca, C. Cernetti, V. Scarabeo, P. Pascotto, and B. Reimers Intracoronary thrombectomy improves myocardial reperfusion in patients undergoing direct angioplasty for acute myocardial infarction J. Am. Coll. Cardiol., October 15, 2003; 42(8): 1395 - 1402. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H.-K. Yip, C.-J. Wu, H.-W. Chang, Y.-K. Hsieh, C.-Y. Fang, S.-M. Chen, and M.-C. Chen Impact of Tirofiban on Angiographic Morphologic Features of High-Burden Thrombus Formation During Direct Percutaneous Coronary Intervention and Short-term Outcomes Chest, September 1, 2003; 124(3): 962 - 968. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F Burzotta, M Hamon, R Sabatier, F Prati, A Boccanelli, and G Grollier Large intracoronary thrombi with good TIMI flow during acute myocardial infarction: four cases of successful aggressive medical management in patients without angiographically detectable coronary atherosclerosis Heart, December 1, 2002; 88(5): e6 - 6. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H.-K. Yip, M.-C. Chen, H.-W. Chang, C.-L. Hang, Y.-K. Hsieh, C.-Y. Fang, and C.-J. Wu Angiographic Morphologic Features of Infarct-Related Arteries and Timely Reperfusion in Acute Myocardial Infarction: Predictors of Slow-Flow and No-Reflow Phenomenon Chest, October 1, 2002; 122(4): 1322 - 1332. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. P. Cannon Importance of TIMI 3 Flow Circulation, August 7, 2001; 104(6): 624 - 626. [Full Text] [PDF]
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||