| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Circulation. 2006;114:1572-1580.)
© 2006 American Heart Association, Inc.
Heart Failure |
From the Departments of Cardiology (T.D.J.S, D.J.v.V., A.A.V., H.L.H.) and Nephrology (G.N.), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands.
Correspondence to Dr H.L. Hillege, Department of Cardiology, Thoraxcenter, University Medical Center Groningen, Hanzeplein 1, PO Box 30001, 9700 RB Groningen, The Netherlands. E-mail J.L.Hillege{at}tcc.umcg.nl
Received December 28, 2005; revision received August 1, 2006; accepted August 4, 2006.
| Abstract |
|---|
|
|
|---|
Methods and Results In 110 CHF patients (age, 57±11.7 years; left ventricular ejection fraction, 0.27±0.09; NYHA class, 2.5±0.9), we measured 125I-iothalamate clearance. Cockcroft-Gault (GFRcg), Modification of Diet in Renal Disease (MDRD), and simplified MDRD (sMDRD) equations were used as creatinine-based renal function estimations. Furthermore, 24-hour creatinine clearance (CrCl) was determined. CrCl and GFRcg were the most accurate. MDRD was most precise formula, although it was also highly biased. All formulas overestimated in the lower ranges and underestimated in the upper ranges of the GFR corrected for body surface area. The predictive performance of the formulas was best in severe CHF (NYHA classes III and IV). The prognostic value of CrCl and MDRD for cardiovascular outcome was comparable to that of GFR, the sMDRD was slightly less, and the GFRcg had a significantly worse prognostic value.
Conclusions In the more severe ranges of CHF, creatinine-based formulas and CrCl corrected for body surface area appeared to be more precise and accurate in estimating true GFR corrected for body surface area. The MDRD formula is the most precise and has a good prognostic value, whereas the sMDRD is slightly less accurate but uses fewer parameters, which makes this formula a practical alternative in clinical practice.
Key Words: glomerular filtration rate heart failure prognostic value renal function validation
| Introduction |
|---|
|
|
|---|
Clinical Perspective p 1580
The aforementioned renal function equations have been developed and validated against exact or true GFR measurements in populations with renal disease, in which they prove to be a reasonable to good estimate of renal function.68 However, in several studies in nonrenal patient populations, their predictive performance was disappointing.9,10 Although several important studies in CHF used renal function estimations by creatinine-based formulas, none of these formulas have been validated in a wide range of CHF patients. A number of factors specific to this group of patients may influence the accuracy and precision of these formulas, such as the predominantly hemodynamic nature of renal function impairment, medication interfering with renal function, sodium retention leading to volume expansion, and loss of muscle mass due to inactivity.
Although the estimated renal function is commonly used as a prognostic cardiovascular risk marker, the prognostic value has never been compared with the true renal function.
In the present study we validated the predictive performance of several creatinine-based formulas estimating GFR in patients with CHF by the "gold standard" of iothalamate clearance, examined sources related to accuracy and precison,11,12 and compared the prognostic value of renal function estimated by the different equations for cardiovascular outcome with the prognostic value of true renal function.
| Methods |
|---|
|
|
|---|
18 years, with left ventricular ejection fraction (LVEF) <0.45, and clinically stable were asked to participate at the outdoor clinic. For ethical reasons, all patients had to use renin-angiotensin system inhibitors. All medications had been stable for at least 1 month. Exclusion criteria were a myocardial infarction within the last 3 months, cardiac surgery or angioplasty within the last 3 months or scheduled to undergo these procedures, unstable angina pectoris, primary renal disease, prior organ transplantation, or chronic use of renal functioncompromising medication. Special care was taken to include patients over the full range of severity of CHF.
Study Design
All patients underwent the same study protocol. On the first day, renal function was measured by iothalamate clearance as described below. Body weight and length were determined just before renal function measurement started. Two hours after the beginning of the renal measurements, venous blood was drawn to determine serum creatinine, serum urea, and serum albumin. In addition, during renal measurements, blood pressure and heart rate were determined. Systolic and diastolic blood pressure measurements were calculated as the mean of the last 2 of 10 consecutive measurements during 10 minutes with the patient in the sitting position with an automatic Dinamap XL model 9300 series device (Johnson-Johnson Medical Inc, Tampa, Fla). After the renal function measurements by iothalamate were finished, patients were given 2 containers for two 24-hour urine collections. After return of these containers, samples were taken to determine urine creatinine concentration for calculation of 24-hour creatinine clearance.
Renal Function Measurement by Iothalamate Clearance
GFR and effective renal plasma flow (ERPF) were measured by constant infusion of the radiolabeled tracers 125I-iothalamate and 131I-hippuran.11 After a blank blood sample was drawn, a priming solution containing 0.4 mL/kg body wt of the infusion solution (0.04 MBq of 125I-iothalamate and 0.03 MBq of 131I-hippuran) plus an extra 0.6 MBq of 125I-iothalamate was given at 8 AM, followed by infusion at 12 mL/h. To attain stable plasma levels of both tracers, a 2-hour stabilization period followed, after which baseline measurements were started at 10 AM. The clearances were calculated as (UxV)/P and (IxV)/P, respectively, where UxV is the urinary excretion of the tracer, IxV is the infusion rate of the tracer, and P is the tracer value in plasma at the end of each clearance period. This method corrects for incomplete bladder emptying and dead space by multiplying the urinary clearance of 125I-iothalamate with the ratio of the plasma and urinary clearance of 131I-hippuran. The filtration fraction (FF) was calculated as the ratio of GFR and ERPF and expressed as a percentage. This method has a day-to-day variation coefficient of 2.5% for GFR and 5% for ERPF. GFR was corrected for 1.73 m2 of body surface area (GFRBSA) for comparison with the Modification of Diet in Renal Disease (MDRD) and sMDRD.
Laboratory Methods
Urinary volume was measured in each collection. Serum creatinine, urea, albumin, and urine creatinine were determined by Kodak Ektachem dry chemistry (Eastman Kodak, Rochester, NY). CrCl was calculated as the mean of two 24-hour urine creatinine excretions divided by plasma creatinine. CrCl was also corrected for 1.73 m2 of body surface area (CrClBSA) for comparison with the MDRD and sMDRD. The daily creatinine production was calculated on the basis of CrCl and serum creatinine: (CrClxserum creatinine)/70.13 The body surface area (BSA) was determined as follows: 0.007184xweight0.425xlength0.725. To obtain body mass index (BMI), weight (kg) was divided by the square of height (m2).
Formulas Estimating GFR
Three formulas were used as creatinine-based estimations of GFR: Cockcroft-Gault, MDRD, and sMDRD. These formulas are the most commonly used formulas for estimating the GFR in CHF patients.
Cockcroft-Gault Formula
The GFRcg (mL/min) is calculated as follows3:
MDRD Formula
The MDRD (mL/min per 1.73 m2) is calculated as follows5:
SMDRD Formula
The sMDRD (mL/min per 1.73 m2) is calculated as follows4:
Follow-Up
To compare the prognostic value of the creatinine-based formulas with the true renal function, we performed a follow-up of all our patients. A 12-month follow-up period was available for all patients. A combined clinical outcome parameter was defined consisting of death, heart transplantation, cardiovascular event (myocardial infarction or primary PTCA), and first hospitalization for heart failure.
Statistical Analyses
Correlations between GFRBSA and the different formulas or CrClBSA were performed with the use of Pearson correlation coefficients. Comparisons between GFRBSA and the different formulas or CrClBSA were performed with a paired sample t test. A probability value <0.05 was considered significant. The creatinine-based formulas and CrClBSA were evaluated by a set of criteria to assess their predictive performance. These criteria included precision, accuracy, and bias.
Precision was evaluated by the degree of spread of series of observations and is reflected by the amount of expected variation in the estimates. The r2 statistics were used to measure this and give an indication of the overall fit of the model.4
The accuracy of each equation, or how well it represents the true GFRBSA, was assessed by comparing its result with those of the gold standard (iothalamate clearance). We used the following equation: [predicted valuetrue value (iothalamate clearance)]x100/iothalamate clearance.14 For each equation, the number of subjects with predicted GFRBSA values within the 15% or 30% of the iothalamate clearance was counted.
Bias is any systematic nonrandom deviation causing a prediction error and was calculated as the difference of the logarithmic-transformed GFRBSA and the creatinine-based formulas or CrClBSA. We used the antilogs to obtain the mean percent deviation of the creatinine-based formulas and CrClBSA.15
The agreements between measured GFRBSA and the different creatinine-based formulas or CrClBSA were tested, as described by Bland and Altman.15 The difference between measured GFRBSA and creatinine-based formulas or CrClBSA of each individual subject was graphed as a scatterplot with the mean of the measured GFRBSA and the creatinine-based formula or CrClBSA of the same individual subject. The magnitude of the differences increased in the higher ranges of GFRBSA, and therefore we conducted a logarithmic transformation of GFRBSA, the creatinine-based formulas, and the CrClBSA.15 Scatterplots include 2 dotted lines representing limits of agreement (mean±2xSD). The antilog of the mean±2 SD is the mean percentage ±2 SD. Ninety-five percent of the differences are situated between the lines of agreement.
To identify confounding factors that could explain the observed difference between the true GFR and creatinine-based formulas, we performed secondary analyses in which we determined the bias of the formulas divided within subgroups of the several parameters. Continuous variables were divided into tertiles, and the bias was calculated per tertile.
To compare the accuracy of the different formulas as predictors of an event within 12 months, the area under the receiver operating characteristic (ROC) curve was calculated. This statistic may vary from 0 to 1, with 1 indicating perfect discrimination and 0.5 indicating what is expected by chance alone. For this additional analysis, a combined end pointoccurrence of death, heart transplantation, myocardial infarction, or primary PTCA or an admission because of CHF within 12 monthshas been defined. The results were displayed graphically, with the optimal cutoff chosen as the shoulder of the ROC curve, at the point of maximum sensitivity and specificity. The statistical analysis was performed with the use of SPSS (Chicago, Ill), version 11, and STATA Statistical Software, release 8.2 (StataCorp LP, College Station, Tex).
The authors had full access to the data and take full responsibility for its integrity. All authors have read and agree to the manuscript as written.
| Results |
|---|
|
|
|---|
|
Individual values of the true GFRBSA, the creatinine-based formulas, and CrClBSA are presented in Figure 1A. Cumulative distributions of the true GFRBSA, CrClBSA, and creatinine-based formulas are shown in Figure 1B. GFRBSA >65 mL/min per 1.73 m2 led to underestimation of the true value, whereas GFRBSA <35 mL/min per 1.73 m2 led to overestimation.
|
In Table 2, the predictive performances of the creatinine-based formulas and CrClBSA are presented. All creatinine-based formulas and CrClBSA significantly underestimated GFRBSA as measured by iothalamate clearance. MDRD had the highest precision (r2=0.72) but also the highest bias (13%). The validity of the creatinine-based formulas according to Bland-Altman analyses is shown in Table 2 and is depicted graphically in Figure 2, which shows the mean differences between GFRBSA and the creatinine-based formulas with the lines of agreement (mean±2 SD). The agreement with true GFRBSA was best for the MDRD. Furthermore, these figures illustrate an underestimation in the higher range of renal function, as for a GFRBSA of
65 mL/min per 1.73 m2, and an overestimation in the lower range of renal function, below a GFRBSA of
35 mL/min per 1.73 m2.
|
|
To analyze determinants of the systematic error, we evaluated the predictive performance of the creatinine-based formulas by formula-based subgroups divided into tertiles when measured continuously (Table 3). Especially in the low and high ranges of serum creatinine and urea, the creatinine-based formulas are biased on estimating GFRBSA. In patients with low serum creatinine or urea, the bias was larger. Furthermore, weight appeared to be a moderate confounder in the MDRD formulas.
|
In Table 4, the bias is shown for subgroups divided into tertiles for other clinical parameters. Several variables reflect the severity of CHF, such as LVEF and NYHA class, as well as blood pressure and ERPF. LVEF was only a weak confounder when compared with NYHA class, ERPF, and blood pressure. In patients with a high NYHA class (III and IV) and in patients with low blood pressure (systolic and diastolic) or low ERPF, the formulas performed more precisely. In patients with mild CHF, bias was increased for all formulas, especially in the higher ranges of ERPF. In patients with severe CHF, precision and accuracy were improved (data not shown).
|
During the follow-up of 12 months, 17 patients had an event, of whom 6 patients died, 1 patient had a heart transplantation, and 10 patients were admitted for worsening heart failure. None of the patients had an ischemic cardiovascular event. The predictive value of GFRBSA for an event was high, which was shown in an area under the ROC curve of 0.83. The areas under the ROC curve were comparable for MDRD (0.81; P=0.432), CrClBSA (0.81; P=0.583), and sMDRD (0.78; P=0.176), but the Cockcroft-Gault formula corrected for BSA (GFRcg-BSA) was significantly worse (0.72; P=0.015). The sensitivity and 1specificity of GFRBSA, sMDRD, and GFRcg-BSA are presented in Figure 3. The shoulder of the ROC curves allows the point of best overall discrimination to be identified. From these data, this corresponded to 63 mL/min per 1.73 m2 for GFRBSA (sensitivity 81%, specificity 81%), 45 mL/min per 1.73 m2 for the MDRD (sensitivity 63%, specificity 93%), 49 mL/min per 1.73 m2 for sMDRD (sensitivity 63%, specificity 89%), and 59 mL/min per 1.73 m2 for GFRcg-BSA (sensitivity 70%, specificity 76%).
|
| Discussion |
|---|
|
|
|---|
For exact quantitative assessment of GFR, determination of the renal clearance of an exogenous marker, such as inulin, 125I-iothalamate, or 51Cr-EDTA, is required. Our center has >20 years of experience with 125I-iothalamate clearance, and this method has been validated extensively.11 Furthermore, we also measured urine concentration of 125I-iothalamate and 131I-hippuran to adjust for possible measurement errors, resulting in a very low day-to-day variance.12
We used precision, accuracy, and bias to validate the formulas and CrCl. High precision is important because it informs us whether the distribution of estimated renal function is parallel to exact measured renal function. High accuracy implies that the values of the formulas and CrCl are in close range with the exact measured renal function. This means that the variance is low. Bias informs us about the degree of systematic error present. Bias is preferably low but can be corrected by multiplying with a correction factor, given that the precision and accuracy are high. When these methods are considered, the MDRD is probably the best method to use. However, most studies do not use the MDRD but instead use the sMDRD, which does not require information about serum urea and serum albumin. In our patients with CHF, this formula showed a predictive performance similar to that of the MDRD.
Creatinine-based formulas have been validated in a variety of patient populations, primarily community-based populations or populations with chronic renal disease.14,16 Recently, a smaller retrospective study has validated these formulas in patients with advanced CHF.17 Similar to our findings, the formulas overestimated renal function in the lower values. In patients with mild to moderate CHF, no information was available until now. The present study emphasizes that these formulas cannot be easily extrapolated to other conditions in which they were developed and validated and that caution is required when these formulas are used for a different condition, eg, CHF.
All parameters included in the formulas were more or less confounders, especially serum creatinine. The difference in gender can be explained by the differences in renal function (78 mL/min per 1.73 m2 for male versus 60 mL/min per 1.73 m2 for female subjects), and the formulas performed more precisely and accurately in the lower ranges of renal function. We showed that the impact of age was only moderate, probably because the formulas perform better at higher serum creatinine levels and serum creatinine increases with age.
The performance of the formulas varied within the subgroups of our CHF population. For this reason it could be argued that the selected formula should be tailored to the study population of interest. For example, in an obese population the use of the Cockcroft-Gault formula might be advocated instead of the MDRD formula. However, this should be studied in more detail.
Implications
The value and usefulness of renal function formulas in clinical practice are dependent on the precision and bias of the calculated value. The degree of variation that is acceptable will depend on the particular clinical situation in which the formula is used. The main implications of this study for daily practice are clear; the interpretation of estimations of renal function with the use of creatinine-based formulas and CrClBSA on an individual level suggests cautious interpretation. The variance is wide, at ±30 mL/min per 1.73 m2, meaning that the accuracy is low. In particular, the CrCl has a low accuracy, and therefore we do not recommend using this method, in accordance with the Kidney Disease Outcome Quality Initiative guidelines, for renal function measurement.18 Four other clinically important findings have been encountered. First, in the near-normal values of renal function, all formulas underestimate the true GFRBSA. This is in agreement with several other studies in different study populations.14,19 When the estimated renal function is >65 mL/min per 1.73 m2, the true renal function is in fact higher.
Second, in the lower ranges the estimated renal function overestimates the exact measured renal function. Interestingly, this has only been reported in populations with primary renal disease in predialysis ranges of GFRBSA.20 The overestimation in less severe ranges might be typical for CHF and needs further study. The primarily hemodynamically driven nature of the impaired renal function in CHF might be relevant here. CHF is characterized by low blood pressure and reduced renal perfusion pressure, leading to reduced filtration rate in viable nephrons with intact tubuli still capable of secreting creatinine actively.21 Primary renal diseases are characterized by loss of glomeruli and loss of corresponding tubuli as well. For physicians, it is important to recognize that at a renal function <35 mL/min per 1.73 m2, the estimated renal function starts to be overestimated. This might endanger the patient if one is not aware of this systematic deviation. This is particularly important in elderly patients in whom age-related physiological change results in reduced renal function and, for example, changes in drug pharmacokinetics and pharmacodynamics. We therefore recommend measuring the exact renal function periodically in these patients, especially if heart transplantation or renal replacement therapy is considered.
These 2 factors could also be of importance in long-term monitoring of renal function. Although we did not study the predictive performance of the formulas longitudinally, physicians should be aware of the possible change in predictive performance across the spectrum from mild to severe CHF, from underestimation to overestimation. This could mean that, although estimated renal function suggests a stable condition during worsening of CHF, it may in fact be declining.
Third, in CHF patients these formulas can be used very well for pharmacokinetic purposes. Adjustments in dosage of drugs is often recommended when GFR is <60 mL/min per 1.73 m2 or when GFR is <30 mL/min per 1.73 m2. This study has shown that the formulas perform very well within this range, and therefore dose adjustment can be safely executed with the use of these formulas.
Finally, our study is the first to compare the prognostic value of the estimated renal function for cardiovascular outcome with the true renal function. The true renal function is the best parameter to predict an event. The MDRD and the CrClBSA were both accurate parameters to predict events. In contrast, the Cockcroft-Gault formula was a significantly worse prognostic parameter. We therefore recommend that the latter formula not be used for prognostic purposes.
Limitations
In this study all patients were using renin-angiotensin system inhibitors (angiotensin II converting-enzyme inhibitors or angiotensin II receptor type 2 antagonists). In the past, the effect of ACE inhibitors on renal function has been studied in CHF patients. Some studies found an increase in GFR,22 others found a decrease, and others did not find any significant effect.23,24 The net effect of renin-angiotensin system inhibitors on renal function in CHF patients remains to be elucidated. However, to the best of our knowledge, no available data suggest that renin-angiotensin system blockade could alter the relationship between true renal function and equation-derived estimates of renal function. Therefore, we do not consider it likely that the use of renin-angiotensin system inhibitors affected our results. Renin-angiotensin system inhibitors are considered essential therapies in patients with CHF, and therefore it would be difficult to obtain renal function measurements before and after the initiation of these medications. The population studied consisted of only patients with systolic dysfunction. The performance and prognostic value of the formulas should also be studied in patients with preserved systolic function.
All of our CHF patients were of white ethnicity and formed a representative sample of the Dutch population, but whether the predictive performance MDRD formulas are the same for CHF patients with black or other ethnicities remains to be elucidated.
Conclusion
All formulas underestimated GFRBSA in the near-normal and normal ranges of renal function and tended to overestimate GFRBSA in the low and very low ranges, although the predictive performance improved in patients with severe CHF. The MDRD formula is the most precise, especially in the lower ranges of GFRBSA, which makes this formula the most reliable in clinical practice. True renal function provided the best prognostic index for cardiovascular outcome, whereas the CrClBSA and the MDRD had a good prognostic value for cardiovascular outcome as well, and the sMDRD, which is from a clinical perspective the most practical formula, was slightly less accurate.
| Acknowledgments |
|---|
Disclosures
None.
| References |
|---|
|
|
|---|
| Footnotes |
|---|
Related Article:
Circulation 2006 114: 1555.
This article has been cited by other articles:
![]() |
P. van der Meer, D. J. Lok, J. L. Januzzi, P. W. B.-A. de la Porte, E. Lipsic, J. van Wijngaarden, A. A. Voors, W. H. van Gilst, and D. J. van Veldhuisen Adequacy of endogenous erythropoietin levels and mortality in anaemic heart failure patients Eur. Heart J., June 2, 2008; 29(12): 1510 - 1515. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. G. Loef, R. H. Henning, G. Navis, A. J. Rankin, W. van Oeveren, T. Ebels, and A. H. Epema Changes in glomerular filtration rate after cardiac surgery with cardiopulmonary bypass in patients with mild preoperative renal dysfunction Br. J. Anaesth., June 1, 2008; 100(6): 759 - 764. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Q. Khan, O. Dhillon, D. Kelly, I. B. Squire, J. Struck, P. Quinn, N. G. Morgenthaler, A. Bergmann, J. E. Davies, and L. L. Ng Plasma N-Terminal B-Type Natriuretic Peptide as an Indicator of Long-Term Survival After Acute Myocardial Infarction: Comparison With Plasma Midregional Pro-Atrial Natriuretic Peptide: The LAMP (Leicester Acute Myocardial Infarction Peptide) Study J. Am. Coll. Cardiol., May 13, 2008; 51(19): 1857 - 1864. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Melloni, E. D. Peterson, A. Y. Chen, L. A. Szczech, L. K. Newby, R. A. Harrington, W. B. Gibler, E. M. Ohman, S. A. Spinler, M. T. Roe, et al. Cockcroft-Gault versus modification of diet in renal disease: importance of glomerular filtration rate formula for classification of chronic kidney disease in patients with non-ST-segment elevation acute coronary syndromes. J. Am. Coll. Cardiol., March 11, 2008; 51(10): 991 - 996. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. W.L. Hartog, A. A. Voors, C. G. Schalkwijk, J. Scheijen, T. D.J. Smilde, K. Damman, S. J.L. Bakker, A. J. Smit, and D. J. van Veldhuisen Clinical and prognostic value of advanced glycation end-products in chronic heart failure Eur. Heart J., December 1, 2007; 28(23): 2879 - 2885. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Schou, F. Gustafsson, C. N. Kistorp, P. Corell, A. Kjaer, and P. R. Hildebrandt Effects of Body Mass Index and Age on N-Terminal Pro Brain Natriuretic Peptide Are Associated with Glomerular Filtration Rate in Chronic Heart Failure Patients Clin. Chem., November 1, 2007; 53(11): 1928 - 1935. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Q. Khan, O. S. Dhillon, R. J. O'Brien, J. Struck, P. A. Quinn, N. G. Morgenthaler, I. B. Squire, J. E. Davies, A. Bergmann, and L. L. Ng C-Terminal Provasopressin (Copeptin) as a Novel and Prognostic Marker in Acute Myocardial Infarction: Leicester Acute Myocardial Infarction Peptide (LAMP) Study Circulation, April 24, 2007; 115(16): 2103 - 2110. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Delanaye, J. M. Krzesinski, and E. Cavalier Letter by Delanaye et al Regarding Article, "Drawbacks and Prognostic Value of Formulas Estimating Renal Function in Patients With Chronic Heart Failure and Systolic Dysfunction" Circulation, March 20, 2007; 115(11): e333 - e333. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Circulation Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2006 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |