Skip to main content

The reliability of the ankle-brachial index in the Atherosclerosis Risk in Communities (ARIC) study and the NHLBI Family Heart Study (FHS)

Abstract

Background

A low ankle-brachial index (ABI) is associated with increased risk of coronary heart disease, stroke, and death. Regression model parameter estimates may be biased due to measurement error when the ABI is included as a predictor in regression models, but may be corrected if the reliability coefficient, R, is known. The R for the ABI computed from DINAMAP™ readings of the ankle and brachial SBP is not known.

Methods

A total of 119 participants in both the Atherosclerosis Risk in Communities (ARIC) study and the NHLBI Family Heart Study (FHS) had repeat ABIs taken within 1 year, using a common protocol, automated oscillometric blood pressure measurement devices, and technician pool.

Results

The estimated reliability coefficient for the ankle systolic blood pressure (SBP) was 0.68 (95% CI: 0.57, 0.77) and for the brachial SBP was 0.74 (95% CI: 0.62, 0.83). The reliability for the ABI based on single ankle and arm SBPs was 0.61 (95% CI: 0.50, 0.70) and the reliability of the ABI computed as the ratio of the average of two ankle SBPs to two arm SBPs was estimated from simulated data as 0.70.

Conclusion

These reliability estimates may be used to obtain unbiased parameter estimates if the ABI is included in regression models. Our results suggest the need for repeated measures of the ABI in clinical practice, preferably within visits and also over time, before diagnosing peripheral artery disease and before making therapeutic decisions.

Peer Review reports

Background

The ratio of the ankle to the brachial systolic blood pressure (SBP), the ankle-brachial index (ABI), is an indicator of atherosclerotic vascular disease in the lower extremities and a simple, non-invasive measure of subclinical atherosclerosis [19]. The ABI has been shown in cross-sectional studies to be associated with cardiovascular disease (CVD) risk factors including smoking [1017] diabetes [1012, 18, 19], total cholesterol [10, 12, 13, 20, 21] hypertension [10, 12, 13] and low birth weight [14]. The ABI is associated with other subclinical [10, 2225] and clinical [10, 12, 13, 23, 2528] CVD manifestations. Prospective studies have found that those with ABI-defined lower extremity arterial disease (LEAD) are approximately 1.5 to 2 times more likely to have a clinical CVD event [27, 2931]. The ABI has a graded, inverse association with mortality [32, 33].

Regression parameters may be biased when predictors are measured with error [34, 35]. The parameter estimate for a regression model with a single explanatory variable measured with error will be biased towards the null by a multiplicative factor R, the reliability coefficient. Parameter estimates for additional covariates included in the model may be biased in any direction. Unbiased parameter estimates may be obtained using Stein estimators of true values [36] or other techniques if R is known [34, 35].

To measure ankle SBP, Doppler ultrasound devices have been used for many years to detect blood flow distal to an occluding cuff. Many epidemiologic CVD studies have included an ABI measured using either Doppler at the ankle and sphygmomanometry at the arm, or Doppler at both the ankle and the arm. In order to reduce interobserver variation, several studies including the Atherosclerosis Risk in Communities (ARIC) study [37] and the NHLBI Family Heart Study (FHS) [38] have employed an automated, oscillometric device to measure ankle and brachial SBPs. Limited data regarding the repeatability of ankle and arm SBPs measured with oscillometric devices are available, but the repeatability of the ABI measured with the widely-used DINAMAP™ has not been published to our knowledge.

DINAMAP™ ankle and brachial SBPs were taken during ultrasound exams using the same protocol, equipment, and pool of sonographers in the ARIC study and the FHS. Using repeat measures of the ABI taken within a year apart for each of these studies, we estimate variance components and reliability coefficients for ankle and brachial SBPs and for the ABI. We also examined the effect of participant characteristics on the ABI reliability.

Methods

Study population

The ARIC study cohort comprises 15,792 members aged 45–64 years of randomly selected households in four United States communities: Forsyth County, North Carolina; northwest suburbs of Minneapolis, Minnesota; Washington County, Maryland; and African American residents of Jackson, Mississippi [37, 39]. ARIC participants were examined at baseline between December 1986 and January 1990 and were then examined every 3 years after their baseline examination. Institutional review board (IRB) approval for each examination cycle and for annual follow-up were obtained by each participating field center and the coordinating center. Informed consent itemized the procedures consented to and any restrictions to the use of biospecimen. The FHS population comprises 588 randomly-selected individuals (probands) and their families and 657 families with high coronary heart disease (CHD) risk scores from three ongoing epidemiologic studies in four communities: the Forsyth County, North Carolina and Minneapolis, Minnesota cohorts of the ARIC study; the Framingham Heart Study in Framingham, Massachusetts; and the Health Family Tree Program in Salt Lake City, Utah [38]. FHS participants were examined in 1994–1995. IRB approval for the examination and a follow-up were obtained by the participating field centers and the coordinating center. Informed consent itemized the procedures consented to and as well as restrictions to the use of biospecimens.

Seven hundred ten ARIC study participants and their families participated in the FHS clinic examination: 267 randomly-selected families, 340 families with high family risk scores, and 103 black participants at Forsyth [38]. One member of each selected ARIC household was designated as proband; 585 total ARIC probands were examined in Phase II of the FHS, of whom 577 had an ARIC 6- or 9-year follow-up visit when the ABI was to be measured.

Replicate ankle-brachial index measures taken for each of the two studies were available for 335 ARIC probands, 120 of which were taken within 365 days. The ARIC ABI measure closest to the FHS exam was chosen; 48 participants had 3 measures, but in all cases the second and third measures were > 365 days apart. One participant who had a difference between ABI measures that was more than 3 standard deviations (SDs) from the mean pair difference was excluded. Of the remaining 119 participants, 25 (21 percent) had their first measure in the FHS and the second at ARIC visit 3 and 22 (18 percent) had the second at ARIC visit 4; 72 (61 percent) had the first ABI measure at ARIC visit 3 and the second at the FHS exam. Measures were taken an average of 228 days apart.

Ankle-brachial index measurement

Ankle and brachial blood pressures were obtained immediately prior to the ultrasound examinations by the same pool of 11 sonographers in both the FHS and ARIC follow-up visit clinic exams, using the same protocol and equipment [40, 41]. With the participant resting in the supine position, the cuff was placed using a contour wrapping technique over the posterior tibial artery of one ankle [42], selected based on the date. The cuff was then placed over the brachial artery of the right arm, if anatomy permitted. Blood pressures were taken with a DINAMAP™ 1846 SX automated oscillometric device (Critikon, Inc., Tampa, FL). None of the 577 subjects in both studies had a recorded blood pressure outside the device's detection limits, <30 or >245 mmHg [43]; one subject was excluded who had one ABI where the ankle systolic blood pressure (SBP) was ≥ 75 mmHg more than the brachial SBP, a criterion employed to exclude non-compressible arteries [44]. The ABI was computed as the ratio of the ankle SBP to the brachial SBP.

At the ARIC baseline survey, the ankle SBP was measured with the participant prone before and after ultrasound scanning of the popliteal artery, then brachial SBPs were measured supine every 5 minutes during the carotid ultrasound. The ABI was computed as the ratio of the average of the last two available ankle SBPs to the average of the first two brachial SBPs.

Covariates

In the ARIC study and the FHS, hypertension was defined as a sitting SBP > 140 mmHg, diastolic blood pressure > 90 mmHg, or use of antihypertensive medication within 2 weeks prior to the examination. Diabetes was defined as a fasting glucose level ≥ 7.8 mmol/L (140 mg/dL), a non-fasting level ≥ 11.1 mmol/L (200 mg/dL), self-reported history of diabetes, or the use of hypoglycemic agents. In ARIC, prevalent CHD was defined as evidence of a prior myocardial infarction on a 12-lead ECG, or self-reported history of a physician-diagnosed heart attack, coronary bypass surgery, or coronary angioplasty. In the FHS self-reported, physician diagnosed coronary heart disease was confirmed by review of hospital records.

Statistical analysis

For all statistical tests, two-sided p values < 0.05 were considered statistically significant. Characteristics of the ABI reliability study subjects were compared to characteristics of the ARIC source population at visits 1 and 3 using Kruskal-Wallis two-sample tests for continuous variables and Wilcoxon tests for categorical variables.

Each of the two observed values was assumed to represent the sum of the true value and random within-person variation [34]. Within-person variation may be due to measurement error and physiologic variation. We assumed that the within-person variation is independent of the value's magnitude and that the within-person variation for each of the two values are independent and identically distributed with mean zero and common variance. Estimates of the between-person and within-person variances were obtained with estimators derived using the method of moments; similar estimates were obtained using SAS PROC MIXED release 8.1 (SAS Institute, Inc., Cary, NC). The reliability coefficient, R, was computed as the ratio of the between-person variance to the total variance and can be interpreted as the proportion of the total variance not due to within-person variation, or as the correlation between measures made at repeat visits for an individual. The within-person coefficient of variation (CV) was computed as 100 times the square root of the within-person variance divided by the mean of the individual mean replicates. These methods were applied to ankle and brachial SBP measurements as well as to ABI. In addition, the multivariate generalization of this method was applied to produce the multivariate error covariance matrices and between-person covariance matrices for ankle and arm SBP and the component-wise ratios of the error and between-person covariance to total covariance. (The diagonal elements of this matrix of ratios are the reliability coefficients for ankle and arm SBP).

Because the arm SBPs and ABIs were not normally distributed, confidence intervals for the estimates of variance components and reliability coefficients were derived from 300 bootstrap samples [45]. We compared variance components, reliability coefficients, and CVs by levels of important covariates, including the FHS sampling group. Analyses did not account for the FHS sampling scheme. To test subgroup differences, we constructed bootstrapped 95 percent confidence intervals for the differences; intervals not including zero were deemed statistically significant.

To examine the assumption of independence of the within-person variation from the ABI level, we compared the estimated square root of the within-person variance (i.e., the within-person SD) for those whose first of the two repeat ABIs was at or below with those whose first ABI was above the median ABI in the 119 reliability study subjects. We also examined plots of the pair differences versus the pair means for the ankle SBP, arm SBP, and ABI [46].

The ABI measured at the ARIC baseline survey is of interest as a predictor of subsequent events. Because repeat ankle and arm SBPs are available for the baseline survey, the ABI is usually computed as the ratio of the average of two ankle SBPs (in the same ankle) to the average of two arm SBPs (in the right arm). We estimated the within-visit multivariate error and total covariance matrices using repeat ankle and arm SBP measures taken at the ARIC baseline survey. The ratios of within-visit multivariate error to total covariance matrices from the baseline survey data were multiplied times the total variance in the ARIC/FHS repeat data to partition the non-between person variance found there into between-visit and within-visit components. We simulated a two-measures-per-visit repeatability dataset very much like the actual repeatability dataset by taking each subject's mean of the two actual repeated BP measures as the "true" BP values, and adding independent random "between-visit" and "within-visit" Gaussian measurement error, of size to make these two variance components the same proportion of the total variance as in the results of the repeatability study and the baseline survey within-visit repeatability analysis. With the simulated data, the reliability coefficient for the ABI was computed as a ratio of means, along with the reliability coefficient using just the first measure at each visit. This was repeated 1000 times and the reliability coefficients averaged.

Results

Of the 119 reliability study subjects, 70 (58.8 percent) were women, 100 (84.0 percent) were white, and 77 (64.7 percent) were from the Forsyth County field center. At the time of the first ABI measure, the mean age was 61.3 years, mean weight 75.7 kg, mean body mass index 28.0 kg/m2, and mean ABI 1.16; 13 (10.9 percent) had diabetes mellitus, 43 (36.1 percent) had hypertension, and 31 (26.0 percent) had coronary heart disease. Characteristics of this group were similar to those of the ARIC cohort in Minneapolis and Forsyth County at the time of the ARIC baseline survey and at visit 3, except with respect to the distribution of characteristics related to the FHS sampling procedures: race/ethnicity, field center, and CHD prevalence (Table 1).

Table 1 Characteristics of ABI reliability study subjects compared with the ARIC study cohort

The estimated reliability coefficient for the ankle SBP was 0.682 (95 percent confidence interval (CI): 0.570, 0.772), for the arm SBP was 0.736 (95 percent CI: 0.622, 0.827), and for the ABI was 0.612 (95 percent CI: 0.505, 0.699) (Table 2). These values are very close to estimated Pearson correlation coefficients of 0.68, 0.74, and 0.62, respectively, which have no underlying measurement error model assumptions. Arm SBP measures appear to have been more repeatable than ankle SBPs, as reflected by a lower within-person SD (10.8 v. 14.6 mmHg), a lower within-person CV (8.6 v. 10.0 percent), and a higher reliability coefficient (0.736 v. 0.682). Exclusion of 4 data pairs with either ABI measurement > 1.5 had little effect on variance estimates.

Table 2 Variation in DINAMAP™ measurements of arm and ankle systolic blood pressure and the ankle-brachial index

The ankle SBP increased an average of 3.1 mmHg between the first and second measures (p = 0.11), which resulted in a statistically significant average increase of 0.031 in the ABI (p = 0.02). Adjustment for the fixed effect of time (first v. second measure) in an analysis of variance model changed the variance component estimates very little. FHS ankle SBP measures were an average of 3.2 mmHg higher than ARIC measures (p = 0.10). ABI measures in the FHS were 0.029 higher, on average, than ARIC measures (p = 0.03); controlling for the fixed effect of time reduced the study difference to 0.024 (p = 0.09). No significant effects of time or study were apparent for arm SBP.

The estimated ABI variance components differed in some subgroups (Table 3). The within-person SD was statistically significantly smaller at the Minneapolis than at the Forsyth County field center (0.086 versus 0.116). The within-person SD was smaller in those with a BMI ≤ the median of 27 kg/m2 than in those with a BMI > 27 kg/m2 (0.083 versus 0.126), resulting in a significantly greater reliability coefficient in those with a lower compared to those with a higher BMI (0.741 versus 0.495). Those whose same ankles were measured had a statistically significantly lower reliability coefficient (R = 0.486) than those with different ankles measured (R = 0.706). There were too few African American subjects, subjects with diabetes, and subjects who initiated or discontinued hypertension treatment to test for subgroup differences. Within-person SDs and reliability coefficients did not differ significantly by age ≤ or > 62 years, gender, hypertension, or by whether the time between measures was greater or less than the median interval of 240 days. Except for the estimated total variance, estimates did not differ significantly between those in the high family risk score and the random sample FHS sampling groups; the proportion of reliability study subjects in the African American sampling group was too small to test for differences.

Table 3 Variation in DINAMAP™ measurements of the ankle-brachial index by subgroup defined at the first measurement

Within-person SD estimates did not differ significantly between those with an ABI ≤ 1.15 and those with an ABI > 1.15 (0.113 versus 0.097), the median ABI in the 119 reliability study subjects. A plot of the pair differences versus the pair means revealed no obvious dependence of the spread of the differences on the ABI level (Figures 1, 2, 3); however, the difference between the first and second measure decreased with increasing ABI level. The ankle SBP differences did not depend statistically significantly on ankle SBP level, but the arm pressure difference decreased with increasing arm SBP. The two ankle pressures differed by >10 mmHg in 73 (61.3 percent) subjects, by >20 mmHg in 38 (31.9 percent) subjects, by >30 mmHg in 15 (12.6 percent) subjects, and by >40 mmHg in 7 (5.9 percent) subjects. Arm pressures differed by >10 mmHg in 51 (42.9 percent) subjects, by >20 mmHg in 19 (16.0 percent) subjects, by >30 mmHg in 7 (5.9 percent) subjects, and by >40 mmHg in 5 (4.2 percent) subjects.

Figure 1
figure 1

Bland-Altman plot showing the reproducibility of the ankle-brachial index. The differences between the first and second measurements are plotted against the mean of the two measures with 95% limits of agreement (solid lines) and regression line (dashed line).

Figure 2
figure 2

Bland-Altman plot showing the reproducibility of the ankle systolic blood pressure. The differences between the first and second measurements are plotted against the mean of the two measures with 95% limits of agreement (solid lines) and regression line (dashed line).

Figure 3
figure 3

Bland-Altman plot showing the reproducibility of the brachial systolic blood pressure. The differences between the first and second measurements are plotted against the mean of the two measures with 95% limits of agreement (solid lines) and regression line (dashed line).

The multivariate within-person error covariance and true-to-total ratio covariance matrices for ankle and arm SBPs estimated from the reliability study are given in Table 4. The non-zero ankle-arm covariance suggests that the ankle and arm SBP within-person errors were correlated (ρ = 0.56). The diagonal elements of the true-to-total component-wise ratio covariance matrix represent the scalar reliability coefficients.

Table 4 Multivariate between-visit covariance matrices for ankle and arm systolic blood pressures estimated in reliability study subjects

The multivariate within-person (between-visit) error covariance and true-to-total component-wise ratio covariance matrices estimated from the ARIC baseline survey are given in Table 5. The within-visit ankle and arm errors were essentially uncorrelated (ρ = 0). The correlation between within-visit measures was high: 0.92 for ankle SBP and 0.90 for arm SBP.

Table 5 Multivariate within-visit covariance matrices for ankle and arm systolic blood pressures estimated in ARIC study participants

From ARIC baseline survey data, we also estimated the within-visit variance and reliability of repeat ABIs, arbitrarily computed as the ratio of the first ankle to first arm SBP and the ratio of the second ankle to second arm SBP. The within-visit error variance for the ABI was 0.00636, and the reliability coefficient was 0.681.

The ABI measured at the ARIC baseline survey, computed as the ratio of the average of two ankle SBPs to the average of two arm SBPs, is of interest as a predictor in regression models. Using the estimates of the total and within-visit errors (Tables 4 and 5, respectively), a dataset containing two ankle and two arm SBPs at each of two visits was simulated by assuming that the pair means for the reliability study represented the "true" values. For each of 1000 replications, the reliability coefficients were estimated for the ABI computed at each visit as the ratio of the averages of the within-visit values and the ABI computed as the ratio of the first measures, and then the mean reliability coefficients over the replications taken. The result for the reliability coefficient for single measures was 0.613, very near that from the actual reliability study, and was 0.704 for the reliability coefficient for the ratio of means.

Discussion

The within-person variance estimated from our data indicates that the 95% confidence interval of a patient's ABI would be the ABI value ± 0.21 if based on a single measure of the ABI. Thus, our results suggest the need for repeated measures of the ABI in clinical practice, if at all possible within visits and also over time, before diagnosing peripheral artery disease and before making therapeutic decisions.

To our knowledge, few studies of the repeatability of ankle or arm pressures measured with the DINAMAP™ have been published, and the designs of the few published studies do not include these same sources of variability. No reliability coefficient has been published, of which we are aware, for the ABI measured using the DINAMAP™ at both the ankle and arm.

We have estimated within-person SDs of 14.6 mmHg for ankle SBP and 10.8 mmHg for brachial SBP, with reliability coefficients of 0.68 and 0.74, respectively, for DINAMAP™ measures taken up to 1 year apart in a sample of two middle-aged populations. Using a DINAMAP™ 1846SX and a contour wrap at the ankle, Mundt et al [42] found a within-person SD of 4.0 mmHg for ankle SBP and 2.5 mmHg for brachial SBP, with reliability coefficients of 0.94 and 0.92, respectively, for three repeat ankle and two repeat arm measures one minute apart by one of two technicians among 71 adult volunteers aged 23–67 years; the same ankle was used for all repeat measures. Ramanathan et al [47] who also used a contour wrap at the ankle but used a VitalCare DOX Model 506DXN automated oscillometric device, estimated inter-reading intraclass correlation coefficients (ICCs) of 0.83 for ankle SBP and 0.85 for arm SBP for 3 repeat measures taken 30 minutes apart by each of 2 investigators among 50 healthy volunteers with a median age of 23 years. De Graaff et al [48] using a DINAMAP™ Plus measured brachial SBPs twice by each of two observers at each of 2 visits one week apart in 54 vascular laboratory patients with a mean age of 66 years. Estimates of within- and between-day, and within- and between-week, ICCs are given, but no overall estimate is presented with which we can compare our estimate of reliability.

Using the contour wrapping technique, ankle SBP measured with the DINAMAP™ 1846SX were found to be about 3.0 mmHg lower, on average, than measures taken with Doppler ultrasound [42]. Estimates of reliability were comparable between the two methods, with a reliability coefficient of 0.92 for Doppler and 0.94 for DINAMAP™ measures. This study did not include variation due to different days or legs, however. Fowkes et al [49] studied the variability of Doppler ultrasound measures of ankle SBP, brachial SBP, and the ABI in 24 peripheral artery disease (PAD) patients and 11 volunteers without PAD aged 40–74 years. Two measures were taken in each leg and the right arm by each of two observers and then repeated two weeks later. Reliability coefficients can be computed from the results by summing all intraindividual variance components. Regrettably, components of variance <10 were not reported, but the range of possible values can be estimated assuming unreported estimates were either all 10 or all 0. For Doppler ankle SBP, R was between 0.78 and 0.90 for normal subjects, and 0.37 and 0.46 for diseased subjects. For Doppler arm SBP, R was between 0.87 and 0.91 for normal subjects, and was 0.68 for diseased subjects. For the ABI, R was between 0.40 to 0.42 for diseased subjects; the range of R computed from the reported between-subject variance for normal subjects was implausibly low. These values bracket those found in our reliability study for DINAMAP™ SBP measures.

The estimated reliability coefficient for the ABI, 0.61, is comparable to that for another measure of subclinical atherosclerosis in the ARIC study, carotid intima-medial thickness (IMT), but is lower than that found for other measures. A reliability coefficient of 0.60 was estimated for the mean carotid IMT, averaged over 3 arterial sites bilaterally, in 279 subjects who participated in both the ARIC study and the FHS and with carotid B-mode ultrasounds within a year apart (Diane Catellier, University of North Carolina, unpublished manuscript, 2000). A reliability coefficient of 0.67 was estimated for the mean carotid IMT measured at three visits, 7–14 days apart in 36 volunteers from each of the four ARIC field centers [50]; measures of arterial distensibility and arterial compliance had reliability coefficients of 0.67 and 0.77 [51]. Estimated reliability coefficients for the ARIC study are 0.94 for both total and HDL-cholesterol [52], and 0.72 for plasma fibrinogen [53].

The within-person variation in this reliability study includes variation due to within and between observer, day, and leg, and physiologic variation. Thus, the ABI reliability estimated from the reliability study data is lower than the within-visit reliability estimated from ARIC baseline survey data, because the reliability study's within-person variability includes both between-visit and within-visit variation. The between-visit variation includes variation due to different technicians, different machines, and within-person biologic variation.

The reliability of the ABI was lower than that of either of its components: the ankle SBP or arm SBP. The lower reliability of the ankle SBP compared with that of the arm SBP may be due to the greater difficulty in placing a cuff on the more conical extremity.

Estimates of within-person variation in this reliability study apply to measures using the methodology at ARIC visits 3 and 4 and in the FHS, and may not apply to other situations. Extreme care was taken in these studies to minimize measurement variation, including a detailed, common protocol and training and certification of technicians. Reliability is likely to be lower in patient care settings, where these methods are unlikely to be standardized. Different oscillometric devices may vary in the algorithms employed for determining systolic blood pressure [54] and the accuracy of different oscillometric devices relative to sphygmomanometry has been found to differ [55]; the repeatability of different devices may differ as well. In addition, the reliability coefficient depends on the total variance in the population and, therefore, the reliability estimated in this study may not apply to other populations. Assuming the same within-person variance, if the total variance is lower than in the reliability study, as it is in the ARIC baseline survey, then the reliability coefficient would be lower than that estimated.

The reliability study defined the ABI as a ratio of single blood pressure measurements. In the ARIC baseline survey, the ABI is defined using the mean of two ankle SBPs (in the same leg) and the mean of two arm SBPs (in the same arm), where the measures were taken approximately 5 minutes apart, and in the study of associations between the ABI and potential disease outcomes this ABI will be used. We have seen that the reliability coefficient for such an ABI is notably higher than that computed directly from the ARIC/FHS reliability study.

In clinical practice, repeated measures of the ABI should be made, preferably within visits and over time before diagnosing peripheral artery disease and before making therapeutic decisions. Based on the within-person variance estimated here, the 95% confidence interval (1.96 times the within-person standard deviation) for one person based on one measure of the ABI would be the ABI ± 0.21. In general, for the average of n measures, this interval becomes the ABI average ± 0.21/√n, so the interval for an ABI based on the average of two visits would be ABI ± 0.15, and average ABI ± 0.12 if based on 3 measures. The reliability of oscillometric measurement of the brachial SBP is not much greater than that of the ABI, and multiple measures of the brachial SBP are recommended before instituting hypertension treatment [56].

Most population-based epidemiologic studies have measured the ankle pressure in both legs, once [18] or twice over the posterior tibial [10, 12, 57] or both over this artery and the dorsalis pedis [58] on each ankle. The mean of the repeated measurements on each ankle [10, 12, 57] or the highest SBP for each ankle [58] was then used, and a single ABI for the participant was computed using the minimum of the ankle numerators of the two legs. ABI values based on different protocols likely are associated with different levels of variability, the most robust (although not necessarily the most sensitive to peripheral arterial disease), being those based on averaged repeated measures. The effect of the choice of measurement protocol on the ABI reliability would be important to know, but cannot be assessed in this study since the ABI was defined in ARIC using ankle pressure measured in one, randomly selected leg.

The limited number of reliability study subjects in certain subgroups limited our ability to test for subgroup differences. The significantly higher within-person SD at Forsyth might be because 7 technicians were employed at the Forsyth County field Center and 4 at Minneapolis. The Forsyth County field center had 25 percent African American subjects, while Minneapolis subjects were all white (p < 0.001); Forsyth also had a higher proportion of subjects with diabetes (14 percent v. 5 percent) than Minneapolis. The center difference might also reflect different proportions of subjects with higher within-person variation, although the difference in reliability coefficients between the two centers was not larger than chance alone would explain and small numbers in these subgroups prevent further analysis. Counter to intuition, the ABI had a lower reliability in those whose ABI was measured in the same leg than in those whose was measured in different legs; this may represent a chance finding in this small study. It would have been desirable to examine whether the reliability differed in subjects with and without ABI-defined LEAD (e.g., ABI < 0.9), but the limited sample size did not allow for this analysis.

Individuals are often categorized as having LEAD or not by categorizing the observed ABI as below or above a cutpoint, typically 0.9. This categorical variable is then included as a predictor in regression models. An upper limit of normal for the ABI also has been proposed [57] to assess arterial stiffness and medial arterial calcification. Categorization of a continuous variable measured with non-differential measurement error may result in differential misclassification when the probability of disease is related to the level of the continuous variable [59]. Resulting regression parameter estimates are biased, but methods that assume non-differential misclassification may not correctly adjust these estimates.

Conclusion

The reliability of the ABI computed as the ratio of single ankle and arm oscillometric SBPs was found to be 0.61. The reliability of the ABI computed as the ratio of the average of two ankle SBPs to two arm SBPs was estimated from simulated data as 0.70. These reliability estimates may be used to obtain unbiased parameter estimates if the ABI is included in regression models. If ankle and arm SBP are included as separate predictors in a regression model, corrected parameter estimates may be obtained by taking the multivariate reliability into account.

References

  1. Winsor T: Influence of arterial disease on the systolic blood pressure gradients of the extremity. Am J Med Sci. 1950, 220: 117-

    Article  CAS  PubMed  Google Scholar 

  2. Strandness DE, Bell JW: Peripheral vascular disease: diagnosis and objective evaluation using a mercury strain guage. Annals of Surgery. 1965, 161 Suppl.: 3-

    Google Scholar 

  3. Carter SA: Indirect systolic pressures and pulse waves in arterial occlusive disease of the lower extremities. Circulation. 1968, 37: 624-

    Article  CAS  PubMed  Google Scholar 

  4. Yao ST, Hobbs JT, Irvine WT: Ankle systolic pressure measurements in arterial disease affecting the lower extremities. British Journal of Surgery. 1969, 56: 676-

    Article  CAS  PubMed  Google Scholar 

  5. Carter SA: Clinical measurement of systolic pressure in limbs with arterial occlusive disease. JAMA. 1969, 207: 1869-10.1001/jama.207.10.1869.

    Article  CAS  PubMed  Google Scholar 

  6. Fronek A, Johnson KH, Dilley RB, Bernstein EF: Non-invasive physiologic tests in the diagnosis and characterization of peripheral arterial occlusive disease. American Journal of Surgery. 1973, 126: 205-

    Article  CAS  PubMed  Google Scholar 

  7. Ouriel K, Zarins CK: Dopper ankle pressure: an evaluation of three methods of expression. Arch Surg. 1982, 117: 1297-

    Article  CAS  PubMed  Google Scholar 

  8. Kiekara O, Riekkinen H, Soimakallio S, Lansimies E: Correlation of angiographically determined reduction of vascular lumen with lower-limb systolic pressures. Acta Chir Scand. 1985, 151: 437-

    CAS  PubMed  Google Scholar 

  9. Lijmer JG, Hunink MG, van den Dungen JJ, Loonstra J, Smit AJ: ROC analysis of noninvasive tests for peripheral arterial disease. Ultrasound in Medicine & Biology. 1996, 22 (4): 391-10.1016/0301-5629(96)00036-1.

    Article  CAS  Google Scholar 

  10. Newman AB, Siscovick DS, Manolio TA, Polak J, Fried LP, Borhani NO, Wolfson SK: Ankle-arm index as a marker of atherosclerosis in the Cardiovascular Health Study. Circulation. 1993, 88: 837-

    Article  CAS  PubMed  Google Scholar 

  11. Beks PJ, Mackaay AJC, deNeeling JND, de Vries H, Bouter LM, Heine RJ: Peripheral arterial disease in relation to glycaemic level in an elderly Caucasian population: the Hoorn Study. Diabetologia. 1995, 38: 86-10.1007/s001250050257.

    Article  CAS  PubMed  Google Scholar 

  12. Curb JD, Masaki K, Rodriguez BL, Abbott RD, Burchfiel CM, Chen R, Petrovitch H, Sharp D, Yano K: Peripheral artery disease and cardiovascular risk factors in the elderly. Arteriosclero Thromb Vasc Biol. 1996, 16: 1495-500.

    Article  CAS  Google Scholar 

  13. Stoffers HEJH, Rinkens PE, Kester AD, Kaiser V, Knottnerus JA: The prevalence of asymptomatic and unrecognized peripheral arterial occlusive disease. International Journal of Epidemiology. 1996, 25 (2): 282-

    Article  CAS  PubMed  Google Scholar 

  14. Martyn CN, Gale CR, Jespersen S, Sherriff SB: Impaired fetal growth and atherosclerosis of carotid and peripheral arteries. Lancet. 1998, 352 (9123): 173-10.1016/S0140-6736(97)10404-4.

    Article  CAS  PubMed  Google Scholar 

  15. Donnan PT, Thomson M, Fowkes FG, Prescott RJ, Housley E: Diet as a risk factor for peripheral arterial disease in the general population: the Edinburgh Artery Study. American Journal of Clinical Nutrition. 1993, 57 (6): 917-

    CAS  PubMed  Google Scholar 

  16. Lowe GD, Fowkes FG, Dawes J, Donnan PT, Lennie SE, Housley E: Blood viscosity, fibrinogen, and activation of coagulation and leukocytes in peripheral arterial disease and the normal population in the Edinburgh Artery Study. Circulation. 1993, 87 (6): 1915-

    Article  CAS  PubMed  Google Scholar 

  17. Fowkes FG, Pell JP, Donnan PT, Housley E, Lowe GD, Riemersma RA, Prescott RJ: Sex differences in susceptibility to etiologic factors for peripheral atherosclerosis. Importance of plasma fibrinogen and blood viscosity. Arteriosclero Thromb. 1994, 14 (6): 862-8.

    Article  CAS  Google Scholar 

  18. Fowkes FG, Housley E, Riemersma RA, Macintyre CC, Cawood EH, Prescott RJ, Ruckley CV: Smoking, lipids, glucose intolerance, and blood pressure as risk factors for peripheral atherosclerosis compared with ischemic heart disease in the Edinburgh Artery Study. American Journal of Epidemiology. 1992, 135 (4): 331-

    CAS  PubMed  Google Scholar 

  19. Fujimoto WY, Leonetti DL, Kinyoun JL, Shuman WP, Stolov WC, Wahl PW: Prevalence of complications among second-generation Japanese-American men with diabetes, impaired glucose tolerance, or normal glucose tolerance. Diabetes. 1987, 36: 730-

    Article  CAS  PubMed  Google Scholar 

  20. Schroll M, Munck O: Estimation of peripheral arteriosclerotic disease by ankle blood pressure measurements in a population study of 60 year old men and women. J Chronic Dis. 1981, 34: 261-10.1016/0021-9681(81)90031-X.

    Article  CAS  PubMed  Google Scholar 

  21. Gofin R, Kark JD, Friedlander Y, Lewis BS, Witt H, Stein Y, Gotsman MS: Peripheral vascular disease in a middle-aged population sample: The Jerusalem Lipid Research Clinic Prevalence Study. Isr J Med Sci. 1987, 23: 157-

    CAS  PubMed  Google Scholar 

  22. Allan PL, Mowbray PI, Lee AJ, Fowkes FG: Relationship between carotid intima-media thickness and symptomatic and asymptomatic peripheral arterial disease. The Edinburgh Artery Study. Stroke. 1997, 28 (2): 348-

    Article  CAS  PubMed  Google Scholar 

  23. Meijer WT, Hoes AW, Rutgers D, Bots ML, Hofman A, Grobbee DE: Peripheral arterial disease in the elderly: The Rotterdam Study. Arterioscler Thromb Vasc Biol. 1998, 18 (2): 185-92.

    Article  CAS  PubMed  Google Scholar 

  24. Bots ML, Hofman A, Grobbee DE: Common carotid intima-media thickness and lower extremity arterial atherosclerosis: The Rotterdam Study. Arteriosclerosis & Thrombosis. 1994, 14: 1885-

    Article  CAS  Google Scholar 

  25. Zheng ZJ, Sharrett AR, Chambless LE, Rosamond WD, Nieto FJ, Sheps DS, Dobs A, Evans GW, Heiss G: Associations of ankle-brachial index with clinical coronary heart disease, stroke and preclinical carotid and popliteal atherosclerosis: the Atherosclerosis Risk in Communities (ARIC) Study. Atherosclerosis. 1997, 131 (1): 115-10.1016/S0021-9150(97)06089-9.

    Article  CAS  PubMed  Google Scholar 

  26. Fowkes FG, Housley E, Cawood EH, Macintyre CC, Ruckley CV, Prescott RJ: Edinburgh Artery Study: prevalence of asymptomatic and symptomatic peripheral arterial disease in the general population. International Journal of Epidemiology. 1991, 20 (2): 384-

    Article  CAS  PubMed  Google Scholar 

  27. Ogren M, Hedblad B, Isacsson SO, Janzon L, Jungquist G, Lindell SE: Non-invasively detected carotid stenosis and ischaemic heart disease in men with leg arteriosclerosis. Lancet. 1993, 342: 1138-10.1016/0140-6736(93)92123-B.

    Article  CAS  PubMed  Google Scholar 

  28. Criqui MH, Denenberg JO, Langer RD, Fronek A: The epidemiology of peripheral arterial disease: importance of identifying the population at risk. Vascular Medicine. 1997, 2 (3): 221-

    Article  CAS  PubMed  Google Scholar 

  29. Leng GC, Fowkes FG, Lee AJ, Dunbar J, Housley E, Ruckley CV: Use of ankle brachial pressure index to predict cardiovascular events and death: a cohort study. BMJ. 1996, 313 (7070): 1440-

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Newman AB, Shemanski L, Manolio TA, Cushman M, Mittelmark M, Polak JF, Powe NR, Siscovick D: Ankle-arm index as a predictor of cardiovascular disease and mortality in the Cardiovascular Health Study. Arterioscler Thromb Vasc Biol. 1999, 19 (3): 538-45.

    Article  CAS  PubMed  Google Scholar 

  31. Tsai AW, Folsom AR, Rosamond WD, Jones DW: Ankle-brachial index and 7-year ischemic stroke incidence: the ARIC study. Stroke. 2001, 32 (8): 1721-

    Article  CAS  PubMed  Google Scholar 

  32. Vogt MT, Cauley JA, Newman AB, Kuller LH, Hulley SB: Decreased ankle/arm blood pressure index and mortality in elderly women. JAMA. 1993, 270: 465-10.1001/jama.270.4.465.

    Article  CAS  PubMed  Google Scholar 

  33. Nelson JJ: Lower extremity arterial disease as a predictor of CHD and mortality, and the association of serum albumin with lower extremity arterial disease and other indices of atherosclerosis. 1996, Dept. of Epidemiology, University of North Carolina School of Public Health

    Google Scholar 

  34. Fuller WA: Measurement error models. 1987, New York , John Wiley & Sons

    Chapter  Google Scholar 

  35. Carroll RJ, Ruppert D, Stefanski LA: Measurement error in nonlinear models. 1995, London , Chapman & Hall

    Chapter  Google Scholar 

  36. Whittemore AS: Errors-in-variables regression using Stein estimates. The American Statistician. 1989, 43 (4): 226-227.

    Google Scholar 

  37. The AI: The Atherosclerosis Risk in Communities (ARIC) Study: design and objectives. American Journal of Epidemiology. 1989, 129: 687-

    Google Scholar 

  38. Higgins M, Province M, Heiss G, Eckfeldt J, Ellison RC, Folsom AR, Rao DC, Sprafka JM, Williams R: NHLBI Family Heart Study: objectives and design. Am J Epidemiol. 1996, 143 (12): 1219-

    Article  CAS  PubMed  Google Scholar 

  39. Jackson R, Chambless L, Yang K, et al: Differences between respondents and non-respondents in a multi-center community-based study vary by gender and ethnicity. J Clin Epidemiol. 1996, 49: 1441-10.1016/0895-4356(95)00047-X.

    Article  CAS  PubMed  Google Scholar 

  40. National Heart LBI: NHLBI Family Heart Study: manuals of procedure. 1993, St. Louis, Mo. , Washington University, [http://www.biostat.wustl.edu/fhs/]

    Google Scholar 

  41. National Heart LBI: ARIC study manuals of operation. 1986, Chapel Hill, NC , ARIC Coordinating Center, School of Public Health, University of North Carolina, [http://www.cscc.unc.edu/aric/#]

    Google Scholar 

  42. Mundt KA, Chambless LE, Burnham CB, Heiss G: Measuring ankle systolic blood pressure: validation of the Dinamap 1846 SX. Angiology. 1992, 43 (7): 555-

    Article  CAS  PubMed  Google Scholar 

  43. Critikon I: DINAMAP Adult/Pediatric and Neonatal Vital Signs Monitor. Models 1846 SX and 1846 SX/P. Operation Manual. 1988, Tampa, FL , Critikon, Inc.

    Google Scholar 

  44. Orchard TJ, Strandness DE: Assessment of peripheral vascular disease in diabetes. Report and recommendations of an international workshop sponsored by the American Diabetes Association and the American Heart Association. September 18-20, 1992, New Orleans, Louisiana. Circulation. 1993, 88 (2): 819-

    Article  CAS  PubMed  Google Scholar 

  45. DiCiccio TJ, Efron B: Bootstrap confidence intervals. 1995, Palo Alto, Calif

    Google Scholar 

  46. Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-

    Article  CAS  PubMed  Google Scholar 

  47. Ramanathan A, Conaghan PJ, Jenkinson AD, Bishop CR: Comparison of ankle-brachial pressure index measurements using an automated oscillometric device with the standard Doppler ultrasound technique. ANZ J Surg. 2003, 73: 105-10.1046/j.1445-2197.2003.02582.x.

    Article  PubMed  Google Scholar 

  48. de Graaff JC, Ubbink DT, Legemate DA, de Haan RJ, Jacobs MJHM: Interobserver and intraobserver reproducibility of peripheral blood and oxygen pressure measurements in the assessment of lower extremity arterial disease. J Vasc Surg. 2001, 33: 1033-10.1067/mva.2001.108011.

    Article  CAS  PubMed  Google Scholar 

  49. Fowkes FG, Housley E, Macintyre CC, Prescott RJ, Ruckley CV: Variability of ankle and brachial systolic pressures in the measurement of atherosclerotic peripheral arterial disease. J Epidemiol Community Health. 1988, 42 (2): 128-33.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Chambless LE, Zhong MM, Arnett D, Folsom AR, Riley WA, Heiss G: Variability in B-mode ultrasound measurements in the Atherosclerosis Risk in Communities (ARIC) Study. Ultrasound Med Biol. 1996, 22: 545-10.1016/0301-5629(96)00039-7.

    Article  CAS  PubMed  Google Scholar 

  51. Arnett DK, Chambless LE, Kim H, Evans GW, Riley W: Variability in ultrasonic measurements of arterial stiffness in the Atherosclerosis Risk in Communities study. Ultrasound in Medicine & Biology. 1999, 25 (2): 175-180. 10.1016/S0301-5629(98)00165-3.

    Article  CAS  Google Scholar 

  52. Chambless LE, McMahon R, Brown SA, Patsch W, Heiss G, Shen YL: Short-term intraindividual variability in lipoprotein measurements: the Atherosclerosis Risk in Communities (ARIC) Study. Am J Epidemiol. 1992, 136: 1069-

    CAS  PubMed  Google Scholar 

  53. Chambless LE, McMahon R, Wu K, Folsom A, Finch A, Shen YL: Short-term intraindividual variability in hemostasis factors: the ARIC study. Ann Epidemiol. 1992, 2: 723-

    Article  CAS  PubMed  Google Scholar 

  54. Ramsey M: Blood pressure monitoring: automated oscillometric devices. J Clin Monit. 1991, 7: 56-10.1007/BF01617900.

    Article  PubMed  Google Scholar 

  55. Whincup PH, Bruce NG, Cook DG, Shaper AG: The Dinamap 1846SX automated blood pressure recorder: comparison with the Hawksley random zero sphygmomanometer under field conditions. J Epidemiol Community Health. 1992, 46: 164-169.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of Hypertension (JNC 7). JAMA. 2003, 289: 2560-2572. 10.1001/jama.289.19.2560.

  57. Resnick HE, Lindsay RS, McDermott MM, Devereux RB, Jones KL, Fabsitz RR, Howard BV: Relationship of high and low ankle brachial index to all-cause and cardiovascular disease mortality: the Strong Heart Study. Circulation. 2004, 109 (6): 733-739. 10.1161/01.CIR.0000112642.63927.54.

    Article  PubMed  Google Scholar 

  58. McDermott MM, Liu K, Criqui MH, Ruth K, Goff D, Saad MF, Wu C, Homma S, Sharrett AR: Ankle-brachial index and subclinical cardiac and carotid disease: the multi-ethnic study of atherosclerosis. Am J Epidemiol. 2005, 162 (1): 33-41. 10.1093/aje/kwi167.

    Article  PubMed  Google Scholar 

  59. Flegal CM, Keyl PM, Nieto FJ: Differential misclassification arising from nondifferential errors in exposure measurement. American Journal of Epidemiology. 1991, 134 (10): 1233-1244.

    CAS  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The ARIC study is supported by National Heart, Lung, and Blood Institute contracts N01-HC-55015, N01-HC-55016, N01-HC-55018, N01-HC-55019, N01-HC-55020, N01-HC-55021, and N01-HC-55022. A list of principal ARIC study staff was published in Am J Epidemiol (1989;129:687–688). The FHS is supported by National Heart, Lung, and Blood Institute contracts N01-HC-25104, N01-HC-25105, N01-HC-25106, N01-HC-25107, N01-HC-25108, and N01-HC-25109. A list of principal FHS staff was published in Am J Epidemiol (1996;143:1227). This study was supported in part by an institutional National Research Service Award, contract 5-T32-HL-07055 (Dr Weatherley).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gerardo Heiss.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

GH and BW conceived of and designed the study. BW and LC performed the statistical analyses. GH, LC, and BW interpreted the results. BW drafted the manuscript. All authors revised the manuscript for intellectual content, and read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Weatherley, B.D., Chambless, L.E., Heiss, G. et al. The reliability of the ankle-brachial index in the Atherosclerosis Risk in Communities (ARIC) study and the NHLBI Family Heart Study (FHS). BMC Cardiovasc Disord 6, 7 (2006). https://doi.org/10.1186/1471-2261-6-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2261-6-7

Keywords