Logo-hpp
2023: Two-year Impact Factor: 2.4
Scopus Journal Metrics
CiteScore (2023):7.1
 
Platinum
Open Access

Convergent validity of the ACC/AHA pooled cohort equations in associating with health-related quality of life among adults in the United States

Health Promotion Perspectives

eISSN: 2228-6497

Health Promotion Perspectives, 7(1), 42-46; DOI:10.15171/hpp.2017.08

Original Article

Convergent validity of the ACC/AHA pooled cohort equations in associating with health-related quality of life among adults in the United States

Allison Nooe1, Meghan K. Edwards1, Ovuokerie Addoh1, Paul D. Loprinzi2,*


1 Center for Health Behavior Research, Physical Activity Epidemiology Laboratory, Department of Health, Exercise Science and Recreation Management, The University of Mississippi, University, MS 38677, USA
2 Jackson Heart Study Vanguard Center of Oxford, Center for Health Behavior Research, Physical Activity Epidemiology Laboratory, Department of Health, Exercise Science and Recreation Management, The University of Mississippi, University, MS 38677, USA

*Corresponding Author: Paul D. Loprinzi, PhD, The University of Mississippi, University, MS 38677, USA. Phone: 662-915-5521; Fax: 662-915-5525; Email: pdloprin@olemiss.edu


© 2017 The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background: The potential convergent validity of the pooled cohort risk (PCR) equations in predicting health-related quality of life (HRQOL) has yet to be evaluated, which was this study’s purpose.

Methods: Data from the 2001-2011 National Health and Nutrition Examination Survey (NHANES) were used (N = 8978 adults, 40-79 years, free of cardiovascular disease at baseline). Calculation of an individual’s 10-year risk of a first atherosclerotic cardiovascular disease (ASCVD) event was determined via the PCR equation. The Centers for Disease Control and Prevention (CDC) HRQOL measure was assessed utilizing 4 questions regarding participants’ perceived mental and physical health status from the past 30 days.

Results: When adjusting for moderate-to-vigorous physical activity (MVPA), obesity, age, gender and race-ethnicity, an ASCVD score of >20% (vs. <20%) was associated with a 0.53-unit (95% CI: 0.34-0.71) higher HRQOL score. A higher HRQOL score indicates a poorer patient perception of their mental and physical health.

Conclusion: The observed association between PCR-determined ASCVD-risk scores and HRQOL provides evidence for the convergent validity of the PCR algorithms, indicating that individuals with a higher risk for a first time ASCVD-event may also have an overall worse HRQOL. As such, employing ASCVD risk reduction efforts may be an important strategy in improving an individual’s HRQOL.


Keywords: Epidemiology, NHANES, Pooled cohort equations, Quality of Life

Citation: Nooe A, Edwards MK, Addoh O, Loprinzi PD. Convergent validity of the ACC/AHA pooled cohort equations in associating with health-related quality of life among adults in the United States. Health Promot Perspect. 2017;7(1):42-46. doi: 10.15171/hpp.2017.08.

Introduction

The pooled cohort risk (PCR) equations were developed by the American College of Cardiology/American Heart Association (ACC/AHA) task force in 2013 to predict 10-year risk for a first atherosclerotic cardiovascular disease (ASCVD) event.1 Since their development, numerous studies have employed the PCR equations, contributing evidence of independent associations between various health factors (e.g. smoking status and diabetes status) and cardiovascular disease (CVD) risk scores. Recent work by Loprinzi and Addoh provided some support for the predictive validity of the PCR equations in a longitudinal study, observing significant associations between (PCR-determined) 10-year risk of an initial ASCVD score and both CVD-specific and all-cause mortality.2 Other work also demonstrates evidence of these equations in predicting cancer-specific mortality.3

Objective measures, such as blood pressure and cholesterol, are often evaluated to measure the health status of patients, including those with CVD.2 Given that health encompasses not only prolonging survival, but also promoting a high quality of life throughout the entire lifespan, it is imperative to also evaluate subjective measures that may influences one’s quality of life, such as their mental health and overall physical well-being.4 Encouragingly, several studies have examined the association between CVD status and health-related quality of life (HRQOL). For instance, in 2014, Tan et al evaluated HRQOL (a subjective measurement to assess one’s quality of life) among type 2 diabetes mellitus (T2DM) patients with and without CVD, finding that those with CVD had significantly lower HRQOL than those free of CVD.4 Additionally, cardiorespiratory fitness (CRF), which is inversely associated with CVD risk,5 is also positively associated with HQROL parameters (e.g. perceived physical and mental health).6

Based on the premise of the previously mentioned associations between CVD and HQROL, the present study aimed to examine the association between PCR-determined ASCVD risk and HRQOL among a national sample of US adults. This topic (predicted CVD and HRQOL) using the PCR equations, to our knowledge, has yet to be investigated. Given that PCR equations are used to estimate 10-year risk for a first ASCVD event, and CVD is associated with HQROL, using these equations may provide clinicians with a quick and cost-effective method to not only provide diagnostic information on CVD risk, but also information related to overall HRQOL.

Materials and Methods

Study design & participants

As noted below, the PCR equations were derived among CVD-free adults ≥40 years and ≤79 years; thus, our analyses were restricted to these age ranges (i.e., 40-79 years). In the evaluated 2001-2010 National Health and Nutrition Examination Survey (NHANES) cycles, 8978 adults 40-79 years who were free of CVD constituted the analytic sample.

The NHANES is an ongoing survey conducted by the Centers for Disease Control and Prevention (CDC) that uses a representative sample of non-institutionalized US civilians selected by a complex, multistage, stratified, clustered probability design. The multistage design consists of 4 stages, including the identification of counties, segments (city blocks), random selection of households within the segments, and random selection of individuals within the households. Procedures were approved by the National Center for Health Statistics review board. Consent was obtained from all participants prior to data collection. Further information on NHANES methodology and data collection is available on the NHANES website (http://www.cdc.gov/nchs/nhanes.htm).

PCR equations to identify 10-year ASCVD risk

Details on the derivation of the PCR equations to predict 10-year risk for a first ASCVD event are described thoroughly in the publication by the American College of Cardiology/American Heart Association (ACC/AHA) Task Force on Practice Guidelines.7 As described elsewhere,8-12 separate equations were developed for African-American and White/other men and women (four groups), which included the following variables in the equations: age (years), concentration of total cholesterol (mg/dL) and high-density lipoprotein cholesterol (HDL-C) (mg/dL), treated or untreated systolic blood pressure (mm Hg), diabetes status (defined here as physician diagnosis or A1C ≥6.5%), and self-reported smoking status (yes/no). Herein, we evaluated participants as moderate-to-high risk and high risk for a first ASCVD event based on a PCR score of ≥7.5% and ≥20% respectively.13

Measurement of HRQOL

As described elsewhere,14-19 the CDC HRQOL measure was assessed from 4 questions, including 1 question about self-rated health status and 3 about the number of unhealthy days during the past 30 days:

“Would you say that in general your health is excellent, very good, good, fair, or poor?”

“Now thinking about your physical health, which includes physical illness and injury, how many days during the past 30 days was your physical health not good?”

“Now thinking about your mental health, which includes stress, depression, and problems with emotions, how many days during the past 30 days was your mental health not good?”

“During the past 30 days, approximately how many days did poor physical or mental health keep you from doing usual activities, such as self-care, work, or recreation?”

The 4 CDC HRQOL items were categorized according to CDC’s recommendations, which included question 1 dichotomized as good/excellent health (coded as 0) or poor/fair health (coded as 1). The latter 3 items were dichotomized as 14 or more days (coded as 1) and less than 14 days (coded as 0).

Thus, the recoded 4 HRQOL items ranged from 0-1. An overall HRQOL score was created by summing the responses from each of the 4 individual items (range: 0-4), with higher HRQOL scores indicating worse HRQOL. The HRQOL-4 developed by CDC has undergone extensive reliability and validity testing and has demonstrated adequate psychometric properties.20-24

Statistical Analyses

All analyses were computed in Stata (v. 12; College Station, TX). Analyses accounted for the complex survey design employed in NHANES by utilizing sample weights, primary sampling units and strata via the Taylor series (linearization) method. A weighted ordinal regression model was used to examine the association between the PCR score on HRQOL.

Consistent with other studies,2,3 three models were computed, including: Model 1 being an unadjusted model; Model 2 adjusted for self-reported engagement in moderate-to-vigorous physical activity (MVPA) in the past 30 days (yes/no) and obesity (measured body mass index ≥ 30 kg/m2); and Model 3 adjusted for MVPA, obesity, age (years; continuous measure), gender (male/female) and race-ethnicity (Mexican American, non-Hispanic white, non-Hispanic black and other). These nested models were evaluated because the demographic parameters (age, gender and race-ethnicity) included in Model 3 were used in the PCR equations. Each of these three models were evaluated with the ASCVD score expressed as either a continuous variable, dichotomized as ≥7.5% vs. <7.5%, or dichotomized as ≥20% vs. <20%. Statistical significance was established as P < 0.05.

Results

Among the 8978 CVD-free adults 40 t o 79 years, the mean (SE) age was 53.1 (0.17) years, the mean body mass index was 28.5 (0.09) kg/m2 and the mean PCR score was 7.17% (0.13%). In the sample, 29.9% of these CVD-free adults (95% CI, 28.6%-31.1%) had a PCR score of 7.5% or higher and 8.5% (95% CI, 7.9%-9.0%) had a PCR score of 20% or higher. In the sample, 52.3% were female and 76.2% were non-Hispanic White. These demographic characteristics are shown in Table 1. All of the provided estimates are weighted estimates which account for the complex study designed used in the NHANES. Therefore the weighted estimates are nationally representative, population-based estimates.2

Table 1. Demographic characteristics of the analyzed sample (N = 8978)
Characteristics Point estimate
Age, mean (SE) years 53.1 (0.17)
Gender (%)
Male 47.7
Female 52.3
Race/Ethnicity (%)
Non-Hispanic White 76.2
Non-Hispanic Black 9.5
Other 14.3
BMI, mean (SE) kg/m2 28.3 (0.09)
PCR equation score, mean (SE) % 7.17 (0.13)
Adults above PCR cut-points (%)
>7.5% 29.9
>20% 8.5
Abbreviations: PCR, pooled cohort risk; BMI, Body mass index.

Table 2 displays the weighted associations between the 10-year ASCVD risk and HRQOL. Statistically significant, positive associations (unfavorable association) between PCR-predicted ASCVD-risk and HRQOL score among all three models (unadjusted, adjusted for MVPA & obesity, and adjusted for MVPA, obesity, age, gender, and race/ethnicity) were observed. Notably, these associations were significant when PCR risk scores were analyzed as a continuous distribution and when PCR risk score was classified as a binary variable at both the 7.5% and 20% cut-points. For every 1% increase in ASCVD, there was a corresponding 0.02-unit (β = 0.018, 95% CI: 0.013-0.024, P < 0.05) increase in the HRQOL score as shown in Model 1, 0.01-unit (β = 0.013, 95% CI: 0.008-0.018, P < 0.05) increase shown in Model 2, and .03-unit (β = 0.030, 95% CI: 0.023-0.038, P < 0.05) increase as shown in Model 3. In cognizance of the aforementioned scoring of the HRQOL scale, a higher score is indicative of a worse HQROL. When evaluated as a binary variable, an ASCVD score of >7.5% (vs. <7.5%) was associated with a .37-unit (β = 0.37, 95% CI: 0.23-0.50, P < 0.05) higher HRQOL score in Model 1, a .25-unit (β = 0.25, 95% CI: 0.11-0.38, P < 0.05) higher score in Model 2, and a .53-unit (β = 0.53, 95% CI: 0.34-0.71, P < 0.05) higher score in Model 3. Those with an ASCVD score of >20% or higher (vs. <20%) had a .48-unit (β = 0.48, 95% CI: 0.32-0.64, P < 0.05) higher HRQOL score in Model 1, 0.36-unit (β = 0.36, 95% CI: 0.21-0.52, P < 0.05) higher HRQOL score in Model 2, and 0.51-unit (β = 0.51, 95% CI: 0.32-0.70, P < 0.05) higher HRQOL score in Model 3.

Table 2. Weighted association between 10-year ASCVD risk and health-related quality of life using the pooled cohort equations, 2001-2010 National Health and Nutrition Examination Survey (N = 8978).
β (95% CI)
Model 1 (unadjusted) Model 2 (MVPA and obesity adjusted) Model 3 (MVPA, obesity, age, gender and race-ethnicity adjusted)
ASCVD risk score, 1% increase 0.018 (0.013-0.024) 0.013 (0.008-0.018) 0.030 (0.023-0.038)
ASCVD risk score, ≥7.5% vs. <7.5% 0.37 (0.23-0.50) 0.25 (0.11-0.38) 0.53 (0.34-0.71)
ASCVD risk score, ≥20% vs. <20% 0.48 (0.32-0.64) 0.36 (0.21-0.52) 0.51 (0.32-0.70)
Abbreviations: ASCVD, atherosclerotic cardiovascular disease; MVPA, moderate-to-vigorous physical activity.
Bold indicates statistical significance (P < 0.05).

Discussion

The purpose of this study was to evaluate the convergent validity of the PCR equations in associating with HRQOL. The primary finding among this nationally representative sample of US adults was an observed association between PCR-determined ASCVD risk and HQROL. For example, when looking specifically at Model 3, an ASCVD score of >20% (vs. <20%) was associated with a .53-unit higher HRQOL score (indicating poorer patient-perceived mental and physical health).

This association between PCR score among adults free of CVD and HQROL suggests that, even in the absence of CVD, individuals with higher CVD-risk seem to have a relatively lower HRQOL. These findings are in alignment with previous work showing associations between PCR-determined ASCVD-risk and various health outcomes, as well as evidence suggesting CVD status is associated with HRQOL. The variables examined in the PCR equations (age, smoking and diabetes status, total concentrated cholesterol levels, and blood pressure) have all been shown to associate with HRQOL. For example, a study by Wang et al found that out of over 900 participants, those with hypertension had poorer HRQOL scores than those without, also noting that the dimensions most affected were those regarding roles of physical limitations.25 Other research has also corroborated this worse HRQOL among those with hypertension.26 Hypertension, in particular, may induce worse HRQOL via its potential effects on both physical27 and mental health.28 A review study by Rubin and Peyrot concluded that most studies demonstrated that HRQOL was lower among those with diabetes when compared to the general population.29 This is an expected finding given that diabetes is also associated with parameters (e.g., muscle strength) associated with physical function.30 Diabetes may also influence mental health via its putative effect on inflammation.31 Thus, our observed association of the collective contributions of the parameters assessed in the PCR equations with HRQOL aligns with previous research that has evaluated the effects of these individual health parameters on HRQOL.

In conclusion, our findings demonstrate that those with a higher predicted score of a first ASCVD event within the next 10 years had worse HRQOL. A study by Loprinzi and Addoh2 demonstrated a positive association between PCR-determined 10-year risk of a first ASCVD event and all cause/CVD-specific mortality, as well as cancer-specific mortality.3 Thus, early identification of CVD risk, which may be achieved using these equations, may elicit earlier intervention approaches and thus a greater opportunity to enhance HRQOL among US adults. A limitation of this study is the cross-sectional study design. Notable strengths include the nationally representative sample and the novelty of the subject matter. Future studies may further examine the directionality of our observed association between ASCVD risk and HRQOL using a longitudinal study design.

Ethical approval

This study was approved by the ethics committee of the National Center for Health Statistics.

Competing interests

We declare no conflicts of interest.

Authors’ contributions

All authors were involved in the conceptualization of the study, revising the manuscript and interpreting the results. Author AN drafted the first draft of the manuscript and author PDL computed the analyses.

References

  1. Goff DC Jr, Lloyd-Jones DM, Bennett G, Coady S, D’Agostino RB, Gibbons R, et al. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol 2014;63(25 Pt B):2935-59. doi: 10.1016/j.jacc.2013.11.005. [Crossref]
  2. Loprinzi PD, Addoh O. Predictive Validity of the American College of Cardiology/American Heart Association Pooled Cohort Equations in Predicting All-Cause and Cardiovascular Disease- Specific Mortality in a National Prospective Cohort Study of Adults in the United States. Mayo Clin Proc 2016;91(6):763-9. doi: 10.1016/j.mayocp.2016.03.019. [Crossref]
  3. Loprinzi PD. Predictive validity of the ACC/AHA Pooled Cohort Equations in predicting cancer-specific mortality in a national prospective cohort study of adults in the United States. Int J Clin Pract 2016;70(8):691-5. doi: 10.1111/ijcp.12840. [Crossref]
  4. Tan MC, Ng OC, Wong TW, Hejar AR, Anthony J, Sintonen H. The association of cardiovascular disease with impaired health-related quality of life among patients with type 2 diabetes mellitus. Singapore Med J 2014;55(4):209-16.
  5. Gupta S, Rohatgi A, Ayers CR, Willis BL, Haskell WL, Khera A, et al. Cardiorespiratory fitness and classification of risk of cardiovascular disease mortality. Circulation 2011;123(13):1377-1383. doi: 10.1161/CIRCULATIONAHA.110.003236. [Crossref]
  6. Clennin MN, Payne JP, Rienzi EG, Lavie CJ, Blair SN, Pate RR, et al. Association between cardiorespiratory fitness and health-related quality of life among patients at risk for cardiovascular disease in Uruguay. PLoS One 2015;10(4):e0123989. doi: 10.1371/journal.pone.0123989. [Crossref]
  7. Goff DJ, Lloyd-Jones DM, Bennett G. ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014;129(25 Suppl 2):S49-73. doi: 10.1161/01.cir.0000437741.48606.98. [Crossref]
  8. Loprinzi PD. Sedentary behavior and predicted 10-yr risk for a first atherosclerotic cardiovascular disease (ASCVD) event using the pooled cohort risk equations among US adults. Int J Cardiol 2015;203:443-4. doi: 10.1016/j.ijcard.2015.10.213. [Crossref]
  9. Loprinzi PD. Objectively-measured physical activity and predicted 10-yr risk for a first atherosclerotic cardiovascular disease (ASCVD) event using the pooled cohort risk equations among US adults. Int J Cardiol 2015;199:31-2. doi: 10.1016/j.ijcard.2015.06.161. [Crossref]
  10. Loprinzi PD. Application of the “Fat-but-Fit” paradigm in predicting 10-yr risk for an atherosclerotic cardiovascular disease (ASCVD) event using the pooled cohort risk equations among US adults. Int J Cardiol 2016;202:297-9. doi: 10.1016/j.ijcard.2015.09.057. [Crossref]
  11. Loprinzi PD, Davis RE. Daily movement patterns and predicted 10-yr risk for a first atherosclerotic cardiovascular disease (ASCVD) event using the pooled cohort risk equations among US adults. Prev Med 2015;81:78-81. doi: 10.1016/j.ypmed.2015.08.008. [Crossref]
  12. Loprinzi PD, Nooe A. Health characteristics and predicted 10-year risk for a first atherosclerotic cardiovascular disease (ASCVD) event using the Pooled Cohort Risk Equations among US adults who are free of cardiovascular disease. Physiol Behav 2015;151:591-5. doi: 10.1016/j.physbeh.2015.08.031. [Crossref]
  13. Lloyd-Jones DM. Cardiovascular risk prediction: basic concepts, current status, and future directions. Circulation 2010;121(15):1768-77. doi: 10.1161/CIRCULATIONAHA.109.849166. [Crossref]
  14. Dankel SJ, Loenneke JP, Loprinzi PD. Physical activity and diet on quality of life and mortality: the importance of meeting one specific or both behaviors. Int J Cardiol 2016;202:328-30. doi: 10.1016/j.ijcard.2015.09.019. [Crossref]
  15. Dankel SJ, Loenneke JP, Loprinzi PD. The WATCH (Weight Activity and Time Contributes to Health) paradigm and quality of life: the impact of overweight/obesity duration on the association between physical activity and health-related quality of life. Int J Clin Pract 2016;70(5):409-15. doi: 10.1111/ijcp.12797. [Crossref]
  16. Edwards MK, Loprinzi PD. Sedentary behavior & health-related quality of life among congestive heart failure patients. Int J Cardiol 2016;220:520-3. doi: 10.1016/j.ijcard.2016.06.256. [Crossref]
  17. Loprinzi PD. Joint associations of objectively-measured sedentary behavior and physical activity with health-related quality of life. Prev Med Rep 2015;2:959-61. doi: 10.1016/j.pmedr.2015.11.004. [Crossref]
  18. Loprinzi PD. Implications of light-intensity physical activity in improving health-related quality of life among congestive heart failure patients. Int J Cardiol 2016;212:16-7. doi: 10.1016/j.ijcard.2016.03.015. [Crossref]
  19. Loprinzi PD, Davis RE. Bouted and non-bouted moderate-to-vigorous physical activity with health-related quality of life. Prev Med Rep 2016;3:46-8. doi: 10.1016/j.pmedr.2015.12.005. [Crossref]
  20. Jiang Y, Hesser JE. Using item response theory to analyze the relationship between health-related quality of life and health risk factors. Prev Chronic Dis 2009;6(1):A30.
  21. Horner-Johnson W, Krahn G, Andresen E, Hall T, Rehabilitation Research and Training Center Expert Panel on Health Status Measurement. Developing summary scores of health-related quality of life for a population-based survey. Public Health Rep 2009;124(1):103-110.
  22. Hays RD, Bjorner JB, Revicki DA, Spritzer KL, Cella D. Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res 2009;18(7):873-880. doi: 10.1007/s11136-009-9496-9. [Crossref]
  23. Mielenz T, Jackson E, Currey S, DeVellis R, Callahan LF. Psychometric properties of the Centers for Disease Control and Prevention Health-Related Quality of Life (CDC HRQOL) items in adults with arthritis. Health Qual Life Outcomes 2006;4:66. doi: 10.1186/1477-7525-4-66. [Crossref]
  24. Linden W, Yi D, Barroetavena MC, MacKenzie R, Doll R. Development and validation of a psychosocial screening instrument for cancer. Health Qual Life Outcomes 2005;3:54. doi: 10.1186/1477-7525-3-54. [Crossref]
  25. Wang R, Zhao Y, He X, Ma X, Yan X, Sun Y, et al. Impact of hypertension on health-related quality of life in a population-based study in Shanghai, China. Public Health 2009;123(8):534-9. doi: 10.1016/j.puhe.2009.06.009. [Crossref]
  26. Carvalho MV, Siqueira LB, Sousa AL, Jardim PC. The influence of hypertension on quality of life. Arq Bras Cardiol 2013;100(2):164-74.
  27. Dogan MH, Karadag B, Ozyigit T, Kayaoglu S, Ozturk AO, Altuntas Y. Correlations between sarcopenia and hypertensive target organ damage in a Turkish cohort. Acta Clin Belg 2012;67(5):328-32. doi: 10.2143/ACB.67.5.2062685. [Crossref]
  28. Kretchy IA, Owusu-Daaku FT, Danquah SA. Mental health in hypertension: assessing symptoms of anxiety, depression and stress on anti-hypertensive medication adherence. Int J Ment Health Syst 2014;8:25. doi: 10.1186/1752-4458-8-25. [Crossref]
  29. Rubin RR, Peyrot M. Quality of life and diabetes. Diabetes Metab Res Rev 1999;15(3):205-18.
  30. Loprinzi PD, Loenneke JP. Evidence of a link between grip strength and type 2 diabetes prevalence and severity among a national sample of U.S. Adults. J Phys Act Health 2016;13(5):558-61. doi: 10.1123/jpah.2015-0241. [Crossref]
  31. Stuart MJ, Baune BT. Depression and type 2 diabetes: inflammatory mechanisms of a psychoneuroendocrine co-morbidity. Neurosci Biobehav Rev 2012;36(1):658-76. doi: 10.1016/j.neubiorev.2011.10.001. [Crossref]
Submitted: 24 Jun 2016
Revised: 10 Jul 2016
Accepted: 01 Oct 2016
First published online: 18 Dec 2016
EndNote EndNote

(Enw Format - Win & Mac)

BibTeX BibTeX

(Bib Format - Win & Mac)

Bookends Bookends

(Ris Format - Mac only)

EasyBib EasyBib

(Ris Format - Win & Mac)

Medlars Medlars

(Txt Format - Win & Mac)

Mendeley Web Mendeley Web
Mendeley Mendeley

(Ris Format - Win & Mac)

Papers Papers

(Ris Format - Win & Mac)

ProCite ProCite

(Ris Format - Win & Mac)

Reference Manager Reference Manager

(Ris Format - Win only)

Refworks Refworks

(Refworks Format - Win & Mac)

Zotero Zotero

(Ris Format - FireFox Plugin)

Abstract View: 2121
PDF Download: 967
Full Text View: 1287