Comparative assessment of absolute cardiovascular disease risk characterization from non-laboratory-based risk assessment in South African populations

The multiple risk factors for cardiovascular diseases (CVD) frequently occur simultaneously in individuals at risk. Because of this clustering, risk factors interact synergistically to increase the level of CVD risk to such an extent that the resulting absolute risk levels achieved are much higher than would be anticipated when considering the individual risk factors. These patients with the highest level of absolute CVD risk will benefit substantially if they are identified and all their risk factors diagnosed early and treated appropriately [1]. In fact, such an absolute CVD risk approach has been shown to be more cost-effective than treating patients’ individual risk factors to prevent CVD [2]. The calculation of the absolute CVD risk is usually based on age, gender, tobacco use status, blood pressure levels and blood cholesterol levels as was done with data from the Framingham study [3]. A number of similar formulations of absolute CVD risk have been proposed in a variety of settings where cohort studies were conducted to evaluate the usefulness of absolute CVD risk scores in predicting CVD events [4–7].

The absolute risk determination approach holds particular promise for resource scarce settings where the limited resources could best be utilized by identifying those at highest absolute CVD risk. However, blood lipid determinations for screening purposes will be far too costly in most developing country settings with limited resources and consequently are unlikely to be adopted as policy in these settings. This has prompted an investigation into the possibility of using other known CVD risk factors that are easier and less costly to measure in the place of CVD risk factors that require costly laboratory tests when calculating absolute CVD risk scores. This work compared the ability to predict first time fatal and non-fatal CVD events in the National Health and Nutrition Examination Survey (NHANES) I follow-up study cohort by two risk prediction models: the laboratory-based Framingham risk score and a non-laboratory-based model, which required only history and physical examination measures [8]. The non-laboratory-based model used the same risk factors but replaced total cholesterol with body-mass index and predicted CVD events equally accurately. This suggested that the less costly non-laboratory absolute CVD risk score can effectively be used in resource scare settings.

The exchangeability of the non-laboratory-based score with commonly-used laboratory-based approaches has been validated in a United States population [9]. In an attempt to evaluate the effectiveness of the non-laboratory absolute CVD risk score in a developing country setting, we compared the ranking of individuals using the non-laboratory-based score with six other absolute risk scores based on laboratory testing in thirteen data sets of cross-sectional CVD risk factor surveys conducted in South Africa between 1987 and 2009.

Correlation in risk characterization was based on comparisons of individual-level, score-specific rankings of absolute CVD risk for the non-laboratory-based score relative to the six laboratory-based scores. The first step in our analysis was to calculate individual-level risk predictions for each of the seven scores included in the study. Individuals were subsequently assigned ranks for each risk score by sex. These ranks were used to assess correlation in dichotomous risk characterization for the non-laboratory-based score compared to each laboratory-based risk score. Using a threshold of >20% 10-year Framingham (2008) CVD risk, individuals were characterized as ‘high’ or ‘low’ risk for each score based on their score-specific rank. We then found the risk level that was equivalent to the same proportion of events using each score. For example, if the CVD risk score using the Framingham risk score identified 15% of the population above 20% 10-year risk then we used the equivalent risk score of the non-laboratory risk score to identify 15% of the population. The CUORE risk score identified similar proportions of the population as did the Framingham CVD risk and the SCORE risk score threshold of >5% fatal events is equivalent to the Framingham CVD score. An alternative threshold of 10-year Framingham CHD risk >20% was also assessed. Percent agreement between the non-laboratory-based score and each of the laboratory-based scores was calculated by adding the proportions of individuals who were equivalently characterized as ‘high’ or ‘low’ risk by both scores. Spearman rank correlation coefficients were computed for the non-laboratory-based score compared to each of the laboratory-based scores to assess the correlations in the rankings across the full spectrum of risk thresholds. Pearson correlation coefficients were not reported because CVD risk prediction values were not normally distributed [21].

We also analyzed data from the 1998 South African Health and Demographic Survey (DHS), which has all the necessary information needed to complete the non-laboratory-based risk score [22]. This nationally representative sample allows us to partially assess whether our results from the cohorts might be generalizable for national primary CVD screening practice. The analyses involving comparison to the laboratory-based scores, however, could not be performed on the DHS data because it does not contain the blood cholesterol values needed to compute the laboratory-based risk assessments.

As a separate analysis of interest, we computed individual-level 10-year risk of CVD death based on the non-laboratory-based risk factors to assess the distribution of absolute CVD risk in the study cohorts and DHS populations. In this second analysis where we look at the 10-year risk of the DHS group we apply the CVD death only score because given the lack of a registry or widely available electronic hospital records for non-fatal MI or stroke in South Africa the only outcome that we will be able to validate in the near future is CVD death and, thus, use this score for projections. We also chose CVD death risk for these analyses to focus on the most severe events (that is, CVD death), as opposed to softer outcomes (such as angina events or revascularization procedures) that are harder to confirm currently in South Africa with limited registry data. These analyses served two functions: 1) to compare the distribution of risk in the representative DHS population to the study population; and 2) to characterize the predicted 10-year CVD mortality risk burden among South African adults.

Each of the studies in South Africa underwent independent study reviews under the local institutional review board (IRB)/ethics committees including the University of the Orange Free State Ethics Committee for Clinical Trials, the University of Free State Ethics Committee of the Faculty of Health Sciences, the Ethics Committee of the North-West University, the Ethics Committee at the University of Cape Town, the University of KwaZulu-Natal Biomedical Research Ethics Committee, and the Ethics Committee of the Medical Research Council of South Africa. Informed consent was obtained from all study participants under local IRB supervision. Only non-identifiable data sets were used and the Ethics Committee of the University of Cape Town approved of the study to evaluate CVD risk.

In this study, we found that a non-laboratory-based CVD risk score, when compared to six versions of laboratory-based Framingham, SCORE and CUORE equations, similarly ranked individuals and characterized CVD risk in all 13 cohorts studied. We observed strong agreement in risk characterization between the non-laboratory-based and laboratory-based scores in all the cohorts. This was true for the aggregate of the cohorts and in each of the cohorts, which had a wide range of overall risk suggesting the non-laboratory-based risk tool performs as well in low-risk groups as it does in high-risk populations. The greatest agreement was with the SCORE risk tool with more than 96% agreement in both men and women. More than 92% of men and 97% of women were equivalently characterized as ‘high’ or ‘low’ risk by non-laboratory-based and laboratory-based scores using a risk threshold based on a threshold commonly used in guidelines (10-year CHD risk >20 [24]. At a risk of 5% in both the high and low risk populations, the SCORE equation is equivalent to the fatal and non-fatal threshold of 20% for Framingham CVD risk.

Correlation at the CVD risk threshold of >20% was highest for the laboratory-based CVD outcome scores, with the older Framingham CHD only score slightly lower. In general, the correlation was greater for women than for men. In men, using the 1991 Framingham CHD score, the correlations for two cohorts, AHA-FS rural and the PURE urban, were slightly lower (0.797, 0.751, respectively). This is important as there has been a movement for risk prediction tools to include both stroke and ischemic heart disease given that many low- and middle-income countries, including South Africa, have a higher proportion of stroke in the total CVD events. Further, reductions in most risk factors for ischemic heart disease also reduce stroke and, thus, a risk prediction tool including both is more in line with clinical activities. However, this level of correlation is still considered ‘high correlation’ being greater than 0.7 if not ‘very high correlation’ for correlations greater than 0.9 [25].

The ability to assess risk without the requirement of expensive laboratory blood tests is important in many low-income settings for multiple reasons. The first includes its ability to correctly classify patients at the thresholds that most prevention guidelines choose for initiating treatment. Other considerations include practicality, cost and feasibility, in particular providing clinicians with the opportunity to make a treatment decision during a single clinic visit. This obviates the need for a laboratory test and a second patient visit to review the results and plan management with a resultant reduction of costs and the potential for non-attendance at the follow up visit. The cost of cholesterol testing and the follow-up clinic visit in South Africa is more than US $30. Testing for cholesterol for the adult population even at a frequency of every five years would cost $110 million annually. The annual cost of treating a patient on generic simvastatin can be less than $20 [26] (less than the cost of testing and follow-up visits) which on an annual basis for all those above 20% 10-year risk would equal nearly $60 million. Thus, money saved from excessive laboratory testing can easily offset the cost of treating those at high risk with an additional savings of nearly $50 million. In addition to these savings would be the added benefit of preventing more premature deaths and disabling myocardial infarctions and strokes. Furthermore, patients, their families or members of the public, with access to a blood pressure device, can calculate their own risk and present themselves to facilities for further evaluation. This opens up the potential for increased opportunistic screening. Furthermore, it could lead to improved risk stratification for those who may be treated so that limited medications go to those who need it most.

Using the non-laboratory-based screening tool, nearly 18% of the DHS and aggregate study populations would have a 10-year CVD death risk greater than 20%. What is striking is that using the 1998 Demographic Health Survey population, the risk for women is only slightly lower than for men, which is not the case for most developed populations where men have a considerably higher risk, at least in the middle-aged populations. However, in the DHS and in many of the cohorts included in the analysis, while smoking rates tend to be higher for men, the opposite is true for diabetes and obesity and hypertension in the elderly. The obesity rates are almost double and the diabetes rate is nearly 50% greater for women than for men [27]. These differences suggest that South African women, in particular, could be facing a greater burden compared to men, especially as smoking rates for men continue to decline.

One limitation of our analysis is that the risk discrimination and validation performance of the non-laboratory-based risk score has not been validated in a longitudinal South African cohort study. The lack of reliable death data for these cross-sectional cohorts makes it impossible at this time to validate any prediction score for CVD death. Having a cohort study with death data would also allow us to assess the level of correct classification and misclassification between the different risk scores. It is also possible that the non-laboratory-based risk score may over- or underestimate the true risk, but that is true for all the risk scores compared in the analysis. This is also true for most individual risk factors on which developing countries base their guidelines. Unfortunately, few low-income countries have cohort data to make these estimates. No risk score has been validated in South Africa nor, for that matter, in most populations in low- and middle-income countries, except China [28]. However, studies to validate the risk score are ongoing in South Africa but this data will not be available for nearly five years. However, the clinical need to risk stratify patients exists now. Our results suggest that using the non-laboratory-based scores will classify people similarly in the meantime as those which rely on laboratory-based information—neither of which have been validated in developing countries. Previous analysis in the US has shown that less than 7% disagreement occurs in risk classification [9]. Further, the WHO/International Society of Hypertension (ISH) risk charts have not been validated in individual country populations but are being promoted for screening. However, all the scores we evaluated will identify the same high risk people. So, if a country is using one of the laboratory-based risk tools, it could substitute a non-laboratory based tool for it and identity the same group for less cost. The WHO/ISH risk charts were not included in our analyses because the underlying risk functions are not publicly available [23].

In summary, we found that a non-laboratory-based CVD risk assessment tool ranked individuals nearly identically compared to risk scores that require additional expensive cholesterol tests. Using the non-laboratory-based risk assessment tool, we estimate that nearly 20% of the South African adult population is at high CVD risk. Health care providers that have limited resources and time in overcrowded primary health centers in South Africa can assess risk and make treatment decisions in a much more timely and inexpensive manner using results similar to those obtained using blood-based risk tools. Further, this risk factor information can be obtained non-invasively in about 5 to 10 minutes. This initial screening without blood testing could lead to the quick initiation of treatment without the added cost or inconvenience of laboratory testing. This would also minimize any potential loss to follow-up due to the extra step in testing.