Associations between attainment of incentivised primary care indicators and incident diabetic retinopathy in England: a population-based historical cohort study

Abstract

Background

The associations between England’s incentivised primary care-based diabetes prevention activities and hard clinical endpoints remain unclear. We aimed to examine the associations between attainment of primary care indicators and incident diabetic retinopathy (DR) among people with type 2 diabetes.

Methods

A historical cohort (n = 60,094) of people aged ≥ 18 years with type 2 diabetes and no DR at baseline was obtained from the UK Clinical Practice Research Datalink (CPRD). Exposures included attainment of the Quality and Outcomes Framework (QOF) HbA1c (≤ 7.5% or 59 mmol/mol), blood pressure (≤ 140/80 mmHg), and cholesterol (≤ 5 mmol/L) indicators, and number of National Diabetes Audit (NDA) care processes completed (categorised as 0–3, 4–6, or 7–9), in 2010–2011. Outcomes were time to development of DR and sight-threatening diabetic retinopathy (STDR). Nearest neighbour propensity score matching was undertaken and Cox proportional hazards models then fitted using the matched samples. Concordance statistics were calculated for each model.

Results

8263 DR and 832 STDR diagnoses were observed over mean follow-up periods of 3.5 (SD 2.1) and 3.8 (SD 2.0) years, respectively. HbA1c and blood pressure (BP) indicator attainment were associated with lower rates of DR (adjusted hazard ratios (aHRs) 0.94 (95% CI 0.89–0.99) and 0.87 (0.83–0.92), respectively), whereas cholesterol indicator attainment was not (aHR 1.03 (0.97–1.10)). All QOF indicators were associated with lower rates of STDR (aHRs 0.74 (0.62–0.87) for HbA1c, 0.78 (0.67–0.91) for BP, and 0.82 (0.67–0.99) for cholesterol). Completion of 7–9 vs. 0–3 NDA processes was associated with fewer STDR diagnoses (aHR 0.72 (0.55–0.94)).

Conclusions

Attainment of key primary care indicators is associated with lower incidence of DR and STDR among patients with type 2 diabetes in England.

Background

Nearly three million people in England have a type 2 diabetes diagnosis [1,2,3]. Diabetic retinopathy (DR) is a common complication, affecting nearly a third of patients with type 2 diabetes [4, 5], with considerable impact on quality of life [6]. The severity of DR progresses from mild, moderate, and severe non-proliferative DR (NPDR) to proliferative DR (PDR). Diabetic macular oedema (DME) occurs in about 10% of individuals and can occur in any stage of DR. Sight-threatening DR (STDR) includes severe NPDR, PDR, and DME and is associated with risk of visual loss if not identified early and treated promptly [7, 8]. As DR at all stages is usually asymptomatic prior to visual loss, detection and management of asymptomatic disease is required to halt or slow disease progression and prevent visual loss. Systematic DR screening was introduced in England in 2003 and has been offered to all of the English population since 2008 [9]. The annual uptake was relatively high at 82.8% in 2015–2016 [9].

Further to screening, prevention of DR is in many ways preferable and achievable. Hyperglycaemia and hypertension are understood to be the strongest modifiable risk factors for DR, and controlling these two factors can markedly influence its development and progression. In the UK Prospective Diabetes Study (UKPDS), a 1% lower HbA1c was found to be associated with a 31% lower risk of DR, and a 10 mmHg lower systolic blood pressure (BP) was associated with a 11% lower risk of STDR [10, 11]. Similarly, a recent meta-analysis of four trials showed that a 0.9% lower HbA1c was associated with a 13% lower risk of development and progression of DR [12].

In view of the considerable potential for community-based risk factor control to limit the incidence of diabetes complications—both DR and other complications with important implications for quality of life and life expectancy [13]—England has invested heavily in related quality improvement initiatives over the past two decades. In particular, the Quality and Outcomes Framework (QOF) and National Diabetes Audit (NDA) were introduced in the early 2000s, to incentivise and monitor preventive primary care-based diabetes activities at national level [14, 15]. The vast majority of English general practices participate in QOF, which provides financial awards for achieving specific indicators across a variety of clinical care and public health areas, including diabetes care. NDA uptake was initially limited, but it became a compulsory component of primary care contracts in 2017, and monitors diabetes care provision against the National Institute of Health and Care Excellence (NICE) Clinical Guidelines and associated Quality Standards. The QOF indicators are based on the same guidelines and underlying evidence, and there is therefore some overlap between the two programmes, but it is also the case that the indicators cannot fully reflect the individualised care the guidelines promote [16]. Application of intermediate clinical outcome indicators has required somewhat arbitrary thresholds to be chosen, and despite their prominence in incentivised and mandated national programmes, their association with hard clinical endpoints remain unclear. We therefore aimed here to examine the association between these key clinical outcome indicators and DR, as well as associations between DR and recommended annual diabetes care processes. Specifically, we addressed the questions of whether meeting the QOF HbA1c, BP, and cholesterol thresholds, or completing the NDA care processes, is associated with time to development of DR or STDR, among people with type 2 diabetes.

Methods

Study design and data sources

This historical cohort was defined from data extracted from the UK Clinical Practice Research Datalink (CPRD) GOLD database. CPRD GOLD contains longitudinal patient data that have been collected during routine general practice activity since 1987. Presently including more than 18 million patients (3 million of which are currently actively inputting data), the database is representative of the UK primary care registered population. Linked Hospital Episode Statistics (HES) and Office for National Statistics (ONS) mortality data are accessible for CPRD participants in England, and the database has previously been used to assess diabetes care processes and outcomes [17, 18].

Participants entered the cohort on 1 April 2010 so long as they had an existing type 2 diabetes diagnosis, had not opted out of HES/ONS data linkage, were ≥ 18 years old, had been registered with their practice for one or more years, and were not censored prior to 1 April 2011 (for the reasons described below). Those with a DR diagnosis prior to 1 April 2011 were excluded. Those with a type 1 diabetes or other specified non-type 2 diabetes diagnosis at any point were also excluded. Individuals prescribed insulin within three months of a diabetes diagnosis at age ≥ 35 years or within 6 months of a diagnosis made at < 35 years were also excluded. Cohort exit happened at the earliest of the following: death, transfer out of database, last CPRD data upload, or 31 December 2017 (end of study). The code lists used in cohort derivation are provided in Additional File: Table S1.

Exposures

Attainment of the QOF HbA1c (≤ 7.5% or 59 mmol/mol), BP (≤ 140/80 mmHg), and total cholesterol (≤ 5 mmol/L) indicators within the 2010–2011 financial year was defined according to the QOF Business Rules v38.0 [19]. Thus, the most recent measurements in 2010–2011 were used as the basis for indicator status, and the indicator was considered not to be met where no measurement was available. A further exposure variable describing implementation of NDA annual care processes throughout the 2010–2011 year was created by categorising the number of processes completed as 0–3, 4–6, or 7–9. The NDA care processes include the following: HbA1c, blood pressure, cholesterol, serum creatinine, urine albumin/creatinine ratio, BMI measurements, examination for foot ulcer risk, record of smoking status, and completion of digital retinal screening.

Outcomes

The primary outcome was time (from 1 April 2011)-to-first CPRD or HES record of incident DR at UK National Screening Committee (NSC) stage R1, R2, R3, M1, or P1 [9]. Time-to-first CPRD or HES record of incident STDR (NSC stage R2, R3, M1, or P1) was considered as a secondary outcome.

Covariates

Covariates (measured at 1 April 2011) included disease-related variables (time from diagnosis, number of diabetes complications, number of prescribed glucose-lowering therapies (GLTs), and presence/absence of insulin prescription, the latter two measures taken within 6 months prior to baseline), socio-demographic variables (age, sex, ethnicity, 2010 patient-level index of multiple deprivation (IMD)), and the person’s primary care practice geographical region. Comorbidities (number of QOF registers the person was on in 2010–2011, number of hospital admissions in that year, and number of prescriptions during the 6 months prior to cohort entry) and lifestyle variables (body mass index, smoking status, and alcohol use) were also included. A complete list of all covariates can be found in each of Additional File: Tables S2-S17.

Statistical analysis

Baseline cohort characteristics and missing data were summarised. Practice-level IMD data was used to impute missing patient-level IMD values. Missing lifestyle and ethnicity variables were imputed using the mice package in RStudio 3.5.1 from the remaining covariates, with five imputations used [20]. Nearest neighbour propensity score matching was conducted by utilising the matchit package with a 0.2 calliper for each exposure [21]. Univariate and multivariate Cox proportional hazards models were fitted with the matched samples for each exposure with the corresponding exposure as another covariate, and concordance statistics were computed for each multivariate model. Sensitivity analyses were conducted for both outcomes to explore the effect of individual QOF indicator attainment among those who had met the other two QOF indicators examined in the study.

Results

Cohort characteristics

60,094 adults (44.8% female) registered across 330 practices and diagnosed with type 2 diabetes prior to 1 April 2010 were found as eligible for inclusion. Table 1 presents their baseline characteristics. Mean (standard deviation, SD) age and time since diagnosis was 67.5 (12.7) and 7.1 (5.3) years, respectively. 83.2% were of white ethnic background. Most were current or ex-smokers (52.1%), regularly consumed alcohol at least one unit/week (70.8%), and/or were overweight or obese (83.6%). Individuals had, at baseline, a mean of 2.3 (1.6) comorbidities and 1.4 (1.2) diabetes complications and 7.4 (8.6) different prescriptions including 1.2 (1.0) different GLTs in the 6 months prior to study entry. Insulin was prescribed to 6210 participants (10.3%) throughout that period.

Table 1 Baseline characteristics of individuals diagnosed with type 2 diabetes for the population defined within the study period (N = 60,094)

Throughout mean follow-up periods of 3.5 (2.1) and 3.8 (2.0) years, 8263 (13.8%) DR and 832 (1.4%) STDR diagnoses were observed, respectively, corresponding to diagnosis rates of 39.2 and 3.6 per 1000 person-years. The observed distribution of QOF indicator attainment and NDA process completion by the number of indicators/processes met is provided in Table 2. The HbA1c, BP, and cholesterol QOF indicators were met by 40,183 (66.9%), 34,827 (58.0%), and 44,570 (74.2%), respectively. 20,110 (33.5%) participants met all three indicators. NDA process completion ranged between 38,619 (64.3%; retinal screening) and 57,494 (95.7%; BP measurement). The majority (50,284, 83.7%) completed 7–9 NDA processes, though less than half (24,802, 41.3%) completed all nine. Those determined as not attaining the indicator due to lack of available measurement consisted of 3687 (6.1%), 2600 (4.3%), and 5701 (9.5%) individuals for HbA1c, BP, and cholesterol, respectively.

Table 2 Number (%) of individuals who met each of the QOF indicators and NDA processes (columns) clustered by the number of QOF indicators or NDA processes met (rows)

Associations between QOF indicator exposures and DR and STDR

Unadjusted and adjusted associations between exposure to attainment of each of the QOF indicators and incident DR and STDR are shown in Table 3 and adjusted outcomes additionally summarised in Fig. 1. HbA1c and BP indicator attainment were associated with lower rates of DR in both unadjusted and adjusted analyses (adjusted hazard ratios (HRs; 95% CI) 0.94 (0.89–0.99; P = 0.030) and 0.87 (0.83–0.92; P < 0.001), respectively). No association was observed between cholesterol indicator attainment and DR (adjusted HR 1.03 (0.97–1.10; P = 0.292)). HbA1c, BP, and cholesterol QOF indicator attainment were associated with significantly lower rates of STDR in both unadjusted and adjusted analyses (adjusted HR 0.74 (0.62–0.87; P < 0.001), 0.78 (0.67–0.91; P = 0.002), and 0.82 (0.67–0.99; P = 0.043), respectively). Full model results (i.e. including unadjusted and adjusted HR estimates for all covariates) are presented in the Additional File (Tables S2, S4, S5, and S7 for DR and Tables S10, S12, S13, and S15 for STDR outcomes, as well as Figure S1 and S3). C-statistics across multivariate Cox proportional hazards models ranged from 0.75 (95% CI 0.75–0.75) to 0.78 (95% CI 0.78–0.78) across exposures, indicating good fit among all models.

Table 3 Unadjusted and adjusted hazard ratios (with corresponding 95% CIs and p values) for DR and STDR given QOF exposures after 1:1 propensity score matching, as well as adjusted sample sizes after propensity score matching (N) with corresponding outcome events by exposure group

Fig. 1

Key adjusted hazard ratio estimates (and corresponding 95% confidence intervals) for risk of DR (top panel) and STDR (bottom panel) across QOF indicator and NDA process exposure definitions

Associations between NDA process completion exposures and DR and STDR

Table 4 summarises the associations between the NDA care process categories and incident DR. Point estimates were consistently greater than one (indicating higher rates of DR among those who completed more processes) in both the unadjusted and adjusted analyses. However, evidence for association was low (p ≥ 0.079 in all adjusted outcomes). Adjusted HRs are presented graphically in Fig. 1, and full model results are available in the Additional File: Tables S3-S4 and S6-S7 for unadjusted and adjusted results, respectively, as well as Figure S1.

Table 4 Unadjusted and adjusted hazard ratios (with corresponding 95% CIs and p values) for DR and STDR given NDA exposures after 1:1 propensity score matching, as well as adjusted sample sizes after propensity score matching (N) with corresponding outcome events by exposure group

Unadjusted and adjusted results show evidence of a significant association between completing 7–9 NDA processes (versus 0–3) and development of STDR, with a 28% lower rate of STDR (adjusted HR 0.72 (0.55–0.94; P = 0.017)). Additional File (Tables S11-S12 and S14-S15) provides full model results for the secondary outcome, including graphical representations of results (Figure S3).

Sensitivity analyses

Analyses of the individual QOF indicators among those who had met the other QOF indicators investigated (e.g. HbA1c indicator attainment among those who had met the BP and cholesterol indicators) demonstrated results consistent with our primary analyses for the DR outcome (see Additional File: Tables S8-S9 and Figure S2). For the STDR outcome, evidence of association was observed for only HbA1c indicator attainment (adjusted HR 0.64 (0.49–0.84; P = 0.002)) (see Additional File: Tables S16-S17 and Figure S4).

Discussion

Based on 60,094 people with type 2 diabetes followed up from 2011 to 2017, we observed incidence rates of 39.2 and 3.6 cases per 1000 person-years for DR and STDR, respectively. The corresponding cumulative incidences were 13.8% and 1.4%, respectively. QOF HbA1c and BP indicator attainment was associated with 1–11% and 8–17% lower incidence of DR, respectively, whereas we did not find evidence for association between cholesterol indicator attainment and DR. All three QOF indicators were associated with lower rates of STDR (13–38% lower for HbA1c, 9–33% for BP, and 1–33% for cholesterol). Completing 7–9 NDA processes (versus 0–3) was also associated with a 6–45% lower rate of STDR.

The UKPDS study conducted more than two decades ago on newly diagnosed individuals with type 2 diabetes reported that 22% developed DR and 1.1% required laser photocoagulation (surrogate for STDR) at 6 years [22]. In the Liverpool Diabetes Eye Study (LDES), among 4770 newly diagnosed type 2 diabetes patients between 1991 and 1999, the cumulative incidence of STDR was 3.9% at 5 years [23]. In a cohort study of 16,444 patients with type 2 diabetes from Norwich who were screened from 1990 to 2006, the cumulative incidence of STDR was 0.7% at 5 years and 1.5% at 10 years [24]. The most recent study is another CPRD study that analysed incident DR in type 2 diabetes individuals registered in general practices between 2004 and 2014, in which the age standardised incidence of DR was 40.8 DR/1000 person-years and 9.4 STDR/1000 person-years in 2011 [4]. The differences in these figures with ours could be attributable, at least in part, to the differences in age, study period, follow-up, absolute risk at baseline, and the duration of diabetes between these studies.

In our study, QOF HbA1c indicator attainment was associated with a lower incidence of DR and STDR incidences. The role of HbA1c control in reducing DR progression is unclear. The UKPDS included 3867 newly diagnosed type 2 patients (median age: 54 years), > 95% of whom had no DR or moderate NPDR at baseline [10]. Following intensive glycaemic control therapy with sulphonylureas or insulin, over 10 years of follow-up, the mean HbA1c was 7.0% compared with 7.9% in the conventional treatment group. This was associated with a consistent reduction in DR progression from the sixth year onwards, reaching a relative risk reduction of 21% (0–37%) at about 12 years. In the ACCORD Eye study, which enrolled 2856 participants with type 2 diabetes who were at high risk for cardiovascular disease, the intensive glycaemic control therapy (target HbA1c < 6.0% (42 mmol/mol)) resulted in a significant 23% (13–49%) relative risk reduction in rates of DR progression at 4 years [25]. In contrast, two other RCTs, namely the AdRem [26] and VADT [27] studies, showed no significant effect in reducing DR progression rates with the intensive glycaemic control therapy. In the AdRem study, the difference in median HbA1c between the treatment groups at 4 years was low (< 0.8%), whereas in the VADT study, a large number of individuals had DR with more than moderate severity at baseline. These might likely explain the lack of a significant effect of the intensive glycaemic therapy on DR progression.

With regard to blood pressure, we observed that QOF indicator (≤140/80 mmHg) attainment was associated with  a 13% (3–17%) lower risk of developing DR in people who attained the QOF target of BP ≤ 140/80 mmHg relative to those who did not. Hypertension usually co-exists with diabetes and is another important risk factor for development of DR. The UKPDS study highlighted that intensive control of BP with a target level of 150/85 mmHg or less among hypertensive patients with type 2 diabetes resulted in significant reductions in several aspects of DR after 4.5 years compared to a target of 180/105 mmHg or less [11]. A recent Cochrane review of five RCTs involving 1632 type 2 diabetes patients showed that intense BP control could reduce the incidence of DR by 22% (risk ratio 0.78, 95% CI 0.63; 0.96) compared with less intensive or no intervention over a 4–5-year period [28]. Furthermore, it is important to note that optimising both BP and glycaemic control simultaneously provide an additive effect in renal outcomes and have similar beneficial effects on DR as reported by UKPDS [29].

Our findings related to cholesterol are in line with the FIELD and ACCORD studies. Although these studies showed that either fenofibrate alone or in combination with simvastatin, respectively, reduced the risk of progression to STDR in individuals with type 2 diabetes, but the results did not correlate with the lowering of plasma lipids [25, 30].

A question that may arise is whether the differences in attainment of these key primary care targets are really an accomplishment of the treating physicians or can they be attributed to underlying disease severity or progression. While we may observe differences in number of prescription medications between the exposed and unexposed groups before matching, upon performing propensity score matching, these differences are eliminated (up to the aforementioned calliper) to produce a quasi-randomised equivalent sample (in terms of the covariates of interest). Therefore, we believe the effect seen on STDR is likely due to the attainment of these targets. Similarly, the propensity score matching also helps to alleviate the impact of other potential confounders or mediators such as lifestyle factors. However, causal relationships would be unclear and difficult to demonstrate for mediators, as well as are likely to be heterogeneous both across individuals and covariates.

In relation to the NDA care processes, it is likely that some of these processes are less relevant to DR compared with other diabetes outcomes. However, it is worth noting that, of the nine health checks provided annually to people with type 2 diabetes, the least attained health check was retinal screening at 64.26%, emphasising the need to ensure this is widely offered and accessible.

Our study has several strengths. The sample was large and we were able to account for several important potential confounders in the analyses. The ascertainment of exposures (routine standardised recording) was strong with low levels of missing data [31]. In terms of limitations, incomplete screening and recording will have been associated with under-ascertainment of cases. Some residual confounding is likely, and the study design as related to the care processes limits the interpretation, particularly as some are clearly less directly relevant to DR. There were relatively few STDR cases, which will have limited study power, especially in sensitivity analyses. Finally, we did not account for time-related variation in exposure status, which could have diluted the effect estimates to some extent. Achievement of care processes was measured at baseline (any point during the 1-year baseline period). with only single measurements made, in line with the expectations on primary care providers. We acknowledge that indicator attainment is likely to in part reflect underlying disease severity, as well patient and physician motivations and preferences, as well as the patient-physician relationship. However, we aim to account for the former by making relevant statistical adjustments eg. while we may observe differences in number of prescription medications between the exposed and unexposed groups before matching, upon performing propensity score matching, these differences are eliminated (up to the aforementioned caliper) to produce a quasi-randomized equivalent sample (in terms of the covariates of interest). The latter was also considered in our sensitivity analyses, where the attainment of other QOF indicators was taken into account.

Conclusions

Overall, our study indicates that attainment of primary care HbA1c and BP indicators is associated with lower incidence of DR and STDR in patients with type 2 diabetes. There is scope to enhance coverage of QOF HbA1c and BP indicator attainment, and thus to potentially limit the incidence of DR and STDR in England, through appropriate community-based measures. Further research is required to examine whether tighter glycaemic and/or BP control could achieve greater reductions in DR incidence without negative impact on macrovascular complications. Moreover, further studies are required to evaluate whether the attainment of these primary care targets will also influence DR progression.