Should all acutely ill children in primary care be tested with point-of-care CRP: a cluster randomised trial

Background

Point-of-care blood C-reactive protein (CRP) testing has diagnostic value in helping clinicians rule out the possibility of serious infection. We investigated whether it should be offered to all acutely ill children in primary care or restricted to those identified as at risk on clinical assessment.

Methods

Cluster randomised controlled trial involving acutely ill children presenting to 133 general practitioners (GPs) at 78 GP practices in Belgium. Practices were randomised to undertake point-of-care CRP testing in all children (1730 episodes) or restricted to children identified as at clinical risk (1417 episodes). Clinical risk was assessed by a validated clinical decision rule (presence of one of breathlessness, temperature ≥ 40 °C, diarrhoea and age 12–30 months, or clinician concern). The main trial outcome was hospital admission with serious infection within 5 days. No specific guidance was given to GPs on interpreting CRP levels but diagnostic performance is reported at 5, 20, 80 and 200 mg/L.

Results

Restricting CRP testing to those identified as at clinical risk substantially reduced the number of children tested by 79.9 % (95 % CI, 77.8–82.0 %). There was no significant difference between arms in the number of children with serious infection who were referred to hospital immediately (0.16 % vs. 0.14 %, P = 0.88). Only one child with a CRP < 5 mg/L had an illness requiring admission (a child with viral gastroenteritis admitted for rehydration). However, of the 80 children referred to hospital to rule out serious infection, 24 (30.7 %, 95 % CI, 19.6–45.6 %) had a CRP < 5 mg/L.

Conclusions

CRP testing should be restricted to children at higher risk after clinical assessment. A CRP < 5 mg/L rules out serious infection and could be used by GPs to avoid unnecessary hospital referrals.

Trial registration

ClinicalTrials.gov Identifier: NCT02024282 (registered on 14^th September 2012).

The care for acutely ill children has traditionally been a primary care responsibility [1], but increasing numbers are being seen in secondary care. There has been a 40 % increase in the number of children presenting to the emergency department over the last decade, 14 % of whom present with febrile illness [2]. Urgent hospital admission rates have increased by 28 % in the same period, mostly for acute infections [3], with 23 per 1000 children admitted annually for a condition that could be managed in the community [3, 4].

In contrast, serious infections have become rare and are now estimated to constitute < 1 % of childhood infections presenting to primary care [5]. Pneumonia represents four-fifths of all cases, followed by urinary tract infections, and now very few cases of sepsis, meningitis, or osteomyelitis [6–8], which, although rare, their prompt recognition is essential to avoid complications or death [9]. This is challenging in primary care because the clinical presentations are highly non-specific, especially in the early stages of illness. Only one clinical decision rule has been developed for primary care, with a sensitivity of 100 % and a specificity of 81 % [8]. Although it can be used to rule out serious infections safely, it also results in approximately 20 % of acutely ill children being classified as at higher risk for a serious infection.

Introducing better diagnostic tests might strengthen the primary care management of acutely ill children. Inflammatory markers such as C-reactive protein (CRP) and procalcitonin can assist in diagnosing serious infections in hospital settings [10]. Up until now, such blood tests play only a marginal role in primary care, because the result comes back from the laboratory too late to influence clinical decision-making [7]. Point-of-care tests that perform a CRP test within 4 minutes have now become available [11, 12].

In this study, we aimed to assess whether performing point-of-care CRP testing should be done in all children presenting with acute infection in primary care or only in those deemed at high-risk of serious illness after initial clinical assessment. We also aimed to investigate how CRP results should be interpreted; specifically, whether a low CRP level can rule out infection and the consequent need for hospital referral.

We conducted a cluster randomised controlled trial comparing CRP testing in all children with clinically-guided CRP testing. Practices were randomised to undertake point-of-care CRP testing in all children or only children assessed as being at higher risk by a validated clinical decision rule.

Children aged 1 month to 16 years presenting with an acute illness for a maximum of 5 days were recruited consecutively from February 15, 2013, to February 28, 2014, in 78 general practices across Flanders, involving 133 general practitioners (GPs). Children were excluded if the acute illness was caused by purely traumatic or neurological conditions, intoxication, a psychiatric problem, or an exacerbation of a known chronic condition. When the same child was recruited twice within 5 days, we considered the second registration to be part of the same illness episode and excluded the second registration from the analyses. If a physician recruited fewer than five children over the 1-year study period, consecutive inclusion was assumed to be violated, leading to the exclusion of that physician from the analysis.

In the “CRP for all” group, each child had a CRP test. In the “CRP only if at clinical risk” group, CRP testing was dependent on the presence of at least one of the following clinical features: breathlessness, body temperature of at least 40 °C, diarrhoea in children 12–30 months of age, and clinician concern [6]. “Breathlessness” was defined as difficult or laboured breathing. “Body temperature” was defined as the highest body temperature measured during the illness episode by the parents or the physician according to their usual practice. Before analysis, 0.5 °C was added to temperatures measured under the axilla or with a tympanic thermometer [13, 14]. “Diarrhoea” was defined as loose or watery stools, increased in frequency and volume [15]. “Clinician concern” was defined as a subjective feeling of the physician that something was out of the ordinary.

We used the Afinion™ CRP Test Cartridge, which has a measuring range for CRP of 5–200 mg/L [12] and requires 1.5 μL of blood obtained by finger prick, providing a result within 4 minutes. We trained all physicians to perform the CRP test. Internal quality control was performed according to the manufacturer’s instructions.

Randomisation was performed at the practice level to avoid contamination and stratified by practice type (solo, duo, group) before randomisation. The intervention-specific protocols were briefed during a face-to-face meeting at each practice, differing primarily in the indication to test for CRP.

The primary outcome of the study was hospital admission (> 24 hours) for a serious infection within 5 days after initial presentation. Hospital admission was verified by a search of the electronic medical records of all hospitals in the practices’ catchment area, an interview with each participating GP and a diary completed by parents. Serious infections were defined as:

• sepsis (including bacteraemia): pathogenic bacteria isolated from blood culture

• meningitis: pleocytosis or identification of bacteria or a virus in cerebrospinal fluid

• appendicitis: histology

• pneumonia: infiltrate on chest X-ray

• osteomyelitis: pathogens from bone aspirate or a MRI or bone scan suggestive for osteomyelitis

• cellulitis: acute suppurative inflammation of the subcutaneous tissues

• bacterial gastroenteritis: pathogen isolated from stool culture

• complicated urinary tract infection: > 10⁵/mL pathogens of a single species isolated from urine culture and systemic effects such as fever

In cases where no definitive adjudication could be made based on the above criteria, an adjudication committee, consisting of clinicians with expertise in acute paediatric care, assigned outcome by consensus, using all available information.

Secondary outcomes were referrals (immediate or delayed) to secondary care (hospital-based paediatricians) and the ordering of additional testing (including blood and urine tests, and imaging) at the initial presentation as recorded by the GP.

Sample size calculation was described previously [8], and is based on the assumptions that prevalence would be 0.8 % and sensitivity and specificity of CRP would be 75 %, as found in a recent meta-analysis, using bivariate random effects meta-analysis across a range of CRP cut-off values [10]. Differences in baseline characteristics and clinical features were analysed through χ² testing and nonparametric equality-of-medians testing to assess potential recruitment bias. We calculated accuracy of CRP in both groups for the following pre-determined thresholds: 5 and 200 mg/L which are the lower and upper limit of the point-of-care CRP test, and 20 and 80 mg/L which have been identified as ‘ruling out’ and ‘ruling in’ thresholds, respectively, in secondary care [10]. We examined whether time from onset of fever (in days) influenced the level of CRP using non-parametric equality-of-medians tests [16]. The 4.2 % missing values for CRP in those patients that should have had a CRP test were assigned to either side of the optimal split for this continuous predictor, defined as the split resulting in the smallest P value through χ² testing for the difference between both sides of the split [17].

To test whether there were any differences in timely diagnosis, referrals to secondary care or additional testing between the two groups, we conducted a mixed-effects logistic regression analysis to account for the clustering at practice level, and other potential interaction terms, such as the child’s age, using the xtmelogit function in Stata [18]. All analyses were performed with Stata software (version 11.2; Stata Corp., USA), and JMP Statistical Discovery (version Pro 12.1.0; SAS Institute Inc., USA).

The 3147 illness episodes occurred in 2773 children between February 15, 2013, and February 28, 2014 (Fig. 1). The children’s median age was 3.2 years (interquartile range 1.5–6.9) and 1659 were male (52.7 %). Table 1 shows that the randomisation arms were well balanced in terms of sex and the presenting features of the illness, although there was a small imbalance in age (median age 3.6 in the CRP for all arm versus 2.7 years in the CRP if at clinical risk arm).

Flowchart of recruited illness episodes in acutely ill children. GP: general practitioner; CRP: point-of-care C-reactive protein testing

Full size image

Impact of testing strategy on clinical management

Table 2 shows that restricting CRP testing to children at clinical risk (because of breathlessness, temperature ≥ 40 °C, diarrhoea and age 12–30 months, or clinician concern) substantially reduced the number of children tested to 285/1417 (20.1 %, 95 % CI, 18.0–22.2 %). All children with serious infection had one of the at-risk features sought by the clinical decision rule and thus all received CRP testing. Although fewer children were referred to hospital in the restricted testing arm (2.1 % vs. 2.9 %), the difference lacks statistical significance (P = 0.15). Similarly, the reduction in the number of children with serious infection whose admission was delayed (> 24 hours) in the restricted testing arm (0.14 % vs. 0.29 %) was also non-significant.

Diagnostic performance of CRP

Restricting CRP testing to those identified as at clinical risk increased the median CRP level of the children tested from 7 mg/L (IQR: 5–23 mg/L) to 11 mg/L (IQR: 5–30 mg/L). Time from onset of fever did not influence the median point-of-care CRP level (P > 0.06).

The impact on diagnostic performance of CRP is shown in Table 3. The small number of cases of serious infection means that the confidence intervals around the number of missed cases are wide, with no indication of a difference between randomisation arms. However, at a CRP threshold of 5 mg/L, no cases of serious infection were missed in either arm. The number of false alarms expressed was also similar in both arms, irrespective of the threshold applied. If the 5 mg/L threshold was adopted as a criterion for hospital referral, over half (59.2 % overall) of the children tested with CRP would be referred. Of these children, 1 in 40 in the restricted testing arm would have serious infection (positive predictive value: 2.4 %). If all children were tested and those with a CRP level ≥ 5 mg/L referred, then the positive predictive value would be even lower (0.8 %) and only 1 in 130 children referred would have a serious infection.

Children referred to hospital with normal CRP

Twenty-four children were referred to hospital with a low CRP level (< 5 mg/L). The clinical presentation and stated reasons for referral are shown in Table 4. In 17 cases (70.8 %), the referral was made to rule out serious infection. In only one of these cases was the child admitted – a case of viral gastroenteritis where the child was admitted because of dehydration.

Main findings

In primary care, CRP testing can be restricted to children at higher risk of serious infection after clinical assessment. At a threshold of 5 mg/L, CRP still has limited diagnostic value in ruling in serious infection (at most, 1 in 40 children will have serious infection) but it does rule out serious infection and the need for hospital referral.

Strengths and limitations

This trial was performed in a large number of practices involving 133 general practitioners and 3147 children. The results therefore reflect a real-life implementation of point-of-care CRP testing. Although blinding is not possible in cluster randomised controlled trials, we believe the verification of our target condition is robust and not influenced by the interventions by using a combination of objective criteria and independent adjudicators. We also think that work-up bias in primary care is unlikely to have had a major impact on our assessment of diagnostic performance because the diagnosis of serious infection was based on hospital assessment [19]. We were not able to provide physicians with instructions on how to deal with the CRP result because there were no studies available in primary care to underpin this advice. This could explain the lack of any effect of CRP tests on additional testing or referrals; earlier studies on CRP for antibiotic prescribing in adults have shown that instructions are pivotal for changing physician prescribing behaviour [20]. The trial did not include a no CRP-testing arm and clinical assessment of all children was guided by a validated clinical decision rule. This means that we could not report the effect of CRP testing compared to routine clinical care. It also means that the advantages we report from limiting CRP testing to children at risk will be achieved only if the quality of risk assessment is comparable to that implemented in the trial. Given the simplicity of the decision rule used, this should be achievable in most clinical settings.

Comparison with existing literature

A systematic review based on studies from hospital settings suggested that CRP levels < 20 mg/L provided the best rule out value for serious infections in children [10]. We applied a lower threshold in a primary care setting because children are presenting at an earlier stage of their illness (i.e. CRP levels in children with evolving serious infection are likely to be lower than when they arrive in hospital) [21].

Most studies on the use of CRP in primary care have focused on antibiotic prescribing in adult patients; a cluster randomised controlled trial has shown that GP’s use of point-of-care testing for CRP significantly reduced antibiotic prescribing if combined with enhanced communication skills [22]. Data from a multinational randomised controlled trial in adults suggested that CRP can be viewed as a tool to decrease diagnostic uncertainty and reassure patients in primary care [23], concluding that addition of CRP at > 30 mg/L improves diagnostic accuracy of a clinical decision rule to predict pneumonia in patients with acute cough [24].

Implications

Our results support the implementation of clinically guided CRP testing to help rule out serious infection and the need for hospital admission. To detect one child with a serious infection, the clinical decision rule would flag 57 children as potentially having a serious infection. A CRP test in these children allows a serious infection to be excluded in a further 22, which means fewer would have to be referred or receive additional testing. This will strengthen the primary care assessment of acutely ill children, assisting GPs in identifying children with a serious infection without swamping secondary care services. By supporting clinical decision-making, it empowers clinicians to safely manage children in ambulatory care, as prioritized by the NHS Five Year Forward View and the Future Hospital Commission [25, 26]. In clinical practice, the implementation of our findings should always allow for clinical judgment, especially when diagnostic uncertainty remains. In such cases, appropriate safety netting strategies (e.g. re-consultation, telephone follow-up, explicating alarm signs) [27, 28] should be in place. Further research should focus on the implementation of this validated clinical assessment in combination with CRP testing and evaluate the cost-effectiveness of the diagnostic strategy overall.

CRP testing in primary care should be restricted to children at higher risk after clinical assessment. A CRP < 5 mg/L rules out serious infection and could be used by GPs to avoid unnecessary hospital referrals.

CRP:

C-reactive protein

GP:

General practitioner

IQR:

Interquartile range

We would like to thank all participating GPs and paediatricians and Dr Bert Vaes for his valuable clinical input. We would like to thank Frederick Albert, Greet Delvou and Annelien Poppe for daily follow-up during the study. Finally, last but not least, we would like to thank all children and parents who took part in this study.

Funding

This study was funded by the National Institute for Health and Disability Insurance (RIZIV, Belgium) under reference CGV n° 2012/235 and the Research Foundation Flanders (FWO) under reference n° G067509N. AVDB and BS were funded by the NIHR Diagnostic Evidence Co-operative Oxford.

Availability of data and materials

The relevant anonymized patient level data are available on request from the corresponding author at jan.verbakel@phc.ox.ac.uk. Consent for data sharing was not obtained but the presented data are anonymized and the risk of identification is low.

Authors’ contributions

JV, ML, ADS, AVDB and FB conceived the study. JV, ML and TDB supervised data collection, performed data follow-up and data cleaning. JV performed the analyses, which were discussed with ML, ADS, BA, BS, RP, AVDB, DM and FB. JV drafted this report and ML, TDB, ADS, BA, BS, RP, DM, AVDB and FB co-drafted and commented on the final version. All authors had full access to all of the data (including statistical reports and tables) in the study and take responsibility for the integrity of the data and accuracy of the data analysis. JV affirms that the manuscript is an honest, accurate and transparent account of the study being reported; that no important aspects of the study have been omitted. All authors have read and approved the final manuscript.

Competing interests

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous 3 years; and no other relationships or activities that could appear to have influenced the submitted work.

Ethics approval and consent to participate

Formal written informed consent was obtained from the parent or guardian of each child. We provided age-appropriate information leaflets and assent forms for minors below and above 12 years of age. The protocol of this study was approved by the ethical review board of the University Hospitals/KU Leuven under reference ML8601.

Affiliations

1. Nuffield Department of Primary Care Health Sciences, University of Oxford, Radcliffe Primary Care Building, Woodstock Road, Oxford, OX2 6GG, UK
   • Jan Y. Verbakel
   • , Rafael Perera
   • , David Mant
   •  & Ann Van den Bruel
2. Department of Public Health and Primary Care, KU Leuven, Kapucijnenvoer 33J, 3000, Leuven, Belgium
   • Jan Y. Verbakel
   • , Tine De Burghgraeve
   • , Bert Aertgeerts
   •  & Frank Buntinx
3. Department of Family Medicine and Primary Health Care, Ghent University, De Pintelaan 185, Gent, 9000, Belgium
   • Marieke B. Lemiengre
   •  & An De Sutter
4. Leeds Institute of Health Sciences, University of Leeds, 101 Clarendon Road, Leeds, LS29LJ, UK
   • Bethany Shinkins
5. Research Institute Caphri, Maastricht University, Universiteitssingel 40, Maastricht, 6229 ER, The Netherlands
   • Frank Buntinx

Corresponding author

Correspondence to Jan Y. Verbakel.

An erratum to this article is available at http://dx.doi.org/10.1186/s12916-017-0861-1.

Reprints and Permissions