Skip to main content

The classification of feeding and eating disorders in the ICD-11: results of a field study comparing proposed ICD-11 guidelines with existing ICD-10 guidelines

Abstract

Background

The World Health Organization (WHO) International Classification of Diseases and Related Health Problems (ICD) is used globally by 194 WHO member nations. It is used for assigning clinical diagnoses, providing the framework for reporting public health data, and to inform the organization and reimbursement of health services. Guided by overarching principles of increasing clinical utility and global applicability, the 11th revision of the ICD proposes major changes that incorporate empirical advances since the previous revision in 1992. To test recommended changes in the Mental, Behavioral, and Neurodevelopmental Disorders chapter, multiple vignette-based case-controlled field studies have been conducted which examine clinicians’ ability to accurately and consistently use the new guidelines and assess their overall clinical utility. This manuscript reports on the results from the study of the proposed ICD-11 guidelines for feeding and eating disorders (FEDs).

Method

Participants were 2288 mental health professionals registered with WHO’s Global Clinical Practice Network. The study was conducted in Chinese, English, French, Japanese, and Spanish. Clinicians were randomly assigned to apply either the ICD-11 or ICD-10 diagnostic guidelines for FEDs to a pair of case vignettes designed to test specific clinical questions. Clinicians selected the diagnosis they thought was correct for each vignette, evaluated the presence of each essential feature of the selected diagnosis, and the clinical utility of the diagnostic guidelines.

Results

The proposed ICD-11 diagnostic guidelines significantly improved accuracy for all FEDs tested relative to ICD-10 and attained higher clinical utility ratings; similar results were obtained across all five languages. The inclusion of binge eating disorder and avoidant-restrictive food intake disorder reduced the use of residual diagnoses. Areas needing further refinement were identified.

Conclusions

The proposed ICD-11 diagnostic guidelines consistently outperformed ICD-10 in distinguishing cases of eating disorders and showed global applicability and appropriate clinical utility. These results suggest that the proposed ICD-11 guidelines for FEDs will help increase accuracy of public health data, improve clinical diagnosis, and enhance health service organization and provision. This is the first time in the revision of the ICD that data from large-scale, empirical research examining proposed guidelines is completed in time to inform the final diagnostic guidelines.

Peer Review reports

Introduction

Improving diagnostic guidelines for feeding and eating disorders (FEDs) in ICD-11 has significant implications for prevention and treatment. These disorders have a lifetime prevalence above 10% [1] and a point prevalence of at least 5% [2] and rates are increasing in many parts of the world [3,4,5]. Eating disorders (EDs) are associated with elevated rates of morbidity and mortality [6,7,8,9]. Anorexia nervosa (AN) has one of the highest mortality rates of all mental disorders [9]. Individuals with eating disorders have an elevated risk of dying by suicide compared to age-matched population estimates [7, 10]. As measured by the combination of years of life lost due to premature mortality and years lived with disability, the global disease burden of eating disorders increased by 65% between 1990 and 2016 [11]. Given the prevalence, severity, burden, and risk of mortality associated with eating disorders, increasing rates of eating disorders in various regions of the world and, given emerging data on feeding disorders, developing more accurate and clinically useful tools for the identification of such conditions to facilitate prevention and promote effective intervention are important global health priorities.

Feeding and eating disorders are conditions that involve abnormal eating or feeding behaviors that are not better accounted for by other health conditions and are not developmentally appropriate or culturally sanctioned. Feeding disorders include a range of conditions characterized by restricted or limited intake (avoidant-restrictive food intake disorder), as well as behavioral disturbances such as eating of non-edible substances (pica) or voluntary regurgitation of foods (rumination-regurgitation disorder). Eating disorders, i.e., anorexia nervosa, bulimia nervosa (BN), and binge eating disorder (BED), are conditions that are characterized by abnormal eating behaviors, as well as to varying degrees by preoccupation with food, body weight, and shape.

It has been more than 25 years since the World Health Organization (WHO) published the last major revision of the International Classification of Diseases and Related Health Problems (ICD) [12]. Since then, empirical research and evidence-informed clinical practice for eating disorders have evolved dramatically. Corresponding research in the field of feeding disorders has lagged behind, resulting in far less by way of evolution of evidence-informed practice for these disorders. This article describes the findings from a field study comparing the accuracy and consistency of clinician-assigned diagnoses when applying the proposed ICD-11 diagnostic guidelines for eating disorders as compared to the existing ICD-10 diagnostic guidelines to standardized case material. The study also compared clinician ratings of the clinical utility of the proposed guidelines for ICD-11 to those for ICD-10.

In developing the ICD-11 chapter on Mental, Behavioral, and Neurodevelopmental Disorders, the WHO Department of Mental Health and Substance Abuse identified clinical utility and global applicability as guiding principles [13]. To this end, a Working Group convened by WHO reviewed the extant research base on feeding and eating disorders and proposed changes to the ICD-10 guidelines with the following aims: (a) to improve communication among users (e.g., practitioners, patients, families, administrators), (b) to foster conceptualization and understanding of feeding and eating disorders, (c) to accurately and easily describe actual clinical presentations, (d) to assist with clinical management, and (e) to enhance clinical outcomes at the individual and population levels [14].

The Working Group identified three overarching limitations inherent to the ICD-10 eating disorders guidelines [15, 16]: (1) the ICD-10’s separation of feeding and eating disorders into two separate groups is not consistent with empirical data and current clinical practice, (2) the ICD-10 guidelines result in a lack of consistency in assigned diagnoses for eating disorders, with a large proportion classified using available “atypical” categories or “other specified” or “unspecified” residual categories, and (3) the ICD-10 guidelines fail to explicitly recognize the full range of cultural differences in clinical manifestations of feeding and eating disorders.

To address the first shortcoming of the ICD-10, and consistent with the Diagnostic and Statistical Manual of Mental Disorders 5th Edition (DSM-5) [17], feeding and eating disorders represent a single grouping in the ICD-11 (Table 1 summarizes the essential features of proposed categories). Further, to improve the clinical utility of the diagnostic system and to reduce the use of “atypical,” “other specified,” or “unspecified” diagnostic categories in ICD-10, which have limited clinical utility or informational value, the Working Group recommended (1) broadening the guidelines for AN and BN to include atypical and developmental variations of presentation, (2) adding BED, and (3) adding avoidant-restrictive food intake disorder (ARFID) to the diagnostic nomenclature [16]. To a great extent, the addition of ARFID represents a revised and expanded understanding of F98.2 Feeding disorder of infancy and childhood [18].

Table 1 Proposed ICD-11 diagnostic guidelines (essential features only) for feeding and eating disorders after revisions based on the study result

Eight specific research questions that are the focus of the present study emerged as a result of the recommended changes in the ICD for feeding and eating disorders. These questions represent fundamental conceptual changes made to the classification on the basis of a rigorous review of the empirical literature, including cross-culturally. Because the diagnostic guidelines for pica and rumination-regurgitation disorder had not changed substantially, these diagnoses were not included in the present study. Our overarching hypothesis was that revisions made to render the ICD-11 diagnostic guidelines more consistent with current research and to increase its clinical utility and global applicability would improve clinicians’ diagnostic accuracy and consistency when using the proposed ICD-11 guidelines for eating disorders, and that clinicians would rate the ICD-11 diagnostic guidelines as more clinically useful, as compared to those using the existing ICD-10 guidelines.

Methods

Description of study design

This was an experimental, vignette-based case-controlled study implemented via the internet with participation from a large, global, multilingual, and multidisciplinary sample of mental health professionals. The current study is part of a larger research program that employs a standard research design across the range of mental and behavioral disorders to assess the impact and clinical utility of proposed changes in the ICD guidelines. Additional information about the rationale and experimental design for these studies has been published elsewhere [19, 20].

Eight core questions

The eight core research questions investigated in this study were as follows:

  1. 1.

    Does the proposed addition of ARFID in the ICD-11 result in individuals with ARFID being more accurately distinguished from AN, and does the proposed addition of ARFID to ICD-11 reduce the number of individuals diagnosed with residual eating disorder categories (atypical, other specified, and unspecified)?

  2. 2.

    Can clinicians distinguish between ARFID and no eating pathology based on the proposed ICD-11 guidelines?

  3. 3.

    Some individuals present with atypical reasons for restricting eating, such as feeling uncomfortable when full. In such cases, can clinicians accurately distinguish between AN and ARFID based on the proposed ICD-11 guidelines?

  4. 4.

    ICD-11 has proposed that a diagnosis of AN be retained until an individual has at least 1 year of stabilized weight gain and cessation of behaviors aimed at promoting weight loss. Does this rule improve diagnostic accuracy for AN over the course of recovery?

  5. 5.

    Is the proposal to include subjective binge eating in ICD-11 BN clinically useful and effective in reducing residual eating disorder diagnoses?

  6. 6.

    Do the proposed guidelines for ICD-11 enable clinicians to accurately distinguish between BN and BED?

  7. 7.

    Are the proposed ICD-11 guidelines for BED clinically useful in distinguishing BED from no disorder?

  8. 8.

    Do the proposed ICD-11 guidelines provide sufficient clinical guidelines to distinguish BN and BED regardless of weight status?

Participants

Participants in this study were members of the Global Clinical Practice Network (GCPN) [21]. Beginning in 2011, mental health and primary care professionals from around the globe were invited to join the Global Clinical Practice Network in order to participate in internet-based field studies of the proposed guidelines for the ICD-11 [22]. For the purpose of the present study, an internet-based protocol using the Qualtrics survey platform [23] was developed. All registered GCPN members at the time of the study were invited to participate provided (a) they were currently seeing patients or engaged in direct clinical supervision, which was operationally defined as 10 h or more per week and (b) they had identified themselves as proficient in one of the five languages of the study (Chinese, English, French, Japanese, and Spanish).

Development of case vignettes

Vignettes were developed and validated to test the eight core study questions; that is, to test specific changes proposed for the ICD-11 as compared to the ICD-10. Members of the Feeding and Eating Disorders Working Group developed case vignettes (Table 2) based on actual clinical patient presentations that addressed the essential features being analyzed. A second, independent group of international eating disorder experts conducted confirmatory evaluations to ensure diagnostic agreement for the case narratives. These procedures follow best practices established for vignette development for such field studies [20, 24].

Table 2 Case vignettes with their accurate diagnoses according to either the ICD-10 or ICD-11 diagnostic guidelines

For the purpose of evaluating the clinical utility of the ICD-11 guidelines in this study, members of the workgroup decided which ICD-10 diagnosis (or diagnoses) represented the best fit for the relevant vignettes. Because BED and ARFID are new diagnoses in ICD-11, there is not an exact comparable diagnosis in ICD-10. Thus, when applying the available options in ICD-10, a specific case could be diagnosed as “atypical” or “other specified” of “unspecified,” or, depending on the specific features of the case, as “feeding disorder of infancy or childhood” or “overeating associated with other psychological disturbances.” None of these options would fit the exact case description for conditions of BED and ARFID, but they would be the best diagnoses available using ICD-10. For these vignettes, we identified all diagnoses in the ICD-10 that could reasonably be used to diagnose these presentations and considered them “applicable.”

As for ICD-11, the generation of diagnosis for the case vignettes involved a rigorous process whereby members of the expert Working Group provided independent diagnoses for each case vignette and indicated in the case vignette each of the essential features required for that diagnosis. Any ambiguity that emerged at this stage was addressed. It was on this basis that the diagnosis considered accurate for each case vignette was defined.

Procedures

At the time of data collection in 2014–2015, 7582 GCPN members were eligible to participate in the study and were invited. Of those, 3059 (40.3%) responded to the survey link and initiated the study. Upon entry to the study, participants were randomized to a condition in which they viewed either ICD-10 or ICD-11 clinical descriptions and diagnostic guidelines for feeding and eating disorders. They were blind to whether they were assigned ICD-10 or ICD-11 guidelines. Clinicians were then randomly assigned to one of the eight core research questions described above, which were addressed by paired-vignette comparisons. The rationale for each core diagnostic question, the description of each case vignette, and the paired vignettes used to examine each research question are described in Tables 2 and 4. Additionally, the cases were presented in counterbalanced order for each comparison. Participants used the guidelines to which they were assigned to diagnose each of the two cases presented to them. Clinical utility of the proposed ICD-11 guidelines was also compared to the ICD-10 guidelines.

After reading each of their assigned vignettes, participants selected a diagnosis from the respective diagnostic system (ICD-11 or ICD-10), with an option to enter a diagnosis other than a feeding or eating disorder (i.e., another Mental and Behavioral Disorder) if they believed that a different diagnosis was more appropriate. Participants could also indicate that no diagnosis was warranted. They were specifically asked to provide a current (as opposed to lifetime) diagnosis and could review the diagnostic guidelines and vignette while making a selection. After providing a diagnosis, participants were shown each of the essential features for their chosen diagnosis, one by one, and were asked to indicate if the clinical case described in the vignette reflected each one. After reviewing the essential features, participants had the option to change their final diagnosis. If a diagnosis was chosen that was not the diagnosis considered correct for the vignette, they were asked to articulate their reasoning (without being informed that the selected diagnosis was considered incorrect). This procedure made it possible to identify specific points of ambiguity or confusion in the classification.

Upon completion of the first vignette, each participant was presented with the second vignette and repeated the procedure described above. After selecting a diagnosis and answering the related diagnostic questions for both vignettes, participants also completed a set of questions related to the clinical utility of the diagnostic guidelines, including their ease of use, goodness of fit, and clarity.

Statistical analysis

The study design was a 2 × 8 (diagnostic system vs. paired vignette) comparison mixed design, where the diagnostic system (ICD-10 vs. ICD-11) and the eight specific diagnostic comparisons described above were between-participant factors, with a within-participant factor comparing ratings of the two vignettes. Two-way chi-square statistics were used for bivariate comparisons and the G-square statistic [25] for three-way interactions. Data from all five languages in which the study was administered were combined in the results reported in this article.

Results

Participants

Of the 3059 who started the survey, 2288 (74.8%) provided complete data for inclusion in the present analysis. Participants that completed the study had approximately half a year more experience, on average (participated M = 13.62, SD = 10.20; not participated M = 13.08, SD = 10.30; t(7580) = 2.26, p < .05, d = 0.05). Participants represented all world regions. The largest numbers of participants came from Europe (33.0%) and the Asian portion of the Western Pacific Region (30.3%), followed by Latin America and the Caribbean (12.1% each) and the USA and Canada (10.0%). Some regions were disproportionately represented in the final sample. Participants from the Asian region of the Western Pacific (30.4% vs. 37.6%; χ2 (1) = 17.81, p < .001) and North American (10.0% vs. 11.8%; χ2 (1) = 4.14, p < .05) were underrepresented relative to the number of people invited to participate. European (33.0% vs. 28.9%; χ2 (1) = 6.69, p < .01), Southeast Asian (6.3% vs. 4.8%; χ2 (1) = 6.08, p < .05), and African (2.8% vs. 1.3%; χ2 (1) = 18.59, p < .001) participants were overrepresented. Male participants slightly outnumbered female participants. The majority (59.7%) were physicians (nearly all psychiatrists), and an additional 30.3% were psychologists. Most were middle-aged with approximately a decade or more of clinical experience. See Table 3 for additional details regarding demographic and other participant features.

Table 3 Participant demographics (N = 2288)

Eight core questions (Table 4)

  1. 1.

    Does the proposed addition of ARFID in the ICD-11 result in individuals with ARFID being more accurately distinguished from AN, and does the proposed addition of ARFID to ICD-11 reduce the number of individuals diagnosed with residual eating disorder categories (atypical, other specified, and unspecified)?

Table 4 Core scientific questions, rationale, vignette comparison and results

Clinicians were highly accurate in diagnosing AN using both the ICD-11 and the ICD-10 guidelines (the percentage of correct diagnoses for AN vignettes was 96.6% and 93.7%, respectively). The difference between systems was not significant, χ2 (1) = 1.38, p = .24. Clinicians assigned to the ICD-11 guidelines were able to successfully differentiate cases of ARFID from AN, χ2 (2) = 246.25, p < 0.001. The majority of clinicians in both the ICD-11 and ICD-10 conditions accurately diagnosed the ARFID case (89.9% and 80.4% respectively, χ2 (1) = 2.34, p = .13). There was no overall difference between ICD-10 and ICD-11, G2 (4) = 7.32, p = .16. However, because ARFID does not exist in the ICD-10, the diagnoses applied by clinicians in the ICD-10 condition were highly varied and distributed across four “applicable” options (atypical anorexia nervosa, feeding disorder of infancy or childhood, other eating disorder, or eating disorder unspecified). Thus, the addition of ARFID in ICD-11 resulted in simplifying the diagnostic landscape relative to the options available under ICD-10.

  1. 2.

    Can clinicians distinguish between ARFID and no eating pathology based on the proposed ICD-11 guidelines?

Using ICD-11, clinicians were able to differentiate ARFID (88.5% correct) from no diagnosis (78.4% correct), χ2 (2) = 190.00, p < 0.001. Using ICD-10, clinicians were also able to differentiate individuals with ARFID symptoms (although diagnoses varied because ARFID does not exist in ICD-10 as mentioned in question 1) from no diagnosis (76.8% and 79.6%, respectively), χ2 (2) = 169.50, p < 0.001. Clinicians using the ICD-11 were more accurate than ICD-10 for the ARFID case, χ2 (1) = 6.71, p < 0.01. Using both the ICD-11 and ICD-10, clinicians correctly gave no diagnosis where appropriate, χ2 (1) = 0.17, p = .68. When looking at overall differences across systems, clinicians using the ICD-11 outperformed those using the ICD-10, G2 (4) = 17.80, p < 0.01.

  1. 3.

    Some individuals with anorexia nervosa present with atypical reasons for restricting eating, such as feeling uncomfortable when full. Can clinicians accurately distinguish between AN and ARFID based on the proposed ICD-11 guidelines in such cases?

Clinicians using ICD-11 reliably differentiated between AN and ARFID, χ2 (2) = 262.84, p < 0.001. Clinicians using both ICD-10 and ICD-11 correctly diagnosed the AN case (96.7% and 97.0% respectively, χ2 (1) = 0.02, p = .89). However, the case that would be diagnosed with ARFID in ICD-11 resulted in multiple diagnoses of participants assigned to the ICD-10 condition. If we consider the diagnoses of atypical anorexia nervosa, other eating disorder, or eating disorder unspecified as applicable under ICD-10, clinicians still did not do as well using ICD-10 as in ICD-11 when diagnosing the same case vignette (76.0% vs. 87.9% respectively, χ2 (1) = 6.90, p < 0.01). Overall, the ICD-11 outperformed the ICD-10, G2 (4) = 14.62, p < 0.01.

  1. 4.

    ICD-11 proposes that a diagnosis of AN be retained until an individual has at least 1 year of stabilized weight gain and cessation of behaviors aimed at promoting weight loss. Does this rule improve diagnostic consistency for AN over the course of recovery?

The majority of clinicians (84.6%) using the ICD-11 correctly applied the new guideline for the case intended to represent AN given the fact that restoration of sufficient weight had not been sustained independent of treatment for a minimum of 1 year. Just over half (53.1%) of the clinicians using the ICD-11 incorrectly continued to apply the diagnosis of AN to the case that depicted someone who had surpassed 1 year of treatment gains and who therefore should have received no diagnosis; thus, diagnostic accuracy for the first case was higher than for the second, χ2 (2) = 46.82, p < 0.001. Among these individuals, there was considerable confusion about the presence or absence of specific essential features of AN in the vignette. However, all but seven recognized that the treatment gains had been maintained for at least 1 year (which according to ICD-11 would call for no diagnosis). After reviewing the diagnostic guidelines in detail, 15 of the 69 opted to change their diagnosis to “no diagnosis,” which was the correct answer. Comparing the accuracy of diagnosis utilizing ICD-11 to ICD-10, clinicians using the ICD-11 guidelines were significantly better able to distinguish between AN, another diagnosis, or no diagnosis (G2 (4) = 31.84, p < 0.0001), although diagnosis had to be grouped into AN, another diagnosis, or no diagnosis for this analysis.

  1. 5.

    Is the proposal to include subjective binge eating in ICD-11 BN clinically useful and effective in reducing residual eating disorder diagnoses?

Clinicians did not consistently apply the diagnosis of BN to the case vignette depicting an individual engaged in subjective binge eating. Participants using ICD-11 were more likely to give a diagnosis other than BN in the case of subjective binge eating when compared with the vignette describing objective binge eating (61.4% and 84.3% correct, respectively; χ2 (2) = 20.25, p < 0.001). Similarly, participants assigned to the ICD-10 condition were more likely to give the applicable diagnostic options when the vignette described objective binge eating (i.e., BN) compared to subjective binge eating (i.e., atypical bulimia nervosa, other eating disorder or eating disorder unspecified) 82.2% and 69.6% correct, respectively; χ2 (2) = 45.95, p < 0.001. Clinicians assigned to the ICD-11 condition were more accurate when diagnosing a case with subjective binge eating, χ2 (1) = 10.62, p < 0.001, but no different when diagnosing a case with objective binge eating, χ2 (1) = 0.23, p = .63. Overall, ICD-11 performed better than ICD-10, G2 (2) = 10.90, p < 0.01.

  1. 6.

    Do the proposed guidelines for ICD-11 enable clinicians to accurately distinguish between BN and BED?

The vast majority of participants correctly diagnosed the BED and BN case vignettes in ICD-11 (78.0% and 90.2%, respectively). The results indicate that participants using the ICD-11 were able to accurately distinguish between BN and BED, χ2 (2) = 182.50, p < 0.001. Clinicians assigned to the ICD-10 condition were highly variable in the diagnosis they chose for the case depicting binge eating without compensatory behavior: atypical BN (23.3%), overeating associated with other psychological disturbances (31.3%), other eating disorder (3.3%), eating disorder unspecified (12.7%), another diagnosis (29.3%). If the first four categories are considered as applicable options or as BED “equivalent,” as BED is not an existing category according to the ICD-10, then clinicians were able to accurately distinguish between BN and BED using both the ICD-10 and ICD-11, χ2 (2) = 2.05, p = .36. However, when using the ICD-10, the case depicting the syndrome of binge eating without compensatory behavior resulted in a widely variable range of diagnoses. When diagnosing BN, clinicians in the ICD-11 condition were significantly more likely to assign a correct diagnosis than those in the ICD-10 condition (90.2% vs. 83.3%, respectively), χ2 (2) = 8.73, p < 0.05. Clinicians using ICD-10 also differentiated the two cases, χ2 (2) = 152.99, p < 0.001, but overall, ICD-11 performed significantly better than ICD-10, G2 (4) = 11.40, p < 0.05.

  1. 7.

    Based on the proposed ICD-11 guidelines, can BED be reliably distinguished from non-pathological variations in eating behavior?

The majority of clinicians in the ICD-11 condition correctly diagnosed BED (82.4%) with only 1.4% failing to give this case a diagnosis, χ2 (2) = 203.40, p < 0.001. For the clinicians using ICD-10, 72.5% selected a binge eating disorder “equivalent” diagnosis (applicable options as mentioned in question 6) and only 7.0% failed to give this case a diagnosis. Clinicians using ICD-11 were accurate in distinguishing BED from no disorder such that most clinicians (80.3%) selected no diagnosis for the case representing no disorder. For the ICD-10 condition, 76.8% of clinicians assigned no diagnosis to the corresponding vignette, and 18.3% incorrectly assigned a BED “equivalent” diagnosis, χ2 (2) = 138.96, p < 0.001. Clinicians in the ICD-11 conditions were more accurate in diagnosing BED, χ2 (2) = 6.71, p < 0.05, and no eating disorder, χ2 (2) = 10.54, p < 0.01. Comparing the clinicians’ accuracy overall, ICD-11 outperformed and evidenced a cleaner pattern than ICD-10, G2 (4) = 18.24, p < 0.01.

  1. 8.

    Do the proposed ICD-11 guidelines facilitate an accurate distinction between BN and BED regardless of weight status?

Clinicians using the ICD-11 were more accurate in diagnosing BED when the case was described as clearly obese (90.5%) (BMI = 34 kg/m2) as compared to when the case was described as slightly overweight (BMI = 27 kg/m2) (82.4%), χ2 (2) = 8.90, p < 0.05. In the case of BN, there was no difference based on whether weight status was described as normal (90.2%) or overweight (88.5%), χ2 (2) = 3.25, p = .20. Overall, clinicians using ICD-11 accurately distinguished between BN and BED when the cases were described as overweight, χ2 (2) = 213.70, p < 0.001.

In the ICD-10 condition, clinicians showed greater accuracy in diagnosing BED “equivalent” conditions when the case was obese (83.2%) as compared to when the case was slightly overweight (70.7%, χ2 (2) = 7.64, p < 0.05). Also, clinicians using the ICD-10 guidelines more accurately diagnosed BN when the case was described as normal weight (83.3%) compared to when the case was described as overweight (69.3%), χ2 (2) = 8.18, p < 0.05. Comparing across ICD-11 and ICD-10 conditions, clinicians using the ICD-11 were more accurate than those using the ICD-10 in diagnosing BN when the case was described as obese, χ2 (2) = 17.43, p < 0.001. Clinicians performed equally well in diagnosing BED associated with obesity, χ2 (2) = 3.52, p = .17. Overall, clinicians in the ICD-11 compared to those in the ICD-10 condition provided more accurate diagnoses when a patient was described as overweight, G2 (4) = 21.54, p < 0.001.

Clinical utility of the diagnoses

Clinician ratings of the clinical utility for the diagnostic guidelines of ICD-10 and ICD-11 for the conditions studied in this set of research questions are shown in Table 5. For most diagnoses, the pattern of results for ICD-11 as compared to ICD-10 was the same. ICD-11 was rated more favorably than ICD-10 for each diagnosis in terms of (1) how easy the diagnostic categories were to use, (2) how well the guidelines fit the case vignettes, and (3) how clear the guidelines were.

Table 5 Clinical utility ratings for ICD-11 categories as compared to closest ICD-10 categories

Discussion

This vignette-based, case-controlled study found that the recommended changes to the ICD-11 diagnostic guidelines for eating disorders generally improved diagnostic accuracy and clinical utility as compared to the existing ICD-10 guidelines. The experimental design of this study facilitated rigorous comparisons of the guidelines when applied by mental health professionals around the world. The addition of the new categories of BED and ARFID significantly improved diagnostic consistency relative to ICD-10. Further, for all diagnostic categories, clinicians rated the ICD-11 guidelines significantly more favorably than ICD-10 in terms of their clinical utility, including ease of use, goodness of fit, diagnostic confidence, and clarity of the guidelines.

The study highlighted several ways in which the initially proposed guidelines needed to be improved and provided direction that guided further refinement of the ICD-11 guidelines [21]. This investigation was also useful in highlighting key issues that will need to be integrated into training efforts as the ICD-11 is adopted around the world.

First, clinicians had some difficulty determining when to consider a person with a diagnosis of AN to be recovered and discontinue use of the diagnosis of AN relative to weight status. This is a longstanding clinical conundrum, given that weight status plays such a central role in the clinical presentation of AN, and individuals with AN can gain weight despite on-going and significant attitudinal and behavioral disturbances. The proposal to extend the diagnosis of AN until an individual has sustained recovery, i.e., achieved healthy weight and cessation of behaviors aimed at reducing body weight without the support of on-going treatment, is conceptually consistent with clinical practice but, as indicated by our results, difficult to operationalize. Alternatively, it may have been that clinicians did not apply the proposed guidelines accurately because they did not realize that they were being asked to assign the “current” diagnosis for the case vignette. It is notable that in follow-up inquiries, among those clinicians who initially applied the diagnostic guidelines inaccurately, virtually all of them changed their diagnosis after the item-by-item analysis. This suggests that training on this guideline will be of significant benefit and that clinicians can accurately apply the guideline when it is brought to their attention.

The definition of recovery in AN was refined in the final guidelines by adding additional qualifiers related to underweight status. Specifically, the qualifier “Anorexia Nervosa in recovery with normal body weight” was added to the qualifiers for underweight status. This qualifier is applied as follows: “Among individuals who are recovering from Anorexia Nervosa who have reached a healthy body weight, the diagnosis should be retained until a full and lasting recovery is achieved. This includes maintenance of a healthy weight and the cessation of behaviors aimed at reducing body weight independent of the provision of treatment (e.g., for at least 1 year after intensive treatment is withdrawn).”

The second finding that resulted in revision to the guidelines pertains to subjective binge eating. Results from the current study indicate that further guidance is necessarily related to the inclusion of subjective binge eating in conferring a diagnosis of BN. Again, in clinical practice, descriptions of the size of binge eating episodes vary [26] and individuals with patterns of subjective binge eating and purging describe significant distress and indicators of psychopathology and severity are the same from individuals who describe objective binge eating [27,28,29,30]. Thus, there is a strong clinical case for applying the diagnosis of BN for these individuals. Given the results of this study, the guidelines for the assessment of binge eating in BN and BED were further elaborated in the “Additional Features” section of the guidelines to make it clear that subjective experiences of loss of control over eating and related distress are pathognomonic features of binge eating, even when not consuming an objectively large amount of food.

Specifically, in the “Additional Features” sections for both BN and BED, it is stated: "Binge eating episodes may be “objective,” in which the individual eats an amount of food that is larger than what most people would eat under similar circumstances, or “subjective,” which may involve eating amounts of food that might be objectively considered to be within normal limits but are considered large by the individual. In either case, the core feature of a binge eating episode is the experience of loss of control over eating". Again, we believe that training clinicians on this guideline will be of utmost importance since it explicitly differs from the definition of binge eating in ICD-10 and DSM-5.

Third, the findings from this study are consistent with clinical reports that clinicians tend to associate BED with obesity, probably in part because the majority of individuals who present for treatment for BED are overweight or obese [31]. The clinical description of BED in ICD-11 explicitly states that weight is not a determinative clinical feature of this disorder. To underscore the distinction between BED and weight status, in the section “Boundaries with Other Disorders and Conditions (Differential Diagnosis),” a specific section has been added as follows: “Boundary with obesity: Obesity is a common consequence of Binge Eating Disorder, and should be recorded separately. However, obese individuals who report overeating patterns that do not meet the definition of binge eating should not be diagnosed with Binge Eating Disorder”. Given the practical reality, training materials for feeding and eating disorders will need to also underscore this point.

The inclusion of the additional diagnoses of BED and ARFID and the broadening of diagnostic requirements of BN to include some formerly subthreshold cases have important clinical and public health implications given that currently the majority of eating disorder diagnoses fall in the residual “other specified” or “unspecified” categories in clinical practice. With the inclusion of BED and ARFID, the results of this study suggest that there will be fewer “other specified” or “unspecified” eating disorders. We also anticipate that many individuals who are suffering from an eating disorder will more readily be able to secure treatment. Research shows that subthreshold cases often have similar levels of impairment and can develop more severe behavioral presentations over time [32,33,34]. The changes in the proposed ICD-11 diagnostic guidelines may help to facilitate more specific diagnoses that will guide appropriate treatment. With earlier diagnosis and treatment, we expect to prevent progression to greater severity of illness presentation and to reduce corresponding loss of function or years of life.

Finally, the present study supported the clinical utility for both schemes. However, ICD-11 was regarded by clinicians as an easier scheme to use and as having an overall clearer description of disorders and a better fit for the clinical vignettes in this study, with results indicating favorable responses of “quite” or “extreme” for these aspects of the clinical utility reaching above 85% of ratings for diagnoses in ICD-11 (Table 5). Overall, findings from this study are in line with other research that examined the clinical utility of the ICD-11 guidelines for high burden mental health disorders [35].

This is the first time in the revision of either the ICD or the DSM that a rigorous research program was pursued to systematically evaluate the impact and clinical utility of proposed changes in guidelines. The use of technology through the engagement of the Global Clinical Practice Network and the utilization of a rigorous experimental case-vignette case-control design enabled us to gather empirical data on the proposed guidelines for feeding and eating disorders, and make further changes in the recommendations prior to the finalization and publication of the ICD-11 guidelines. Because we conducted an item-by-item analysis whenever a clinician made a diagnosis that was not accurate according to the expert standard, we were able to utilize the additional feedback from participants to guide further refinement of the guidelines.

This study engaged clinicians from around the world. Every WHO region was represented, and the study was conducted in five languages [21]. The case-controlled vignette-based study methodology enabled us to evaluate the guidelines by controlling for variability associated with clinical presentations. The vignettes were developed based on actual clinical cases and most participants reported that the case vignettes were similar to the individuals they see in clinical practice. Additionally, members of the Work Group who consulted on the creation of the case vignettes represent a variety of countries, ensuring that a range of cultural perspectives was included in vignette development.

The development of the ICD-11 is notable in that this is the first time that empirical findings regarding clinical utility and global applicability of a diagnostic classification will inform further revision of the diagnostic guidelines prior to their formal adoption. These methods increase ICD-11’s ability to provide guidelines that are truly relevant and broadly applicable in real clinical practice around the globe. The findings from this study indicate that the ICD-11 will provide significantly improved guidelines for the disorders within the Feeding and Eating Disorders Category.

Limitations

The present study used standardized case descriptions in the form of vignettes and did not involve the application of the guidelines to a real clinical sample. Therefore, the result of this study should be generalized to individual patients with caution. Nonetheless, vignettes were developed and validated by clinical experts drawing upon real cases which expert raters considered to be valid and therefore can be treated as a useful simulation of clinical decision-making within these limitations [20].

Regarding generalizability, this was a truly global, multilingual, multidisciplinary study, with vignettes and guidelines designed to be cross-culturally applicable. Nonetheless, care should always be taken when generalizing results to specific (local) populations that may differ from the general (global) sample.

Conclusion

Overall, the results in this study indicate that the proposed ICD-11 diagnostic guidelines for eating disorders represent a significant improvement over ICD-10. Clinicians report that the ICD-11 has high clinical utility; the additional diagnostic categories appear to be widely understood and are expected to increase the clinical accuracy in the diagnosis of feeding and eating disorders. These improvements in diagnosis have the potential to facilitate the organization and delivery of services and to achieve better clinical outcomes over time.

Abbreviations

AN:

Anorexia nervosa

APA:

American Psychiatry Association

ARFID:

Avoidant-restrictive food intake disorder

BED:

Binge eating disorder

BN:

Bulimia nervosa

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders 5th Edition

EDs:

Eating disorders

FEDs:

Feeding and eating disorders

GCPN:

Global Clinical Practice Network

ICD:

International Classification of Diseases and Related Health Problems

WHO:

World Health Organization

References

  1. Smink FR, van Hoeken D, Hoek HW. Epidemiology, course, and outcome of eating disorders. Curr Opin Psychiatry. 2013;26(6):543–8.

    Article  Google Scholar 

  2. Hay P, Mitchison D, Collado AEL, González-Chica DA, Stocks N, Touyz S. Burden and health-related quality of life of eating disorders, including avoidant/restrictive food intake disorder (ARFID), in the Australian population. J Eat Disord. 2017;5(1):21.

    Article  Google Scholar 

  3. Qian J, Hu Q, Wan Y, Li T, Wu M, Ren Z, et al. Prevalence of eating disorders in the general population: a systematic review. Shanghai Arch Psychiatry. 2013;25(4):212.

    PubMed  PubMed Central  Google Scholar 

  4. Micali N, Hagberg KW, Petersen I, Treasure JL. The incidence of eating disorders in the UK in 2000–2009: findings from the General Practice Research Database. BMJ Open. 2013;3(5):e002646.

    Article  Google Scholar 

  5. Pike KM, Dunne PE. The rise of eating disorders in Asia: a review. J Eat Disord. 2015;3(1):33.

    Article  Google Scholar 

  6. Keel PK, Brown TA, Holm-Denoma J, Bodell LP. Comparison of DSM-IV versus proposed DSM-5 diagnostic criteria for eating disorders: reduction of eating disorder not otherwise specified and validity. Int J Eat Disord. 2011;44(6):553–60.

    Article  Google Scholar 

  7. Arcelus J, Mitchell AJ, Wales J, Nielsen S. Mortality rates in patients with anorexia nervosa and other eating disorders: a meta-analysis of 36 studies. Arch Gen Psychiatry. 2011;68(7):724–31.

    Article  Google Scholar 

  8. Field AE, Sonneville KR, Micali N, Crosby RD, Swanson SA, Laird NM, et al. Prospective association of common eating disorders and adverse outcomes. Pediatrics. 2012. doi:https://doi.org/10.1542/peds.2011-3663.

    Article  Google Scholar 

  9. Zerwas S, Larsen JT, Petersen L, Thornton LM, Mortensen PB, Bulik CM. The incidence of eating disorders in a Danish register study: associations with suicide risk and mortality. J Psychiatr Res. 2015;65:16–22.

    Article  Google Scholar 

  10. Pisetsky EM, Thornton LM, Lichtenstein P, Pedersen NL, Bulik CM. Suicide attempts in women with eating disorders. J Abnorm Psychol. 2013;122(4):1042–56.

    Article  Google Scholar 

  11. Erskine HE, Whiteford HA, Pike KM. The global burden of eating disorders. Curr Opin Psychiatry. 2016;29(6):346–53.

    Article  Google Scholar 

  12. WHO. The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines: World Health Organization; 1992.

    Google Scholar 

  13. International Advisory Group for the Revision of ICD-10 Mental Behavioural Disorders. A conceptual framework for the revision of the ICD-10 classification of mental and behavioural disorders. World Psychiatry. 2011;10(2):86–92.

    Article  Google Scholar 

  14. First MB, Reed GM, Hyman SE, Saxena S. The development of the ICD-11 clinical descriptions and diagnostic guidelines for mental and behavioural disorders. World Psychiatry. 2015;14(1):82–90.

    Article  Google Scholar 

  15. Uher R, Rutter M. Classification of feeding and eating disorders: review of evidence and proposals for ICD-11. World Psychiatry. 2012;11(2):80–92.

    Article  Google Scholar 

  16. Al-Adawi S, Bax B, Bryant-Waugh R, Claudino AM, Hay P, Monteleone P, et al. Revision of ICD–status update on feeding and eating disorders. Adv Eat Disord. 2013;1(1):10–20.

    Article  Google Scholar 

  17. APA. Diagnostic and statistical manual of mental disorders (5th Edition): American Psychiatric Association; 2013.

    Google Scholar 

  18. Attia E, Becker AE, Bryant-Waugh R, Hoek HW, Kreipe RE, Marcus MD, et al. Feeding and eating disorders in DSM-5. Am J Psychiatr. 2013;170(11):1237–9.

    Article  Google Scholar 

  19. Keeley JW, Reed GM, Roberts MC, Evans SC, Medina-Mora ME, Robles R, et al. Developing a science of clinical utility in diagnostic classification systems: Field study strategies for ICD-11 mental and behavioral disorders. Am Psychol. 2016;71(1):3.

    Article  Google Scholar 

  20. Evans SC, Roberts MC, Keeley JW, Blossom JB, Amaro CM, Garcia AM, et al. Vignette methodologies for studying clinicians’ decision-making: validity, utility, and application in ICD-11 field studies. Int J Clin Health Psychol. 2015;15(2):160–70.

    Article  Google Scholar 

  21. The Global Clinical Practice Network. Available from: https://gcp.network.

  22. Reed GM, Rebello TJ, Pike KM, Medina-Mora ME, Gureje O, Zhao M, et al. WHO’s Global Clinical Practice Network for mental health. Lancet Psychiatry. 2015;2(5):379–80.

    Article  Google Scholar 

  23. Qualtrics L. Qualtrics [software]. Utah: Qualtrics; 2014.

    Google Scholar 

  24. Keeley JW, Reed GM, Roberts MC, Evans SC, Robles R, Matsumoto C, et al. Disorders specifically associated with stress: a case-controlled field study for ICD-11 mental and behavioural disorders. Int J Clin Health Psychol. 2016;16(2):109–27.

    Article  Google Scholar 

  25. Rao JN, Scott AJ. On chi-squared tests for multiway contingency tables with cell proportions estimated from survey data. Ann Stat. 1984;12(1):46–60.

    Article  Google Scholar 

  26. Wolfe BE, Baker CW, Smith AT, Kelly-Weeder S. Validity and utility of the current definition of binge eating. Int J Eat Disord. 2009;42(8):674–86.

    Article  Google Scholar 

  27. Fitzsimmons-Craft EE, Ciao AC, Accurso EC, Pisetsky EM, Peterson CB, Byrne CE, et al. Subjective and objective binge eating in relation to eating disorder symptomatology, depressive symptoms, and self-esteem among treatment-seeking adolescents with bulimia nervosa. Eur Eat Disord Rev. 2014;22(4):230–6.

    Article  Google Scholar 

  28. Watson HJ, Fursland A, Bulik CM, Nathan P. Subjective binge eating with compensatory behaviors: a variant presentation of bulimia nervosa. Int J Eat Disord. 2013;46(2):119–26.

    Article  Google Scholar 

  29. Brownstone LM, Bardone-Cone AM, Fitzsimmons-Craft EE, Printz KS, Le Grange D, Mitchell JE, et al. Subjective and objective binge eating in relation to eating disorder symptomatology, negative affect, and personality dimensions. Int J Eat Disord. 2013;46(1):66–76.

    Article  Google Scholar 

  30. Palavras MA, Morgan CM, Borges FMB, Claudino AM, Hay PJ. An investigation of objective and subjective types of binge eating episodes in a clinical sample of people with co-morbid obesity. J Eat Disord. 2013;1(1):26.

    Article  Google Scholar 

  31. Villarejo C, Fernández-Aranda F, Jiménez-Murcia S, Peñas-Lledó E, Granero R, Penelo E, et al. Lifetime obesity in patients with eating disorders: increasing prevalence, clinical and personality correlates. Eur Eat Disord Rev. 2012;20(3):250–4.

    Article  Google Scholar 

  32. Fairburn CG, Bohn K. Eating disorder NOS (EDNOS): an example of the troublesome “not otherwise specified” (NOS) category in DSM-IV. Behav Res Ther. 2005;43(6):691–701.

    Article  Google Scholar 

  33. Eddy KT, Doyle AC, Hoste RR, Herzog DB, Le Grange D. Eating disorder not otherwise specified in adolescents. J Am Acad Child Adolesc Psychiatry. 2008;47(2):156–64.

    Article  Google Scholar 

  34. Nicholls DE, Lynn R, Viner RM. Childhood eating disorders: British national surveillance study. Br J Psychiatry. 2011;198(4):295–301.

    Article  Google Scholar 

  35. Reed GM, Keeley JW, Rebello TJ, First MB, Gureje O, Ayuso-Mateos JL, et al. Clinical utility of ICD-11 diagnostic guidelines for high-burden mental disorders: results from mental health settings in 13 countries. World Psychiatry. 2018;17(3):306–15.

    Article  Google Scholar 

Download references

Acknowledgements

The authors are grateful to the following individuals for their assistance with translation and testing of the study materials: Chinese: CHEN Jue, XU Yong, FAN Qing, JIANG Wenhui, ZHANG Tianhong, Drew Fralick; French: Mimi Israel, Howard Steiger, Ghada El Baky, Samantha Burns; Japanese: Nobuo Kiriike, Hiroko Mizushima, Tetsuji Cho, Naoki Hashimoto, Toshitaka II, Kanna Sugiura, Yuri Sugiura, Masuo Tanaka, Takeshi Yamasaki, Tomoko Yamazaki; Spanish: Florencia Duthu, Alejandro Caballero, Magdalena Ocampo, Carlos Miguel Bueno, Brisa Monroy Cortes, David Ricardo Luna Domínguez. We also thank the other members and consultants to the Field Studies Coordination Group—José Luís Ayuso-Mateos, Wolfgang Gaebel, Oye Gureje, Brigitte Khoury, Valery Krasnov, Anne Lovell, Jair de Jesus Mari, Toshimasa Maruta, María Elena Medina-Mora, Michael C. Roberts, Pratap Sharan, Michael B. First, Maya Kulygina, and Dan Stein—as well as Brigita Baks, Rudolf Uher, Claes Norring, and Per-Anders Rydelius, for their participation in discussions that helped to improve this study and its interpretation.

Funding

This study was funded by the World Health Organization.

Availability of data and materials

The datasets used and analyzed during the current study belong to the WHO. Requests for access to the dataset should be made to the corresponding author and reasonable requests will be presented to the WHO.

Author information

Authors and Affiliations

Authors

Contributions

The study was conceptualized and designed by JWK, GMR, AMC, KMP, and PH. Additional materials specific to eating disorders used in the study were developed by AMC, KMP, PH, RB-W, CRH, PM, DJP, CT, PS, and SA-A. Programming for the study and monitoring of data collection was done by SCE and TJR. Translations into study languages other than English were done by YD, MZ, CM, CRH, BM-M, A-CS, and CSK, all of whom also assisted in testing of non-English versions. Database management was supervised by HFA and data analysis was performed by JWK. The draft manuscript was developed by AMC, KMP, PH, GMR, and JWK, and all authors reviewed the draft and provided comments, contributing to the final version of the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Angélica M. Claudino or Kathleen M. Pike.

Ethics declarations

Ethics approval and consent to participate

All study procedures were exempted from review by the World Health Organization Ethics Review Committee (Protocol ID RPC569) and by the Human Subjects Committee of the University of Kansas (HSCL #20804). University of Kansas servers hosted the survey system used in the study. All participants were presented with an online informed consent document describing the study and had to indicate their consent to participate in order to continue.

Consent for publication

Not applicable.

Competing interests

With the exception of Geoffrey M. Reed, the authors of this article were members of the ICD-11 Feeding and Eating Disorders Working Group, or members of or consultants to the ICD-11 Field Studies Coordination Group for Mental and Behavioral Disorders. Geoffrey M. Reed is a member of the Secretariat, WHO Department of Mental Health and Substance Abuse. The authors alone are responsible for the views expressed in this article, which do not necessarily represent the decisions, policy, or views of the World Health Organization.

Dr. Howard Andrews reports a grant from the WHO during the conduct of the study. Dr. Hay reports personal fees from Shire Pharmaceuticals, personal fees from Wesley Hospital Ashfield NSW, personal fees from NSW Health Education and Training, grants from CAPES Brazil, grants from NSW Health, personal fees from Australian Medical Council, other from BMC Publishing, outside the submitted work; and Member of the ICD-11 Working Group for eating disorders. Views in this paper are personal. Dr. Hay is author of some papers cited in this paper. Dr. Stona reports grants from the French Ministry of Health during the conduct of the study. Dr. Claudino reports grants from Janssen Cilag, Abbot, CAPES, and FAPESP during the conduct of the study. The other authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Claudino, A.M., Pike, K.M., Hay, P. et al. The classification of feeding and eating disorders in the ICD-11: results of a field study comparing proposed ICD-11 guidelines with existing ICD-10 guidelines. BMC Med 17, 93 (2019). https://doi.org/10.1186/s12916-019-1327-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-019-1327-4

Keywords