- Commentary
- Open access
- Published:
Is it them or is it us? Unravelling ethnic disparities in undergraduate clinical performance
BMC Medicine volume 15, Article number: 190 (2017)
Abstract
Given our increasingly diverse societies, there is an urgent need for research into the causes of persistent ethnic disparities in undergraduate clinical performance. It is argued that causes for underperformance can be identified from two perspectives, namely that of the students (‘them’) and that of the academic environment (‘us’). Taking the ‘us’ perspective, Yeates et al. conducted a detailed experimental study aimed at understanding the processes underlying judgment and decision-making in clinical assessments. Contrary to their expectations, their study indicates that, despite the presence of active stereotypes, examiner bias does not explain ethnic minority students’ underperformance. Naturally, future studies are required to confirm their findings. It is suggested that these studies should take into account various rater and situational factors (e.g. rater experience, increased cognitive load) that may influence examiners’ reliance on stereotypes. However, future work should also focus on other potential impeding factors from both perspectives, including differences in communication styles. Knowing what leads to the ethnic disparities in performance is a prerequisite for designing interventions aimed at ensuring a level playing field for a diverse student population.
Please see related article: https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-017-0943-0
Background
The increase in ethnic and cultural diversity of many western societies in recent decades has resulted in growing numbers of minority group patients and in increasingly diverse student populations in medical schools. As a result of these developments, the field of medical education faces several challenges. The main challenge is that of increasing diversity in the healthcare workforce in order to improve healthcare access and quality for minority patients [1].
Increasing diversity not only serves the cause of social justice, but also makes good business sense [2] since diversity and inclusion lead to excellence [3]. However, the pursuit of increasing diversity is hampered by the persistent ethnic disparities in medical school performance. Numerous studies, including our own [4], have shown that medical students from ethnic minorities underperform compared with those from the ethnic majority, particularly on clinical (rater-based) assessments, even when controlled for prior attainment [4, 5]. As clinical grades are known to play a key role in selection for residency training, lower clinical grades for ethnic minority students may contribute to their underrepresentation in residency training and in the medical workforce. Unfortunately, thus far, little is known about why this underperformance occurs and how to address it [5].
As underperformance can be seen as the result of a mismatch between the student and the academic environment, explanations can be identified from both perspectives, i.e. is it them or is it us? Put differently, do ethnic minority students actually perform worse or do their assessors think they do so? Knowing what leads to ethnic disparities in performance is a prerequisite for designing interventions aimed at ensuring fair clinical grades for ethnic minority students.
Recent evidence
Yeates et al. [6] assessed whether examiners are biased against ethnic minority students, i.e. from the ‘us’ perspective, thus providing information about the potential of examiner bias in an experimental study. Participants, namely UK Objective Structured Clinical Examination (OSCE) examiners, were assigned to watch scripted videotaped OSCE performances by Caucasian and Asian students that were either consistent or inconsistent with a previously described stereotype of Asian students’ performance. Surprisingly, their hypotheses regarding the presence of bias were not confirmed, despite the fact that these originated from a whole body of existing literature from the social psychology domain. The Asian students did not receive lower scores than Caucasian students, and the feedback provided to the Asian students was also not comparatively negative nor more focused on communication skills than that given to Caucasian students.
Nevertheless, using a lexical decision task, Yeates et al. [6] did find evidence of the presence of Asian stereotypes in examiners’ mind. Contrary to their expectations, this occurred regardless of whether examiners observed stereotype-consistent or -inconsistent performances. Furthermore, in absence of a control group, we cannot tell whether the stereotypes were activated by the task at hand or were already present beforehand. In any case, it is remarkable that the presence of active stereotypes did not influence examiners’ scores, their feedback or their memories of performances.
Explanations, implications and further research
Why did Yeates et al. [6] not find an effect of stereotype bias in their study? As suggested by the authors themselves, it might be that the raters were able to resist stereotyping. A theory that can help elucidate how students’ ethnic minority status affects raters’ information processing during assessment is the dual-process theory [7] – one of the most fundamental models on judgment and decision-making in social and cognitive psychology [8]. Dual-process theory distinguishes two information processing modes, namely a fast, automatic mode (‘System 1’) and a deliberate, conscious mode (‘System 2’). System 1 is considered to use mental shortcuts (heuristics), which are prone to cognitive biases. Such biases, including the activation of stereotypes and prejudiced attitudes, might result in lower scores for ethnic minority students [7]. System 2 executes complex cognitive operations and monitors the outcome or responses of System 1. Whether System 2 intervenes in the case of undesirable System 1 impulses depends on situational factors and rater characteristics [7].
Rater factors that might increase reliance on System 1 processes are their prejudiced attitudes, their (perceived) level of experience and their ‘need for cognitive closure’ – a personality characteristic related to being decisive and closed-minded [7]. Meanwhile, (perceived) similarity to the student and concerns about prejudice might decrease a rater’s risk of bias [7]. Building in accountability, structuring the assessment, and the presence of diversity policies and training are likely to stimulate System 2 processes, whereas high cognitive demands and pressure hamper the correction of initial impressions [7].
Thus, it could well be that the sense of professionalism or experience of working with ethnic minority students helped the participants in Yeates’ study to resist reliance on System 1 processes, i.e. stereotyping. On the other hand, one should be aware that experience and a sense of objectivity (‘I think it, therefore it is true’) caused by the ‘position of power’, which is characteristic for medical doctors, could also lead to a stronger reliance on System 1 processes [9]. Future research into unravelling the judgment process of raters should explore the influence of experience and the other mentioned rater and situational factors. For example, what would be the effect of increased pressure and higher cognitive demands (e.g. longer series of student performances) as occurs in actual practice of OSCE examinations? What would happen when ethnic minority students are assessed by ethnic minority raters? Would their scores be higher, similar or even lower due to ‘self-group distancing’ by raters who are individually successful members of their group? [10] Would there be a mitigating effect of the scoring method used?
Another reason why the consistently reported underperformance of ethnic minority students was not confirmed in the study by Yeates et al. [6] may be related to differences in communication styles. Yeates et al. used scripted videos with nearly identical Caucasian and Asian versions. However, the question is whether the communication skills of Asian students in real OSCEs are poorer (as suggested by the described stereotype [11]) or just different. In other words, is there just one correct way of interacting with patients? Do all patients favour the same communication styles? A study by Wass et al. [12] on examiner bias in a final year OSCE suggested that opinions on what was considered good interaction differed between Caucasian examiners and ethnic minority simulated patients. Other studies showed that levels of assertiveness and reticence [13] and patient-centeredness [14] were related to clinical grades. However, even within Western Europe, there are differences in doctor-patient communication preferences [15]. In preparing our future doctors for an increasingly diverse patient population we may have to reconsider the existence of one golden standard for doctor-patient communication.
Conclusions
There is an urgent need for research into the causes of ethnic disparities in undergraduate clinical performance. Yeates et al. [6] responded to the call for more detailed experimental studies to understand the processes underlying judgment and decision-making in clinical assessments. Although their study indicates that examiner bias does not explain ethnic minority students’ underperformance, future studies – preferably taking into account various rater and situational factors (e.g. experience, longer series of performances) – are required to confirm their findings. Additionally, other potential impeding factors from both perspectives, including differences in communication styles, should be studied and accompanied by possible interventions in order to ensure a level playing field for a diverse student population.
References
Betancourt JR. Eliminating racial and ethnic disparities in health care: what is the role of academic medicine? Acad Med. 2006;81:788–92.
Commission S. Missing Persons. Minorities in the Health Professions. 2004. http://www.aacnnursing.org/Portals/42/News/Sullivan-Report.pdf. Accessed 19 Oct 2017.
Nivet M. Diversity and inclusion in the 21st Century: bridging the moral and excellence imperatives. Acad Med. 2012;87:1458–60.
Stegers-Jager KM, Steyerberg EW, Cohen-Schotanus J, Themmen A. Ethnic disparities in undergraduate pre-clinical and clinical performance. Med Educ. 2012;46:575–85.
Woolf K, Potts HWW, McManus IC. Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysis. BMJ. 2011;342:901.
Yeates P, Woolf K, Benbow E, Davies B, Boohan M, Eva K. A randomised trial of the influence of racial stereotype bias on examiners' scores, feedback, and recollections in undergraduate clinical exams. BMC Med. 2017. doi: 10.1186/s12916-017-0943-0
Derous E, Buijsrogge A, Roulin N, Duyck W. Why your stigma isn't hired: A dual-process framework of interview bias. Hum Resour Manage Rev. 2016;26:90–111.
Kahneman D. Thinking, fast and slow. New York: Farrar, Straus and Giroux; 2011.
Uhlmann E, Cohen GL. “I think it, therefore it’s true”: Effects of self-perceived objectivity on hiring discrimination. Organ Behav Hum. 2007;104:207–23.
Derks B, Laar C, Ellemers N, Raghoe G. Extending the queen bee effect: how Hindustani workers cope with disadvanate by distancing the self from the group. J Soc Issues. 2015;3:476–96.
Woolf K, Cave J, Greenhalgh T, Dacre J. Ethnic stereotypes and the underachievement of UK medical students from ethnic minorities: qualitative study. BMJ. 2008;337:a1220.
Wass V, Roberts C, Hoogenboom R, Jones R, Vleuten C. Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study. BMJ. 2003;326:800–3.
Lee KB, Vaishnavi SN, Lau SKM, Andriole DA, Jeffe DB. ‘Making the grade’: Noncognitive predictors of medical students' clinical clerkship grades. J Natl Med Assoc. 2007;99:1138–50.
Hauer KE, Boscardin C, Gesundheit N, Nevins A, Srinivasan M, Fernandez A. Impact of student ethnicity and patient-centredness on communication skills performance. Med Educ. 2010;44:653–61.
van den Brink-Muinen A, Verhaak PFM, Bensing JM, Bahrs O, Deveugele M, Gask L, et al. Communication in general practice: differences between European countries. Fam Pr. 2003;20:478–85.
Acknowledgements
Not applicable.
Funding
KSJ is funded by the Netherlands Organization for Scientific Research (NWO) grant number 451.17.015.
Availability of data and materials
Not applicable.
Author information
Authors and Affiliations
Contributions
KSJ, the sole author of this article, read and approved the final manuscript.
Corresponding author
Ethics declarations
Author information
KSJ holds an MSc in Educational Science and Technology and a PhD in Medical Education. She currently is Assistant Professor at the institute of Medical Education Research Rotterdam, Rotterdam, the Netherlands. Her research focuses on creating equal opportunities for success for non-traditional medical students throughout the medical education pipeline. She recently received a grant to study the role of first impressions in rater-based assessments.
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The author declares that she has no competing interests.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Stegers-Jager, K.M. Is it them or is it us? Unravelling ethnic disparities in undergraduate clinical performance. BMC Med 15, 190 (2017). https://doi.org/10.1186/s12916-017-0959-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12916-017-0959-5