- Commentary
- Open access
- Published:
Country of qualification is linked to doctors’ General Medical Council performance assessment rate, but is it linked to their clinical competence?
BMC Medicine volume 15, Article number: 149 (2017)
Abstract
Mehdizadeh and colleagues recently described the prevalence of General Medical Council regulatory performance assessments by doctors’ country of primary medical qualification. This article has caused anger within the UK–international medical community because it identifies graduates of certain countries with significantly raised prevalence.
The present article comments on evidence from published Royal College of General Practitioners’ data that support these conclusions. However, in an increasingly international age of medical education, the ambiguity of attributions of qualifying from a certain country needs addressing. Some medical students of British nationality, for example, who fail to obtain a place at a UK medical school, train in medical schools abroad, and thus may be identified as international medical graduates.
Please see related article: https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-017-0903-6.
Background
In the 1970s, significant numbers of doctors who were trained outside the UK joined the National Health Service (NHS). The first tests to assess overseas-qualified doctors were introduced by the General Medical Council (GMC) in 1975. Originally known as ‘TRAB’ (Temporary Registration Assessment Board) tests, these were later renamed ‘PLAB’ (Professional and Linguistic Assessments Board) tests [1]. There has been interest in their clinical performance as assessed by postgraduate examinations (e.g. [2, 3]), and their experiences of disciplinary attention by the GMC. [4].
When the GMC has concerns about a doctor’s performance, it may, as part of its regulatory armamentarium, require him or her to undergo a ‘performance assessment’; a set of assessments tailored to the individual’s level and type of practice. After summarising previous evidence on differential performance, a recent paper by Mehdizadeh et al. [5] analyses new GMC data on doctors who received a GMC performance assessment (PA) between 1996 and 2013 by demographic variables, including country of primary medical qualification (PMQ).
Findings of the study by Mehdizadeh et al.
Highly significant differences were found between the various countries of PMQ, with an incident rate ratio (IRR) of doctors from Bangladesh 13 times higher the UK baseline. Egyptian and Nigerian-trained doctors had an IRR of 8; and for doctors trained in countries acceding to the EU in 2004, the IRR was 4 times that for UK doctors.
However, the authors note that very small actual numbers are represented by these statistics. The reasons for the differences are unclear and need further investigation. They might derive from true differences in competency and training standards, or from differences in the way(s) this group of doctors is treated both by society and employers.
Credibility of the findings: triangulation?
The publication of Mehdizadeh et al.’s data caused understandable dismay among graduates of countries with high IRRs. Within two weeks of the paper’s online publication, a news report appeared in the BMJ [6] in which the president of the British Association of Physicians of Indian Origin (BAPIO) was quoted as saying that the paper was “useless really, it doesn’t mean anything…it is retrospective.” The president also asserted, “it doesn’t say anything about the competence of these doctors.” In a sense, this is correct, as the outcome of the PA was not considered, only the PA referral; however, there must be serious concerns about a doctor’s competence for a referral to have been made.
Is any evidence available that could be used to triangulate the implications of this paper – that those groups with high IRRs and most likely to be called to PAs are clinically less competent? The GMC publishes extensive data on UK medical graduates, and their performance in postgraduate examinations and in Annual Reviews of Competency Progression [7], but does not yet differentiate between PMQ countries. However, the Royal College of General Practitioners does so in its annual statistical report and has done since 2008 [8]. Table 1 contrasts Clinical Skills Assessment (CSA) results in the last year for which data are available (2015–2016) [9] with the data presented in the Mehdizadeh et al. paper for the 10 countries common to both lists.
Calculated from the data in Table 1, the IRR for the 10 PMQ countries common to this paper’s data and those listed in the MRCGP (Membership of the Royal College of General Practitioners) report correlates strongly and negatively with the mean CSA scores (columns E and G; rho = –0.66, P < 0.05), and positively with the associated fail rates (columns E and H; rho = 0.73, P < 0.02). Similar patterns result from correlating the crude PA rates (column D) with the CSA scores (rho = –0.65, P < 0.05) and fail rates (rho = 0.71, P < 0.05); results of the multiple-choice MRCGP applied knowledge test (e.g. rho IRR to AKT fail rate, columns E and I = 0.70, P < 0.05); and in RCGP data from the previous year [10].
Differential performance in the MRCGP assessments by country of PMQ parallels that reported in this paper. The credibility of the order of the presumed clinical competence of doctors from the various countries of PMQ is thus supported; however, as suggested by a court action in 2014 [11], examination performance may not accurately reflect clinical competence.
The problem of expatriate medical students
‘Country of medical training’ does not always equate to ‘country of origin’ or ‘nationality’. UK nationals can train elsewhere, emerging as an ‘International Medical Graduate’ (IMG). Thus IMGs may be British, and it should not be assumed that someone with a qualification from (for example) Cluj Napoca is Romanian.
In GMC research towards a paper on PLAB tests [2], we noted that graduates from a variety of countries (e.g. the Czech Republic, Russia, Romania, Bulgaria) were frequently British nationals. Indeed, the UK was the third largest nationality of PLAB candidates (12%). Browsing internet forums used by medical school applicants, such as The Student Room [12], confirms widespread interest among would-be medical students in these medical schools and success in admission. Given McManus’ notion of ‘the academic backbone’, in which earlier academic attainment predicts later academic attainment [13], it would be unsurprising that applicants rejected from UK medical schools would perform worse in UK postgraduate examinations than those who achieved entry to medicine in the UK. Indeed, we found that UK national candidates required significantly more attempts to pass PLAB Part 1 than those of other nationalities. The first-attempt score on PLAB Part 1 was also significantly lower for UK nationals than non‐UK nationals [2].
The ambivalence of PMQ-to-background attribution is clearly important, though probably a small threat to the findings of studies such as that of Mehdizadeh et al. Researchers must know the nationality of doctors as well as their country of PMQ.
Conclusion: future directions
Simplistic stereotypical analyses of doctors’ behaviour are no longer credible. In the UK, until 1991, English-qualified doctors were most often struck off the Medical Register for sexual shenanigans, while Scottish and Irish-qualified doctors were most frequently struck off for alcohol-related activities. The number of overseas-qualified doctors was then relatively small [14].
Mehdizadeh et al. contribute substantially to our understanding of the predictors (or concomitants) for review of doctors under the GMC’s performance procedures. Differences in the prevalence of referral for PAs by country of PMQ appear supported by quite separate evidence from the MRCGP examinations.
Using qualitative research approaches, explanations should examine the frequently-repeated concerns that unconscious bias “prevalent through much of the NHS,” leading to “disparate treatment of international medical graduates,” may have contributed to differential PA referral rates [6].
Future work could include PA outcomes and pay attention to the nationalities of those referred by the regulator, as well as their country of PMQ. Those who study the detailed results of postgraduate examinations might suggest that the training institutions of qualification, rather than just the country, should form the unit of aggregation in such research. Within its public datasets the GMC should at least include country of PMQ and nationality in its overarching summaries of postgraduate examination performance of all doctors in training.
References
General Medical Council. Report of the working party on the PLAB tests. London: General Medical Council; 1986.
McManus IC, Wakeford R. PLAB and UK graduates’ performance on MRCP (UK) and MRCGP examinations: data linkage study. BMJ. 2014;348:g2621.
Watmough S, Bowhay A. An evaluation of the impact of primary medical qualification on performance in the UK Royal College of Anaesthetists’ Examinations. Med Teach. 2011;33:938–40.
Wakeford R. Who gets struck off? BMJ. 2011;343:d7842.
Mehdizadeh L, Potts HWW, Sturrock A, Dacre J. Prevalence of GMC performance assessments in the United Kingdom: a retrospective cohort analysis by country of medical qualification. BMC Med Educ. 2017;17:67.
Rimmer A. Unconscious bias must be tackled to reduce worry about overseas trained doctors, says BAPIO. BMJ. 2017;357:j1881.
General Medical Council. Progression of doctors in training. 2017. http://www.gmc-uk.org/education/25495.asp. Accessed 18 Jul 2017.
Royal College of General Practitioners. MRCGP annual reports and research. http://www.rcgp.org.uk/training-exams/mrcgp-exams-overview/mrcgp-annual-reports.aspx. Accessed 18 Jul 2017.
Royal College of General Practitioners. MRCGP Statistics 2015–2016. Annual report (August 2015–July 2016) on the results of the AKT and CSA assessments. 2016. http://www.rcgp.org.uk/-/media/Files/GP-training-and-exams/Annual-reports/MRCGP-Statistics-2015-16-Final-Draft-Feb-17.ashx?la=en. Accessed 18 Jul 2017.
Royal College of General Practitioners. MRCGP Statistics 2014-15: Annual Report on the AKT and CSA Assessments. 2015. http://www.rcgp.org.uk/training-exams/mrcgp-exams-overview/mrcgp-annual-reports/mrcgp-annual-reports-2014-2015.aspx. Accessed 18 Jul 2017.
Royal Courts of Justice, Queen’s Bench Division, the Administrative Court. Between: The Queen on the application of Bapio Action Ltd. (Claimant) v Royal College of General Practitioners (First Defendant) and General Medical Council (Second Defendant). 2014. http://www.rcgp.org.uk/news/2014/may/~/media/Files/News/Judicial-Review-Judgment-14-April-2014.ashx. Accessed 18 Jul 2017.
The Student Room. 2017. https://www.thestudentroom.co.uk/. Accessed 18 Jul 2017.
McManus IC, Woolf K, Dacre J, Paice E, Dewberry C. The Academic Backbone: longitudinal continuities in educational achievement from secondary school and medical school to MRCP (UK) and the specialist register in UK medical students and doctors. BMC Med. 2013;11:242.
Wakeford R. Licentious licentiates, medical malfeasants: a study of doctors struck off the medical register for disciplinary reasons 1860–1991. Cambridge Med. 1996;12:10–4.
Acknowledgements
Not applicable.
Funding
No funding was associated with the preparation of this manuscript.
Availability of data and materials
Not applicable.
Author information
Authors and Affiliations
Contributions
RW conceived and authored this paper in response to a request from the journal’s editor for a commentary on the paper by Mehdizadeh et al.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The author declares that he has no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Wakeford, R. Country of qualification is linked to doctors’ General Medical Council performance assessment rate, but is it linked to their clinical competence?. BMC Med 15, 149 (2017). https://doi.org/10.1186/s12916-017-0918-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12916-017-0918-1