- Research article
- Open access
- Published:
Participatory design of an improvement intervention for the primary care management of possible sepsis using the Functional Resonance Analysis Method
BMC Medicine volume 16, Article number: 174 (2018)
Abstract
Background
Ensuring effective identification and management of sepsis is a healthcare priority in many countries. Recommendations for sepsis management in primary care have been produced, but in complex healthcare systems, an in-depth understanding of current system interactions and functioning is often essential before improvement interventions can be successfully designed and implemented. A structured participatory design approach to model a primary care system was employed to hypothesise gaps between work as intended and work delivered to inform improvement and implementation priorities for sepsis management.
Methods
In a Scottish regional health authority, multiple stakeholders were interviewed and the records of patients admitted from primary care to hospital with possible sepsis analysed. This identified the key work functions required to manage these patients successfully, the influence of system conditions (such as resource availability) and the resulting variability of function output. This information was used to model the system using the Functional Resonance Analysis Method (FRAM). The multiple stakeholder interviews also explored perspectives on system improvement needs which were subsequently themed. The FRAM model directed an expert group to reconcile improvement suggestions with current work systems and design an intervention to improve clinical management of sepsis.
Results
Fourteen key system functions were identified, and a FRAM model was created. Variability was found in the output of all functions. The overall system purpose and improvement priorities were agreed. Improvement interventions were reconciled with the FRAM model of current work to understand how best to implement change, and a multi-component improvement intervention was designed.
Conclusions
Traditional improvement approaches often focus on individual performance or a specific care process, rather than seeking to understand and improve overall performance in a complex system. The construction of the FRAM model facilitated an understanding of the complexity of interactions within the current system, how system conditions influence everyday sepsis management and how proposed interventions would work within the context of the current system. This directed the design of a multi-component improvement intervention that organisations could locally adapt and implement with the aim of improving overall system functioning and performance to improve sepsis management.
Background
Sepsis is a life-threatening condition where tissue damage, organ failure and death may result due to the body’s own response to infection [1, 2]. It is thought to cause at least six million deaths per annum worldwide, many of which are thought to be preventable with early recognition and treatment [1, 2]. There is international expert consensus that increased awareness, earlier presentation and detection, rapid administration of antibiotics and treatment according to locally developed guidelines can significantly reduce sepsis-related deaths [3, 4]. In secondary care, compliance with care protocols for patients with signs suggestive of sepsis is believed critical to improving outcomes and minimising sepsis-related deaths [5]. However, the implementation of sepsis management interventions has been problematic with only 10–20% of patients receiving care that is fully compliant with intervention recommendations [6, 7].
While a significant amount has been reported about work undertaken within the hospital setting to improve sepsis management, work in primary care is at a much earlier stage but has become a national priority in Scotland [8,9,10,11]. Presentations with infective conditions in this setting are exceedingly common, with only a very small proportion developing sepsis, while initial symptoms of sepsis can be vague—making early, accurate identification of patients who have sepsis or may develop it a challenge [12]. In several high-profile cases, primary care management of patients who had sepsis was thought to be inadequate [13, 14]. Guidelines to aid the identification of acutely ill patients who may have sepsis in primary care have been published that recommend the use of a structured set of clinical observations to stratify the risk of sepsis including pulse, temperature, blood pressure, respiratory rate, peripheral oxygen saturation and consciousness level [10].
Quality improvement (QI) as both a philosophy and suite of methods [15] has underpinned the design of major national preventive efforts to tackle sepsis internationally [16,17,18]. Recent perspectives on QI argue that in complex healthcare systems the design of improvement interventions risks being flawed if there is limited focus beforehand to gain a deep insight into how the system under study actually functions when things go right and wrong [19,20,21,22,23,24,25,26].
Primary healthcare has been described as a complex socio-technical system [28, 30]. Such systems consist of many dynamic and interacting components (e.g. clinicians, patients, tasks, information technology, protocols, equipment and culture) and are affected by rapid changes in conditions (such as patient deterioration, reduced staff capacity, increased patient demand, limited information and availability of resources) [28,29,30,31]. Often, different parts of systems can be closely coupled resulting in changes in one area affecting other areas in a non-linear, unpredictable manner. Rather than being purposively designed, systems of work often emerge and evolve over time due to the interactions between different components. People employ workarounds (for example, when information is not available) and trade-offs (such as when staff have to prioritise task efficiency over thoroughness) to achieve safe care [31,32,33,34]. “Work-as-done” (WAD), including performance adjustments, represents everyday work and is often different from “work-as-imagined” (WAI) as encapsulated in clinical guidelines and protocols and imagined by those in other parts of the system such as senior managers and policymakers.
Healthcare improvement projects to implement recommendations or clinical guidelines are often complex interventions that include multiple interacting and interdependent components; for example, education, new care protocols, new staff roles and new ways of accessing services [19, 20]. There is a growing awareness of the importance of understanding the complexity of current work and considering interactions between proposed interventions and the existing system in the planning and design stages of improvement projects to inform potential success [24,25,26].
The rationale for this study was to explore and better understand how acutely ill patients who may have sepsis are currently identified and managed in the community, obtain multiple perspectives on potential improvement interventions and determine how best these suggestions can inform the design of a system-centred improvement intervention.
Methods
The methods and results of this project have been reported in keeping with current, best practice guidelines advised by Tong et al. [35]. A COREQ checklist (Additional file 1) is included as Table 6 in Appendix 1.
Clinical setting
The study was conducted in a primary care setting within a single, Scottish, regional health board, NHS (National Health Service) Ayrshire and Arran (NHSAA). The identification and management of sepsis is a priority patient safety improvement focus for NHSAA but the best way to design and implement a related intervention in community settings was not clear to local clinical leaders, management and improvement advisors. To access appropriate treatment including antibiotics and fluid management, patients may self-present at the hospital Emergency Department (ED) either by themselves or through telephoning for an ambulance. Alternatively, they may be assessed in the community by a general practitioner (GP) or advanced nurse practitioner (ANP). During normal working hours (8:00 am to 6:00 pm Monday to Friday), clinical assessment is arranged by GP reception staff, while at other times it is arranged by NHS24 (a special national health board within NHS Scotland that provides health information and facilitates patient access to primary care out-of-hours services provided regionally by Ayrshire Doctors On Call (ADOC)). Other healthcare professionals, such as nurses who work in the community and in nursing care homes, can arrange out-of-hours clinical review directly using the single point of contact (SPOC—a non-clinical administrative member of staff who arranges ADOC appointments directly based on the instruction from the healthcare professionals). If, after clinical assessment, it is thought that admission is required, clinicians discuss secondary care assessment with colleagues in the Combined Medical Assessment Unit (CMAU) and then forward documentation summarising their findings and presumed diagnosis and arrange transport.
Study design
A mixed methods approach, including semi-structured interviews, group interviews and documentary analysis, was used to identify system functions and their interactions and output variability to inform a contextually grounded design of a Functional Resonance Analysis Method (FRAM) model [36, 37]. Multiple clinical, management and administrative perspectives on potential system improvements were identified and themed. A participatory design approach [38] using a key stakeholder workshop was then used to reflect on FRAM findings and improvement suggestions and identify and agree improvement interventions based on a systems approach to this issue.
Functional Resonance Analysis Method (FRAM)
The Functional Resonance Analysis Method (FRAM) is one way to begin to model and understand non-trivial, complex, socio-technical systems [36]. The FRAM involves exploring “work-as-done” with frontline workers to identify the “functions” that are being performed. A function is defined as “the activities—or set of activities—that are required to produce a certain outcome” [36]. Identified system functions are entered into the FRAM Model Visualiser software (FMV). FRAM studies the relationships within a system by exploring potential interactions between functions to identify coupling between different parts of the system. To achieve this, links are created between functions by identifying six specific aspects of each function: input, output, preconditions, resources, controls and time factors (Table 1). For example, the output of a function <book appointment> is <appointment booked> which is a precondition of the function <perform clinical assessment>. A key component of the FRAM is to study and record the variability of the output of each function. Functional resonance refers to how variability of different functions can combine to produce amplified and unpredicted effects (both wanted and unwanted).
The FRAM is one method to facilitate the adoption of a complex systems approach. Exploring and building a model of work-as-done allows consideration of how people adapt to deal with unexpected clinical presentations, system conditions (such as availability of information or time) and competing goals (such as efficiency and thoroughness). Exploring how these adaptations combine with variability elsewhere in the system encourages a shift from considering systems as linear, where event A causes outcome B in a predictable manner, to adopting a complex systems approach to focus on the relationships between components and how outcomes emerge from these interactions. FRAM has previously been used in healthcare to explore the complexity of the system for taking blood prior to blood transfusion [39] and to guide implementation of guidelines [40] by exploring current work systems with health care professionals to ensure proposed changes were compatible with current ways of working. It is used regularly in parts of Denmark to explore complex systems in order to plan improvements [41].
Real linkages can only be found by looking at the system with a specified set of conditions, such as an event that has occurred or by predicting how a particular event may occur—these are called instantiations. The linkages present in any given instantiation are a subset of all the potential linkages in the FRAM model and can be used to understand how historical events occurred, consider how the system may perform in varying conditions or how system performance may be altered by change to one function. The FRAM also describes variability of function output. This variability, or functional resonance, reflects the normal, everyday variability of function output caused by altering system conditions and the adaptations people employ to continue successful operations in these conditions. Rather than being quantified, variability is recorded as present or not within a function and can be described as too early, on time, too late, not at all, precise, acceptable and imprecise. Resonance (or variability) in one function can combine with resonance in other functions and lead to unpredicted outcomes both positive and negative.
Study participants
A pragmatic, purposive sampling strategy was employed to identify appropriate healthcare professionals working in primary, secondary and interface care settings with experience and knowledge of their part of the NHSAA Sepsis identification and management system who were then invited to participate in semi-structured interviews. Twenty-two healthcare professionals and administrators were contacted by email and all agreed to participate. Fifteen interviews were completed (Table 2).
To assess variability of functions, ADOC were asked to provide relevant out-of-hours data and a pragmatic, convenience sample of NHSAA general practices was approached to provide in-hours data (Table 3). Twenty (of 55 NHSAA) general practices were asked to provide data on recent admissions of which eight practices returned requested data (40%).
Data collection and analysis
The following data collection, interpretation and analytical methods were applied to enable construction of a preliminary FRAM Model, identify and theme improvement suggestions and design an improvement intervention.
Semi-structured interviews
Fifteen semi-structured, face-to-face, individual (n = 11) and group (n = 4) interviews were conducted at the participants’ place of work by DM. Only DM, who is a GP in the area and an experienced qualitative researcher, and the participants were present during interviews, and no repeat interviews were conducted. The duration of interviews was from 22 to 54 min. Study aims were explained and a definition of sepsis was provided to participants. Interviews were informed by an inductive approach [42] and structured in design to ensure data collection identified functions and their aspects to construct the FRAM model and suggestions for system improvement.
GP in-hours data
Participating GP practices (n = 8) provided data on their last ten admissions for adults with a presumed infective cause (chest infection, urine infection, cellulitis or other presumed infective cause based on the recorded consultation). A worksheet was completed by either a GP within the practice or the practice manager to record if the following were explicitly stated in the admission letter: patient’s pulse, temperature, oxygen saturations, blood pressure, a comment on level of consciousness and if a working diagnosis of sepsis or possible sepsis was noted.
GP out-of-hours data
Anonymised data for all acute hospital admissions was extracted from the ADOC computer system for a full calendar month in 2016 and downloaded to MS Excel Software [Microsoft Corporation, version 12.0 / 2007] for analysis (Table 3). Patients aged 16 or over admitted with a suspected infective cause were identified and selected by the lead author (DM). The Microsoft Excel random number generator was used to select 50 patient cases, which the research team agreed should be sufficient to provide evidence of variability within this part of the system.
Identification of system functions and aspects
All individual and group interviews with participants were audio-recorded and transcribed with consent. A systematic and iterative approach to analysis of the interview data based on the constant comparative method was adopted [43]. Transcription text was read and re-read by DM to facilitate a deep understanding of the data. Functions required in the current system for the identification and management of sepsis were identified and treated as themes. Responses were coded within QDA Miner [Provalis Research, Montreal, Canada, Version 1.4.6.0, 2002] based on these themes. The data for each theme was analysed to identify aspects of each function. All data were cross checked with other authors with any disagreements resolved by discussion until consensus was achieved. Finally, system functions and aspects were uploaded to FMV software [Zerprize, New Zealand, Version 0.4.1, 2016].
Assessment of variability of function output
Variability of function output was assessed through analysis of interview data for reported variability in function output. In addition, out-of-hours and in-hours admission data was analysed to determine the number and percentage of patients with each physiological parameter recorded, the number and percentage with all parameters recorded and the median number of physiological parameters recorded per patient. The median was calculated as it was thought that some practices may have either very high or very low levels of recording physiological parameters [44]. For out-of-hours admissions, the use of an electronic template for recording observations and priority (1, 2 or 4 h) assigned by NHS24 was recorded. This was determined for all patients and separately for those with a presumed diagnosis of sepsis. Variability of function output was entered into the FMV software.
Design of improvement intervention
A separate thematic analysis identified suggested areas for system improvement. Suggestions from interviewees were coded in QDA Miner by DM and arranged into themes through discussion of codes by authors (DM, JF and CB). A workshop was held for key local stakeholders with primary care management, leadership and frontline clinical roles (n = 6) to both validate the FRAM model and gain consensus on improvement priorities and strategies. Through discussion, the FRAM model was used to reconcile improvement suggestions with work-as-done and consensus was sought on the design of an improvement intervention. A Driver Diagram was constructed to link the overall aim of the project with the major improvement drivers identified enabling a multi-component improvement intervention strategy to be designed [45]. Consensus was deemed to have been reached when full agreement was achieved by all attendees.
Results
FRAM model
Fourteen foreground system functions were identified with description of the function and output variability outlined in Tables 4 and 5 (Fig. 1). Seventeen background functions were required to complete the FRAM model of which the key stakeholder group felt ten were relevant to discussions on improvement intervention design. For example, the function <Create guidance on KIS completion> was not the focus of the FRAM; therefore, its aspects were not explored, meaning it only had an output and was thus a background function. It was considered relevant in the design of the improvement intervention as change to this function may influence the function <Create and maintain KIS>. In contrast, it was thought that an intervention would be unlikely to influence the background function <Manage staff capacity> and so this was not included in the FRAM model that was discussed.
Co-design of improvement intervention
Six improvement intervention themes were identified comprising of (1) feedback to facilitate reflective learning, (2) improving communication pathways, (3) use of early warning scores, (4) improving electronic template for recording physiological parameters, (5) provision of sepsis education and (6) improving KIS completion.
-
1)
Feedback to facilitate reflective learning
Many of the professionals interviewed stated that they wanted feedback on their own practice to facilitate learning but this was rarely given. A system-based reflective tool was developed to direct practice teams to reflect on their current systems. This could be used to investigate events when patients were diagnosed with sepsis or to prospectively examine their systems and share learning within teams on how they manage difficult system conditions. The tool provided data from the FRAM to encourage individual and team reflection on their role in the overall system and how this influences other parts of the system. This included how work-as-imagined and work-as-done differ in areas such as arranging clinical review, assessing patients and communication across interfaces.
For example, practice teams were encouraged to analyse their own recording of physiological parameters and compare this to the data collected when constructing the FRAM. It was felt that recording, interpreting and communicating the individual physiological parameters was essential to successfully recognise and manage patients who may be at risk of sepsis. This is demonstrated in the FRAM model which shows that the function <record observations> links to four other functions (<decide to admit patient>, <communicate with secondary care>, <transfer patient to secondary care> and <assess in secondary care>). Variability in this function could influence all of these functions (Fig. 2).
Clinicians were much more likely to record physiological parameters in an out-of-hours setting than an in-hours setting. This was due to feeling that out-of-hours work was riskier as they did not know the patients as well as those seen in their own practices during normal in-hours working.
I feel in out of hours you don’t know the patient so well so I am very precise in out of hours of recording observations and I think it would be a good idea if more people did that. GP1
When patients were admitted and the diagnosis was thought to be sepsis, it was less likely that all physiological parameters were recorded. Clinicians recognised that this was due to employing an efficiency thoroughness trade off based on making a rapid decision to quickly admit patients who appeared acutely ill and so did not record all parameters.
I saw this man on a visit and from the moment I walked in I knew I was admitting him. We had the information that he was getting chemo and was a bit shaky. I did his temp and pulse and thought – right you’re going in – so I didn’t do the other values. GP2
Although this is an effective trade-off from the GP perspective, this physiological information is considered extremely important when the patient is assessed in secondary care which was not fully appreciated by those in the community.
I think if there has been abnormal physiology it is useful to have that documented. AE
Teams were asked to reflect on their own data and the presented data to consider if changes to local systems were required. Trade-offs and performance variability are needed in complex healthcare systems, but it is essential that we understand the potential effects at a local and wider system level through exploring and understanding the system [34, 46].
-
2)
Communication pathways
Physiological parameter values were important when the patient is assessed in hospital (Fig. 2). The results of this project fed into existing work-streams on communication between primary and secondary care. During telephone admission calls to the secondary care combined assessment unit, all physiological parameters will routinely be requested by receiving staff. This allows a degree of flexibility for community staff while still encouraging communication of all parameters.
-
3)
Use of early warning scores
Although early warning scores have been endorsed as a way to detect acute illness due to sepsis, there were mixed opinions on the use of early warning score.
There is much more of a push to do observations which I think gives you more of an objective measurement which might push someone towards a potential sepsis rather than just an unwell diagnosis and make you act a bit more promptly. GPST3
I think [a score] gives you more weight to make the decision that this person is unwell - Even young people for example could be septic and still look alright you know. GP4
I don’t think it would change what I do much it would just be more to stimulate me to remember more things. GP2
Yeah and I think a lot of the times when you have this scoring system we are taking away people’s common sense it is just a scoring system, it’s just a helpful tool it shouldn’t replace your clinical judgement. CAU senior nurse
There is less evidence for the use of a “one off” early warning score in the community to identify patients with possible sepsis as opposed to repeatedly recording early warning scores to identify clinical deterioration of a patient. It was felt that the use of an early warning score did not fit with the way that GPs currently worked as they were more likely to consider the whole clinical situation. They felt that the interpretation of parameters and the communication of concern between health professionals were more important than the calculation of the score which also increased workload.
You have got to put it together with other observations and clinical picture and the history it gives you more weight, it is all about picking up things that help you make your decision. GP4
There was concern by some clinicians that if early warning scores were used as part of a QI intervention, compliance would be rigidly monitored reducing scope for clinicians to adapt their behaviour to suit the patient in front of them and the work conditions experienced. Instead, a less rigid approach was recommended focussing on the social aspects of communicating across interfaces and providing opportunity for feedback to encourage reflection on when and why to record physiological parameters.
But people want every box ticked. Because someone will audit it, someone will look at it and then they will come round and go like we have had a complaint from a patient who had a sore throat turned out two days later he had quinsy you don’t seem to have recorded saturations on him. GP1
Despite this, it was agreed that the early warning score may be useful to communicate with professionals in other parts of the system, for example, ambulance services or community nurses. To test this, a pilot project was planned involving community nurses using early warning scores to assess patients and communicate with clinicians in an out of hours setting. Study of the FRAM allowed anticipation of potential problems when implementing these changes by identifying functions that would be influenced by the intervention (Fig. 3). Systems need to be in place to ensure availability of resources such as thermometers and oxygen saturation monitors for community nurses. The output of community nurse assessment will direct the priority of clinical review required. Communication and escalation policies will be required to direct this process for the single point of contact and clinicians.
-
4)
Electronic template for recording physiological parameters
The existing electronic templates were non-intuitive and did not fit with the way work was currently done. Because of this mismatch, clinicians used workarounds such as hand-writing values or typing them into the electronic record as free text. The template available on the in-hours system was considered more useful as it provided information to aid interpretation of results but it often still took time to find and open. Some practices had created shortcuts to allow its use within the consultation—a code, that when typed, automatically opened the template. The out-of-hours template was rarely used as values had to be entered after the clinician had left the patient and so any guidance from the template came too late.
The out-of-hours template makes it more difficult – you see it when you are back in the car writing up the case after you have made your decision – it’s too late. I think if it was quick, easy and straightforward you might get better recording (of observations). GP2
The stakeholder group recommended the design of an electronic template that fits with the current work to make its use as simple as hand written notes or free text entries. Work is underway to develop a template to alert clinicians in real time to abnormal physiological parameters that may prompt recording of all relevant parameters with automatic calculation of an early warning score.
-
5)
Provision of sepsis training
By exploring multiple perspectives, the FRAM helped identify the conditions of work that result in divergence of work-as-imagined by clinicians and work-as-done by administrative staff. Clinicians generally thought that their administrative staff could accurately identify patients who may need early assessment and knew how to arrange this. However, administrative staff felt that they had no training or guidance on how to identify patients who may be at risk of sepsis and often had no clear advice on how to arrange rapid review.
In general, our staff are good at saying this person doesn’t sound well and they are concerned and they don’t call often and they let us know so they will put it onto the emergency doctor. GP3
I don’t know if I would necessarily recognise it in a patient coming in because a lot of it is like fever and sickness - it could be anything. Training or a checklist may help. Receptionist 2
System conditions affected the output of the function describing staff arranging clinical review and so, even with training, staff may not be able to successfully identify and deal with patients who may have sepsis. This information was used to design educational materials that accompany the system-based reflective tool. The aim is to allow teams to consider how the sepsis education material can be applied in their own setting to improve care. For example, if staff are more aware of the vague symptoms that may indicate risk of sepsis (such as confusion) they need a way to raise their concerns with clinical staff and the clinical staff need a way to respond flexibility dependent on the situation (such as knowledge of patient and competing priorities).
It can be quite hard on a Monday morning when you have got lots of patients waiting for an on-the-day appointment and we just get a sea of people it would be quite hard to say then could you give me indication of the problem. Receptionist 2
I think it is easy for us to recognise someone that comes in with chest pains rather than someone who comes in with sepsis. Receptionist 1
I need to be able to go to someone comfortably and say I am just raising this. To make you aware as I am concerned. Receptionist 2
-
6)
KIS completion
The importance of the Key Information Summary became clear when interviewing professionals in different parts of the system and was demonstrated within the FRAM model (Fig. 4). Work was already underway locally to improve KIS completion in terms of identifying patients appropriate for KIS completion and recording relevant details such as usual oxygen level, pulse, blood pressure, level of confusion and wishes regarding ceilings of care. The FRAM model was used to inform further work in this work-stream as well as providing evidence in the system-based reflective tool of the importance of this task elsewhere in the system.
I think it is variable sometimes it is excellent (the KIS) and it makes such a difference - and then other times it isn’t - and I think that is probably one of the reasons why it is not being accessed strategically because it is not the easiest or quickest thing to get into and it is almost like it is a bit like a lottery if you get one that is going to help you or not. AE consultant
I know it is hard to find the time during the day to complete these (KIS) but in OOH the most important things I have is background observation and base line observations. GP
It was also identified that the KIS was not available when the SPOC was used to refer patients to primary care out-of-hours clinicians. Information Technology systems were altered to solve this problem.
Following consideration of each improvement theme, consensus was reached on the design of a Driver Diagram and multi-component improvement intervention (Figure 5, Appendices 1 and 2). It was agreed that the overall purpose of the system was the identification and management of sepsis in the community. The boundary of the system for improvement excluded NHS24 as this was a national organisation over which we would have little influence.
Discussion
In this paper, we described how a FRAM model of the complex system to identify and manage sepsis in primary care was constructed to understand how conditions of work and system interactions influenced everyday work in a regional NHS Board. This information directly allowed reconciliation between improvement suggestions from frontline staff and current works systems and informed the design of a multi-component improvement intervention to improve overall system functioning.
Despite the complex systems that exist in healthcare, many improvement projects fail to take a “systems approach”, or misunderstand and misapply this concept. Many seek to introduce new procedures in a top-down manner or implement change and improvement at the level of individual performance through, for example, audit and feedback strategies [24, 47]. As a result, the focus of many interventions has been on single-system components such as performing a clinical assessment more reliably or effectively [48,49,50,51]. Improvement interventions often target the person through education and training, protocol dissemination or recommend the use of a tool or technology, such as an IT template or early warning scores [49,50,51]. Educational interventions alone are considered weak as they depend on memory of training whereas introducing tools or technology to aid recall is considered to be of intermediate strength as an improvement intervention [52]. Evaluation of such interventions involves measuring compliance (of the component targeted) with the proposed change. It is thought that this attempt to reduce process variation will improve health outcomes [53]. However, the evidence frequently demonstrates that these types of interventions often fail to have the sustainable impact anticipated leading to missed opportunities to improve system performance and reduce avoidable patient harm [28].
Rather than persisting with linear, cause and effect approaches, the use of a complex system lens may help to maximise the impact of improvement interventions [26, 27]. One way to do this is to engage the people in the system who are expert at doing the work to both understand the system and identify potential improvements [26]. In this way, improvement strategies can be co-designed that consider important contextual factors when implementing change and include strategies to support local adaptation to cope with the conditions faced [34, 54]. In this study, the interventions did not over specify work by mandating and measuring the use of early warning scores but encouraged recording and communication of physiological parameters while allowing clinicians to adapt if needed based on the conditions they experience. The edges of systems are blurry and interact with other systems [26]. As such, treating sepsis identification as a standalone system, and educating administrative staff on its identification, is unlikely to be effective unless consideration is given to the other task they are doing and the other systems with which they are interacting. We believe that the method described in this study is one way to involve multiple perspectives in the co-design of change and will add value to existing quality improvement methods.
It may be argued that simply discussing implementation of the improvement suggestions with a multidisciplinary team would yield similar results. The benefit of using the FRAM is that it allowed the qualitative and quantitative data to be synthesised and the whole system to be conceptualised. By identifying the conditions and interactions that influence work and cause variable function output, we believe it helped support clinical teams to consider where improvement efforts should be targeted. Constructing the FRAM model is a trade-off between showing all related functions and ensuring that it is useable and understandable. It may be argued that the FRAM could describe many other background functions (such as <manage staff capacity>) and links to other systems (such as <patient obtain access to laboratory results>). FRAM models can be constructed with different levels of resolution. For example, if the function <process request for clinical assessment – GP surgery> was the main object of improvement, this could be broken down to include all the functions needed to complete this task, such as <answer the telephone>. This has potential to increase the complexity of the FRAM model by identifying more interrelated functions. The level of detail required is dependent on the data collected and validated by those doing the work. If links to other systems significantly influence work in the system under study, then they should be included, and if variability in a specific task within a function (such as how the telephone is answered) is important, then it should be included as a separate function [36].
Consensus already exists on how improvement interventions should be described and reported [55, 56] and recent recommendations to improve the design of improvement interventions in complex systems have been published [23]. These include rigorously defining the problem, co-designing improvement interventions, use of a programme theory and considering the interaction between the social and the technical aspects of change. We have described one way to rigorously explore and understand the system to identify potential problems by exploring local work-as-done by frontline staff—for example, expected actions of administrative staff when patients present with possible sepsis and the lack of community nursing equipment. Improvement ideas were generated and interventions co-designed with frontline staff. The reflective sepsis tool promoted co-design of specific practice level interventions. It may be argued that this will produce a new work-as-imagined from which people will have to vary when conditions change in an unexpected way. However, the tool encourages repeated team reflection on performance to understand different perspectives on how the system functions and will support further adaptation to guidance to bring work-as-imagined and work-as-done closer.
The FRAM explored how the system worked and how interactions, resources, controls and time influence output. This allowed us to develop a programme theory, presented in the Driver Diagram (Fig. 2), that defines how interventions may lead to overall system improvement and how each intervention could be evaluated [57]. This will be used by local teams to learn about and adapt local processes to maximise success and is currently being piloted. As recently recommended for improvement interventions in complex systems, we have agreed a measurement of the final outcome of interest allowing for local adaptation of processes to create success [46].
The participatory approach we adopted helped us to explore the social and technical aspects of change. Increasingly, the use of risk stratification and early warning scores are being promoted in primary care but there is little evidence of their benefit as part of a one-off pre-hospital clinical assessment [9, 10]. The key stakeholder group felt that the social “processes” that lead to the interpretation and communication of the output of these tools (the actual physiological parameters and an indication of clinical condition) are what will ultimately influence the quality and safety of care [58].
Many factors that should be considered to maximise implementation and sustainability of improvement interventions within complex system have been described [59]. These include how the intervention fits with current work, demonstrating the benefits of the intervention and the ability to adapt it to local conditions [59]. Considering these factors can help understand why measuring the use of early warning scores as a quality improvement process measure was rejected by the key stakeholder group. The current electronic templates are not simple to use and do not fit with the way work is currently done. The benefits were not obvious to community clinicians—although there may be benefits in other parts of the system. There was also concern that if they were used as part of a QI intervention, compliance would be rigidly monitored reducing scope for clinicians to adapt their behaviour to suit the patient in front of them and the work conditions experienced. Instead, a less rigid approach was recommended focussing on the social aspects of communicating across interfaces and providing opportunity for feedback to encourage reflection on when and why to record physiological parameters.
This study has several limitations. First, several key stakeholders were not involved—most notably patients, home care teams and the Scottish Ambulance Service. We did not know if this approach would work and wished to initially test it with healthcare professionals. Better integrated patient participation will be sought to develop the improvement intervention design. The study included small numbers of participants in each professional group. This did not present a problem in the construction of the FRAM model and it appeared that data saturation was achieved for improvement suggestions. However, with more participants, it is possible other ideas for change may have been generated. The FRAM model was constructed based on work-as-disclosed by participants and observation of actual work may have revealed other ways of working. Interviewees may have been guarded in their description of how they completed work as they were speaking to a local GP; however, this made access to participants’ easier and improved understanding of contextual factors such as the limitations of existing electronic templates. Transcripts were not returned to participants for checking. Data from NHS24 only included patients who received an out-of-hours clinician review, and did not include how often an emergency ambulance was called. It may be that NHS24 identify most patients with sepsis and arrange ambulance transport. Nevertheless, it allowed assessment of the variability of output of the function of arranging clinical review that may delay transfer to hospital. Similarly, the low rate of GP practice participation in data collection may mean levels of recording are not representative but they do demonstrate variability which was the main objective. The stakeholder meeting held to agree the improvement intervention did not include representation from all staff groups but their perspective was considered through the discussion of the suggested improvement interventions. The methods used to explore and understand the system require considerable experience and time investment that will not be available in all improvement projects. FRAM model construction through facilitated group discussion is successfully used elsewhere and this may be a more time efficient method to allow wider application and inclusion of more participants from each professional group [40, 41]. This method has only been used to design the intervention, and future evaluation of the intervention is required. Similarly, the method has only been tested in a single regional health board and further evaluation of its application in different settings is required. A full evaluation of the impact of this approach is planned and further research on the application of this method in different healthcare areas is required.
Conclusion
We have demonstrated the use of FRAM in a complex system to aid the design of a quality improvement intervention for identifying and managing sepsis in a single regional NHS board. This allowed an exploration of how conditions and interactions influence performance and output and how improvement suggestions from frontline staff could be reconciled with current work systems.
Abbreviations
- ADOC:
-
Ayrshire Doctors on Call
- ANP:
-
Advanced nurse practitioner
- CMAU:
-
Combined Medical Assessment Unit
- COREQ:
-
Consolidated criteria for reporting qualitative research
- ED:
-
Emergency department
- FMV:
-
FRAM Model Visualiser
- FRAM:
-
Functional Resonance Analysis Method
- GP:
-
General practitioner
- GPST3:
-
General Practitioner Specialty Trainee 3
- KIS:
-
Key Information Summary
- NHSAA:
-
National Health Service Ayrshire and Arran
- QI:
-
Quality improvement
- SPOC:
-
Single point of contact
- WAD:
-
Work-as-done
- WAI:
-
Work-as-imagined
References
National Confidential Enquiry into Patient Outcome and Death. Sepsis: just say sepsis! (2015) http://www.ncepod.org.uk/2015sepsis.html. Accessed 11 Sept 2018.
Fleischmann C, Scherag A, Adhikari NKJ, et al. Assessment of global incidence and mortality of hospital-treated sepsis: current estimates and limitations. Am J Respir Crit Care Med. 2016;193:259–72.
Reinhart K, Daniels R, Kissoon N, Machado FR, Schachter RD, Finfer S. Recognizing sepsis as a global health priority—a WHO resolution. N Engl J Med. 2017;377(5):414–7.
Herlitz J, Bang A, Wireklint-Sundstrom B, et al. Suspicion and treatment of severe sepsis. An overview of the prehospital chain of care. Scand J Trauma Resusc Emerg Med. 2012;20:42.
Rivers E, Nguyen B, Havstad S, Early Goal-Directed Therapy Collaborative Group, et al. Early goal-directed therapy in the treatment of severe sepsis and septic shock. N Engl J Med. 2001;345:1368–77.
Delaney A. Protocolized sepsis care is not helpful for patients. Crit Care Med. 2017;45(3):473–5.
Schlapbach LJ, Javouhey E, Jansen NJG. Paediatric sepsis: old wine in new bottles? Intensive Care Med. 2017;43(11):1686–9.
The Scottish Patient Safety Programme. Scottish Patient Safety Programme in Primary Care. http://www.scottishpatientsafetyprogramme.scot.nhs.uk/programmes/primary-care. Accessed 11 Sept 2018.
Gilham C. Sepsis: the primary care focus. Br J Gen Pract. 2016;66(644):120–1.
National Institute for Health and Care Excellence (NICE). Sepsis: recognition, diagnosis and early management. London: National Institute for Health and Care Excellence (NICE); 2016.
Esteban A, Frutos-Vivar F, Ferguson ND, et al. Sepsis incidence and outcome: contrasting the intensive care unit with the hospital ward. Crit Care Med. 2007;35(5):1284–9.
NHS England Cross Systems Sepsis Prevention Programme Board. In: NHS England, editor. Improving outcomes for patients with sepsis: a cross-system action plan. London: NHS England; 2015.
Health Service Ombudsman. Time to act: severe sepsis rapid diagnosis and treatment saves lives. London: Parliamentary and Health Service Ombudsman; 2014.
Health Service Ombudsman. An avoidable death of a three year old. London: Parliamentary and Health Service Ombudsman; 2014.
Cork N, Rooney KD, Carson-Stevens A. When I say… quality improvement. Med Educ. 2017;51(5):467–8.
Gatewood MO, Wemple M, Greco S, et al. A quality improvement project to improve early sepsis care in the emergency department. BMJ Qual Saf. 2015;24:787–95.
Levy MM, Dellinger RP, Townsend SR, Linde-Zwirble WT, Marshall JC, Bion J, et al. The surviving sepsis campaign: results of an international guideline-based performance improvement program targeting severe sepsis. Intensive Care Med. 2010;36(2):222–31.
Ferrer R, Martin-Loeches I, Phillips G, Osborn TM, Townsend S, Dellinger RP, et al. Empiric antibiotic treatment reduces mortality in severe sepsis and septic shock from the first hour: results from a guideline-based performance improvement program. Crit Care Med. 2014;42(8):1749–55.
Craig P, Dieppe P, Macintyre S, Michie S, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–9.
Kaplan H, Brady P, Dritz M, Hooper D, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Millbank Q. 2010;88:500–9.
Parry GJ, Carson-Stevens A, Luff DF, McPherson ME, Goldmann DA. Recommendations for evaluation of health care improvement initiatives. Acad Pediatr. 2013;31(13 Supple 6):23–30.
Marshall M, de Silva D, Cruikshank L, et al. What we know about designing an effective improvement intervention (but too often fail to put into practice). BMJ Qual Saf. 2017;26(7):578–82. https://doi.org/10.1136/bmjqs-2016-006143.
Lau R, Stevenson F, Ong BN, et al. Achieving change in primary care—effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews. BMJ Open. 2015;5:e009993. https://doi.org/10.1136/bmjopen-2015-009993.
May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016;11:141.
Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Medicine. 2018;16:95 https://doi.org/10.1186/s12916-018-1089-4.
Braithewaite J, Chirruca K, Long J, Ellis LA, et al. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Medicine. 2018;16:63 https://doi.org/10.1186/s12916-018-1057-z.
The Health Foundation. Evidence scan: complex adaptive systems. London: The Health Foundation; 2010.
Braithwaite J, Clay-Williams R, Nugus P, Plumb J. Health care as a complex adaptive system. In: Hollnagel E, Braithwaite J, Wears R, editors. Resilient health care. Surrey: Ashgate Publishing Limited; 2013.
Litaker D, Tomolo A, Liberatone V, Stange K, et al. Using complexity theory to build interventions that improve health care delivery in primary care. J Gen Intern Med. 2006;21(Suppl 2):30–4.
Hollnagel E. Safety-I and safety-II the past and future of safety management. Surrey: Ashgate Publishing Limited; 2014.
Tucker AL, Spear SJ. Operational failures and interruptions in hospital nursing. Health Serv Res. 2006;41(3part1):643–62.
Hollnagel E. The ETTO principle: efficiency-thoroughness trade-off: why things that go right sometimes go wrong. London: Ashgate Publishing Limited; 2009.
McNab D, Bowie P, Morrison J, Ross A. Understanding patient safety performance and educational needs using the ‘Safety-II’ approach for complex systems. Educ Prim Care. 2016;27(6):443–50.
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.
Hollnagel E. FRAM: the functional resonance analysis method. Modelling complex socio-technical systems. Surrey: Ashgate publishing limited; 2012.
The Functional Resonance Analysis Method: FRAM Model visualiser. http://functionalresonance.com/FMV/index.html. Accessed 11 Sept 2018.
Hignett S, Wilson JR, Morris W. Finding ergonomic solutions—participatory approaches. Occup Med. 2005;55:200–7.
Pickup L, Atkinson S, Hollnagel E, Bowie P, et al. Blood sampling—two sides to the story. Appl Ergon. 2017;59(Pt A):234–42.
Clay-Williams R, Hounsgaard J, Hollnagel E. Where the rubber meets the road: using FRAM to align work-as-imagined with work-as-done when implementing clinical guidelines. Implement Sci. 2015;10:125. https://doi.org/10.1186/s13012-015-0317-y.
Hounsgaard J. Patient safety in everyday work: learning from things that go right. 2016 http://functionalresonance.com/onewebmedia/Hounsgaard%20(2016).pdf. Accessed 11 Sept 2018.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.
Glaser BG, Strauss AL. The discovery of grounded theory: strategies for qualitative research. Chicago: Aldine; 1967.
British Medical Journal. Statistics square one - 1. Data display and summary. http://www.bmj.com/about-bmj/resources-readers/publications/statistics-square-one/1-data-display-and-summary. Accessed 11 Sept 2018.
Institute for Healthcare Improvement. Driver Diagram Available at http://www.ihi.org/resources/Pages/Tools/Driver-Diagram.aspx. Accessed 11 Sept 2018.
Young RA, Roberts RG, Holden RJ. The challenges of measuring, improving, and reporting quality in primary care. Ann Fam Med. 2017;15(2):175–82.
Ivers N, Jamtvedt G, Flottorp S. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.
Institute for Healthcare Improvement. Science of Improvement: Establishing measures http://www.ihi.org/resources/Pages/HowtoImprove/ScienceofImprovementEstablishingMeasures.aspx. Accessed 11 Sept 2018.
McLaughlin S, Houston N, Winter J. Sepsis in primary care: recognition, response and referral using NEWS. http://www.qihub.scot.nhs.uk/media/969883/stephen%20mclaughlin_25.pdf. Accessed 11 Sept 2018.
Byers G. Recognizing severe sepsis in the pre hospital setting improves the timeliness of antibiotic administration. http://www.qihub.scot.nhs.uk/media/618286/geraldine%20byers.pdf. Accessed 11 Sept 2018.
Ryan L. Early, safe and reliable detection of sepsis in primary care: moving the front door into the community in NHS borders.http://www.qihub.scot.nhs.uk/media/650720/laura%20ryan.pdf. Accessed 11 Sept 2018.
US Department for Veterans Affairs. National Centre for patient safety. Root cause analysis tools. NCPS; 2015. http://www.patientsafety.va.gov/docs/joe/rca_tools_2_15.pdf. Accessed 11 Sept 2018.
The Health Foundation. Evidence scan: QI made simple. London: The Health Foundation; 2013.
Sujan MA, Huang H, Braithwaite J. Learning from incidents in health care: critique from a Safety-II perspective. Safety Sci. 2017;99:115–21.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, Lamb SE, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Ogrinc G, Mooney SE, Estrada C, et al. The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration. BMJ Qual Saf. 2008;17:i13–32.
Foy R, Ovretveit J, Shekelle PG, et al. The role of theory in research to develop and evaluate the implementation of patient safety practices. BMJ Qual Saf. 2011;20:453–9.
Mitchell B, Cristancho S, Nyhof BB, et al. Mobilising or standing still? A narrative review of surgical safety checklist knowledge as developed in 25 highly cited papers from 2009 to 2016. BMJ Qual Saf. 2017. https://doi.org/10.1136/bmjqs-2016-006218.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x.
Carayon P, Hundt AS, Karsh B-T, et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care. 2006;15:50–8.
Acknowledgements
The authors would like to thank all those that participated in interviews, the practices that submitted data, the ADOC staff who collected data and the key stakeholder group who designed the intervention and Julie Anderson, Associate Director Scottish Improvement Science Collaborating Centre for feedback on the paper.
Availability of data and materials
Data is held by DM—permission for public access was not given by participants.
Author information
Authors and Affiliations
Contributions
The project was devised and planned by DM, PB, JF and CB. DM conducted the interviews, coded the data and analysed the quantitative data. DM, JF and CB developed themes from the coded data. All authors contributed equally to develop the improvement intervention. DM produced the first draft of the manuscript and all authors reviewed, edited and revised the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Under UK research governance regulations, ethical review is not required as following application of the Medical Research Council “Decision tool - is it research?” the authors considered this project to be service evaluation.
Consent for publication
We confirm we have consent to publish this information from those involved in the project and NHS Ayrshire and Arran.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file
Additional file 1:
Consolidated criteria for reporting qualitative studies (COREQ): 32-item checklist. (DOCX 16 kb)
Appendices
Appendix 1
Appendix 2
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
McNab, D., Freestone, J., Black, C. et al. Participatory design of an improvement intervention for the primary care management of possible sepsis using the Functional Resonance Analysis Method. BMC Med 16, 174 (2018). https://doi.org/10.1186/s12916-018-1164-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12916-018-1164-x