Inappropriate hospital admission as a risk factor for the subsequent development of adverse events: a cross-sectional study
BMC Medicine volume 21, Article number: 312 (2023)
All health overuse implies an unnecessary risk of patients suffering adverse events (AEs). However, this hypothesis has not been corroborated by direct estimates for inappropriate hospital admission (IHA). The objectives of the study were the following: (1) to analyze the association between IHA and the development of subsequent AEs; (2) to explore the distinct clinical and economic implications of AEs subsequent IHA compared to appropriate admissions.
An observational cross-sectional study was conducted on hospitalized patients in May 2019 in a high-complexity hospital in Madrid, Spain. The Appropriateness Evaluation Protocol was used to measure IHA, and the methodologies of the Harvard Medical Practice Study and the European Point Prevalence Survey of Healthcare-associated Infections were used to detect and characterize AEs. The association between IHA and the subsequent.
A total of 558 patients in the hospital ward were studied. IHA increased the risk of subsequent occurrence of AEs (OR [95% CI]: 3.54 [1.87 to 6.69], versus appropriate) and doubled the mean AEs per patient (coefficient [95% CI]: 0.19 [0.08 to 0.30] increase, versus appropriate) after adjusting for confounders. IHA was a predictive variable of subsequent AEs and the number of AEs per patient. AEs developed after IHA were associated with scheduled admissions (78.9% of AEs, versus 27.9% after appropriate admissions; p < 0.001). Compared with AEs developed after appropriate admissions, AEs after IHA added 2.4 additional days of stay in the intensive care unit and incurred an extra cost of €166,324.9 for the studied sample.
Patients with IHA have a higher risk of subsequent occurrence of AE. Due to the multifactorial nature of AEs, IHA is a possible contributing factor. AEs developed after IHA are associated with scheduled admissions, prolonged ICU stays, and resulted in significant cost overruns.
Health overuse consists of the provision of health services in which the potential harm to the patient exceeds the possible clinical benefit . One form of presentation is inappropriate hospital admission (IHA), a parameter evaluated in the Appropriateness Evaluation Protocol (AEP) questionnaire . This validated tool, which was developed by Gertmann and Restuccia , has wide international acceptance due to its diagnostic-independent application . In a recent meta-analysis, the frequency of IHA ranged from 8.4 to 17.1% , implying a considerable reduction in the availability of hospital beds .
Definitions establish that health overuse involves unnecessary risks for patients [6, 7]. These risks can cause adverse events (AEs), defined by The World Health Organization as any safety incident derived from health care that causes harm, suffering, disability, or death of a patient . The most accepted methodology for the detection of AEs was developed by Brennan et al. and used in the Harvard Medical Practice Study (HMPS) . At the global level, AEs are an important public health problem, as they occur in 10–12% of hospitalized patients [10,11,12] and approximately 48% of AEs have a moderate-severe impact on the clinical course of patients . In addition, they also represent an important risk for the sustainability of the health system; it has been estimated that AEs could result in an additional cost of more than 1 billion dollars per year , and it has been reported that AEs are related to filing claims and the second and third victim phenomenon .
Healthcare-associated infections constitute 30–40% of all AE and are associated with the worst healthcare outcomes for the patient in terms of comorbidity and length of hospital stay [16, 17]. For their identification, the European Centre for Disease Prevention and Control has developed the specific methodology European Point Prevalence Survey for healthcare-associated infections (PPS), which has estimated prevalence values in Europe between 6 and 10% [18, 19].
The assumption that health inappropriateness implies a greater risk for patients is a globally accepted premise [6, 7]. However, this hypothesis has not been fully corroborated by direct estimates. To date, this is the first study that analyzes a possible association between IHA and the subsequent development of AEs, and that calculates the magnitude of this association through direct estimates. In addition, through a review of medical records, this work analyzes whether IHA influences the clinical and economic impacts of AEs. For this, in a pioneering approach, the AEP, HMPS, and PPS methodologies are combined and applied to the same sample, with models adjusted for clinical and epidemiological variables, intrinsic risk factors (IRFs), and extrinsic risk factors (ERFs), not considered in previous studies of the inappropriateness of hospitalization use.
Therefore, this study has the following aims: (1) to analyze if IHA is associated with developing subsequent AEs; (2) to explore the distinct clinical and economic implications of AEs subsequent IHA compared to appropriate admissions.
Design, measurement instruments, and sample selection
This was an observational study with a cross-sectional design. The study setting was a high-complexity hospital with a capacity of 901 beds and 45 operating rooms. Throughout the second week of May 2019, a cross-section of hospitalized patients was obtained for each of the hospital care units. The exact date of the cutoff varied depending on each unit, but the final sample included all patients hospitalized in the center. This work was framed within the Patient Safety Incident Study of Hospitals in the Community of Madrid (ESHMAD) [17, 20], a multicenter patient safety study based on the HMPS methodology . The study, carried out with a cross-sectional design, aimed to include in a subsample the measurement of IHA  and, finally, to analyze their association with the subsequent development of AE. Therefore, both were analyzed in the entire subsample. A sample size calculation was not made for this phase due to the lack of previous evidence of the association level of IHA with AEs.
Five validated instruments were used in conjunction with a review of the clinical history of each patient: two versions of the AEP to measure IHA, two tools derived from the HMPS methodology to measure and analyze AEs , and the PPS [18, 21] as an additional screening for identifying healthcare-associated infections.
AEP for admissions : for the measurement of IHA in adult patients. This tool was developed to assess the unnecessary days of hospitalization. The version used includes 16 items related to the clinical status and care needs of the patient to be checked at the moment of admission, which would make it appropriate. If a patient does not meet any of the items, his or her admission is considered inappropriate. The kappa of the tool used was over 0.85 in its validation  (Additional file: Table S1).
Screening Review Form (SRF): for the screening of AEs from the identification of alert situations in the clinical history. This instrument was developed by the HMPS study . The translated version of the ESHMAD study was used [17, 25]; this version integrated clinical and epidemiological variables from the following studies: ENEAS  and IBEAS  (Additional file: Table S3). The Screening Review Form had a high sensitivity and negative predictive value in its validation, making it an appropriate screening tool .
Modular Review Form 2 (MRF2) : for the analysis of the characteristics, types, avoidability, impact, and severity of AEs and additional days of hospital stay related to AEs. This tool was developed by the HMPS  to serve as a follow-up instrument for potential AEs identified by the SRF. The Spanish versions of the ENEAS  and IBEAS  studies were used. The kappa index of the tool was 0.61 .
The European PPS: designed by the European Centre for Disease Prevention and Control  for identifying healthcare-associated infections. The Prevalence Study of Nosocomial Infections in Spain  adapted version was used.
The following exclusion criteria were established: (1) patients who were in the emergency room and who were hospitalized on the same day of the study, as detailed in the PPS [18, 21] and ESHMAD [17, 25] protocols; (2) patients admitted to obstetrics and psychiatric areas, as detailed in the AEP protocol ; (3) patients directly admitted to an intensive care unit (ICU), because those patients were not susceptible to meet the IHA criteria of the AEP ; and (4) patients in whom AEs were the reason for hospitalization because theoretical models establish that AEs increase the risk of new ones  and, according to the main objective of this work, only AEs after admission were considered of interest).
The study was carried out in two sequential phases:
Phase 1: cross-section of hospitalized patients, performed during the second week of May 2019. The AEP , pAEP , SRF [27, 29] and PPS [18, 21] were applied. When the PPS identified healthcare-associated infections, the corresponding AE items of the SRF were checked. The clinical and epidemiological variables of interest were collected. Data were collected by personnel trained in the use of the tools but with no specific skills in Patient Safety or Appropriateness, according to the protocols of the tools used. Data from IHA and the screening were uploaded to two different databases: (1) IHA Database, (2) AEs Database
Phase 2: The MRF2 [27, 29] was used if the results of the SRF screening in Phase 1 suggested AEs. False-positive screening results were excluded, and the impact and preventability of confirmed AEs were analyzed. This phase began one month after screening and was only carried out after each patient was discharged. In this phase, data were collected by personnel trained in the use of the tool and with specific training in Patient Safety. They were blinded as they did not know if the patient had an IHA at the moment of review. After this phase, data from both databases were merged.
IHA was any admission in which not a single appropriateness item of the AEP was met. For the confirmation of AEs and their avoidability, the HMPS protocol was used through the MRF2 (scale from 1 to 6; with 1 being 'minimum relationship/evidence' and 6 being ‘practically certain relationship/evidence’; values ≥ 4 were considered positive).
The following clinical and epidemiological variables were collected using the definitions provided in PPS and previous HMPS-based studies (ENEAS  and IBEAS ): age, sex, type of admission service, Charlson-comorbidity index , total stay, reason for discharge, prognosis of the disease that led to admission, IRFs, and ERFs. IRFs were the presence of previous cardiovascular disease, impaired mobility, sensory deficit, diabetes, hypoalbuminemia, immunodeficiency, neutropenia, cirrhosis, coma, previous pressure ulcers, obesity, active smoking, previous neoplasia, and kidney failure. ERFs were the existence of previous surgery, peripheral venous catheter, central venous catheter, urinary catheterization, and mechanical ventilation (Additional file: Tables S3 and S4).
The economic cost due to length of stay related to AEs was calculated from the monetary equivalence for each day of hospital stay for 2019. These data were provided by the accounting department of the study center.
The presence of AEs after hospital admissions was defined as the dependent variable in this study. A descriptive analysis was performed. For qualitative variables, percentages were used; for hypothesis testing, the chi-square or Fisher’s test was used depending on the parametric criteria. For quantitative measures, central measures (mean and median) and dispersion measures were used (standard deviation [SD] and interquartile range [IR]), and comparisons were performed using Student’s t test or the Mann‒Whitney U test (depending on parametric criteria). The 95% confidence intervals (CI) of means and proportions were estimated. Simple linear regression and univariate logistic regression models were developed.
Two explanatory multivariate models were developed to estimate the association between IHA and subsequent AEs. The first was performed using logistic regression, in which the presence of AEs was the unit of analysis; the second was performed by multiple linear regression, in which the dependent variable was the mean AEs per patient. The confounding variables were studied, considering those that modified the crude association between IHA and the dependent variable by more than 10% [31, 32]. Neither ICU stay nor total stay was included in the analysis because they are intermediate variables between IHA and subsequent AEs. The complete study of the confounding variables can be found in the additional file (Additional file: Tables S5 and S6).
To analyze whether IHA acted as a predictor variable, two predictive models were developed: the first focused on the determinants of the presence of subsequent AEs, and the second focused on the average AEs per patient by logistic multivariate regression and multiple linear regression. Both were developed using a backward modeling strategy with an output p-value of 0.100 until finding the most parsimonious model . Overoptimism was corrected with resampling techniques (bootstrap), and goodness of fit was evaluated with the Hosmer‒Lemeshow test and the R2 statistic.
The statistical analysis was carried out with STATA Statistical software, version 16 (StataCorp. 2019. College Station, TX: StataCorp LLC) .
As a whole, the different phases of the study were approved by the Ethics Committee of the Hospital (March 19, 2019; reference 057/19) and by the Research Ethics Committee (March 3, 2022; PI reference: 006/2022).
Sample characteristics and results tree
At the time of the study, 636 patients were hospitalized. A total of 72 patients did not meet the inclusion criteria: 33 were admitted directly to the ICU, 20 were hospitalized due to a previous AE, and 19 were admitted to psychiatry. There were 6 losses due to patient identification errors.
For the 558 patients analyzed, the mean and median ages were 67.6 (SD: 19.7) and 71 (IR: 57 to 83) years, respectively. There were no relevant differences in the distribution by sex. A total of 50.2%, 47.1%, and 2.7% of patients were admitted to medical, surgical, and pediatric services, respectively. A total of 63.3% of the patients were admitted urgently, 39.1% underwent surgical interventions, and 6.1% died during hospitalization. The mean and median length of stay were 18.2 (SD: 21.8) and 5 (IR: 2 to 12) days, respectively. A total of 94.9% of patients had ≥ 1 IRF, with previous cardiovascular disease (54.7%) and impaired mobility (38.2%) being the most frequent. A total of 95.3% of patients had ≥ 1 ERF, the most frequent being peripheral venous catheters (67.0%) and urinary catheters (21.4%). The characteristics and the bivariate analysis for the sample are shown in Tables 1 and 2.
A total of 12.7% (71) of the patients were considered IHA, and 11.3% presented ≥ 1 AE (80 AEs in 63 patients). Of the patients with IHA, 15.5% developed ≥ 1 subsequent AEs (10.7% for patients without IHA; p = 0.231). Patients with IHA had twice the subsequent AEs than patients with appropriate admission (0.27 AEs per patient versus 0.12 AEs per patient; p = 0.015) (Fig. 1).
Explanatory models of the association between IHA and the subsequent development of AEs
The univariate crude analysis between IHA and the subsequent development of AEs indicated a statistical association (OR [95% CI]: 2.26 [1.26 to 4.04], compared to appropriate admissions). For this model, a higher number of ERFs, the Charlson-comorbidity index, cardiovascular disease, hypoalbuminemia, immunodeficiency, and previous pressure ulcers acted as confounding factors. In the explanatory model, adjusted for confounding variables, the risk of the subsequent development of AEs was 3.54 times higher for patients with IHA than for those with appropriate hospital admissions (OR [95% CI]: 3.54 [1.87 to 6.69]) (Table 3).
In the crude analysis between IHA and subsequent AEs, with the patient as the unit of analysis, patients with IHA had, on average, 0.14 more subsequent AEs than did patients with appropriate admission. In the multivariate analysis, the number of ERFs, the Charlson-comorbidity index, and hypoalbuminemia acted as confounding factors. This model estimated that IHA increased the average AEs by 0.19 (95% CI: 0.08 to 0.30). Considering that the mean number of subsequent AEs per patient with appropriate admission was 0.12, IHA doubled the average AEs (Table 3).
Predictive model for AEs developed after hospital admissions
For AEs developed after hospital admissions, IHA acted as a predictor variable in the logistic regression model (OR [95% CI]: 2.29 [1.07 to 4.89], compared with appropriate admission), as did the presence of pressure ulcers (OR [95% CI]: 6.82 [2.87 to 16.2], versus absence), immunodeficiency (OR [95% CI]: 4.75 [1.54 to 14.65], versus absence), central venous catheter (OR [95% CI]: 2.90, versus absence), prior surgical intervention (OR [95% CI]: 2.41 [1.14 to 5.07], versus absence), urinary catheterization (OR [95% CI]: 2.31 [1.41 to 4.37] versus absence), prognosis of residual disability (OR [95% CI]: 2.24 [1.11 to 4.52], versus complete recovery to baseline) and age (OR [95% CI]: 1.02 [1.01 to 1.04] for each 1-year increase) (Table 4).
In the model, sex acted as a control variable due to the existing evidence of its association with AEs developed after hospital admissions. The goodness of fit of the model was evaluated with the Hosmer‒Lemeshow test, obtaining an optimal value (p = 0.257).
Predictive model of the number of AEs developed after hospital admission per patient
In the predictive model developed through multiple linear regression, IHA was a predictor, doubling the mean AEs per patient (coefficient [95% CI]: 0.17 [0.02 to 0.31] increase compared to appropriate admission), as were the presence of pressure ulcers (coefficient [95% CI]: 0.47 [0.17 to 0.77] increase versus absence), central venous catheter (coefficient [95% CI]: 0.24 [0.06 to 0.41] increase versus absence), immunodeficiency (coefficient [95% CI]: 0.17 [0.00 to 0.34] increase versus absence), surgical intervention (coefficient [95% CI]: 0.12 [0.06 to 0.19] increase versus absence), and cardiovascular disease (coefficient [95% CI]: 0.09 [0.02 to 0.16] increase versus absence). The presence of obesity was the only variable that significantly reduced the mean AEs when adjusting for the rest of the variables (coefficient [95% CI]: − 0.09 [− 0.18 to − 0.01] decrease versus absence).
In the goodness of fit analysis, the R2 statistic was 0.159, with the model having an optimal fit. The final model is presented in the additional file (Additional file: Table S7).
Impact of the IHA-related AEs
Of the 80 AEs, the most frequent type was healthcare-associated infection (38.8%), followed by procedural complications (26.3%) and nursing care (26.3%). A total of 71.3% of the AEs occurred in the hospitalization ward. A total of 51.2% of the AEs were moderate or severe, and 98.7% required additional health care. The overall preventability of an AE was 69.6%. The mean number of days of additional stay triggered by AEs was 10.3 days in hospitalization wards and 1.5 days in the ICU, with an additional economic cost of €385,238.3.
Compared with AEs developed after appropriate admissions, AEs developed after IHA occurred more frequently among scheduled admissions (78.9%, compared to 27.9% of AEs developed after appropriate admissions; p < 0.001) and was associated with more additional days of stay in the ICU (3.3 days on average, compared to 0.9 days for appropriate admissions; p = 0.037). AEs developed after IHA incurred an average cost of €12,600.4 for each additional day of stay and an extra cost of €166,324.9 for all additional days of stay identified. AEs occurring after IHA also incurred higher costs resulting from additional days of ICU stay (€104,475.9, compared to €93,338.5 for AE developed after appropriate admissions; p = 0.039) (Table 5).
Approximately 13% of patients presented with IHA, and of these, almost 16% developed ≥ 1 subsequent AEs. After adjusting for confounding variables, patients with IHA had a risk of subsequent occurrence of AEs more than three times higher than that for patients with appropriate admissions. Notably, this is the first study to analyze this association through a direct estimation. IHA acted as a predictor variable of the subsequent development of AEs in both predictive models, using either AE records or patients as a study unit. Compared with AEs developed after appropriate admissions, AEs that occurred after IHA added more than two additional days of stay in the ICU and incurred extra economic costs greater than €160,000 for the total sample studied.
To date, the relationship between health overuse and the risks it entails for patients has been treated mainly from a theoretical framework. There are few studies that have quantified both phenomena using the same sample, and until this study, none had performed a direct estimate of the association between IHA and subsequent AEs. The study was also carried out during May, in a similar way to other studies in the field of epidemiological surveillance, considering this as a representative month of usual clinical practice, not marked by seasonal diseases (such as flu) or by organizational aspects of the hospital (lower care burden) [10, 18, 21].
Previously, indirect estimates were made based on the incidence of AEs related to a procedure and the frequency with which such a procedure is overused. However, these data tended to come from independent studies that did not share the same sample or study population. Brownlee et al.  in 2017 carried out an extrapolation of these characteristics. It was estimated that if the frequency of AEs associated with arthroplasties was 7–8%  and that 30% of such procedures were indicated unjustifiably , approximately 1–2% of arthroplasties would present, simultaneously, overuse and AEs.
To a lesser extent, other more recent studies have made more direct estimates between overuse and AEs. In 2019, Badgery-Parker et al.  analyzed hospital-acquired complications after low-value procedures, showing that 26.3% of them were healthcare-associated infections. In Spain, in 2021, AEs derived from the unjustified indication of routine diagnostic and therapeutic procedures in the field of primary care were identified. However, most of these AEs had mild impacts in both adult and pediatric patients . Similarly, other studies have shown that the inappropriate consumption of medications increased the risk of hospitalization by 31% .
To date, the only study that explored AEs developed after IHA was that by Canzoniero et al. in 2015 , which did so with patients with syncope admitted to a hospital in the USA. This study evaluated the appropriateness of admission using the San Francisco Syncope Rule and subsequently analyzed the episodes of hospitalization, finding serious AEs such as hypoglycemia and transfusion errors. However, the study by Canzoniero et al. did not provide a measure of the association between IHA and AEs (as it did not identify the AEs for appropriate admissions) and only investigated a specific pathology. In this regard, our study provides 2 pioneering approaches: (1) it provides a direct estimate of the association between IHA and the subsequent AEs after analyzing AEs in the entire sample, regardless of the appropriateness of admission; and (2) it uses an independent diagnostic tool to measure IHA, providing greater representativeness of the sample and greater external validity of the results.
In our study, the association between IHA and subsequent AEs was analyzed using multivariate explanatory and predictive models and two different units of analysis: (1) based on each patient and (2) based on AE records. This methodology was chosen after observing notable differences in the frequency of the subsequent development of AEs between patients with IHA and patients with appropriate admissions. The most accurate estimation of the association was performed with explanatory models. After adjusting for confounding variables, the model indicated that IHA increased the risk of developing a subsequent AE by more than three times and doubled the mean AE per patient. This finding suggests that reducing IHA would exponentially decrease the burden derived from AEs.
Some hypotheses may explain why IHAs favor the appearance of AEs. One could be that the appearance of an IHA inherently implies an unnecessary increase in hospital stay and the patient's exposure to a high-risk environment, which activates other healthcare errors that lead to the appearance of AEs. In this regard, AEs are not due to a single root cause but to an overlap of failures and errors, including IHA .
Another hypothesis would be that IHA could be associated with specific surgical procedures or patient comorbidities that may favor an increment in errors and AEs. In our sample, no specific intervention was found as a possible confounding variable. Furthermore, the AEP has not been used in the analysis of a single intervention because it is diagnostic-independent, so there is no previous evidence of an association between concrete surgeries and IHA . Regarding patient comorbidities, none was found to be associated with IHA in our study. However, this may be due to the sample size, so our findings could serve as a starting point to analyze specific interventions and patients and thus deepen this association with a longitudinal design.
In both predictive models, using patients or AE records as the unit of analysis, IHA was a predictor variable, acting as a contributing factor. This finding has additional importance because the inappropriateness of health care is not considered a contributing factor by most of the tools designed for this purpose, such as the London Protocol  or the Systems Engineering Initiative for Patient Safety model . From this perspective, the results of this study could indicate a need for IHA to be included as a study dimension within the analysis of AEs or sentinel events and could lead to the investigation of other forms of inappropriateness as contributing factors of the AEs.
AEs after IHA and their impacts
The most frequently identified AEs after IHA were procedural complications and healthcare-associated infections. This result coincides with those of other studies that did not analyze the appropriateness of admission. This was the case in a meta-analysis conducted in 2018, in which procedural complications were the most frequent AEs . For the IBEAS, which used the same AE identification instrument as that used in our study, the most frequent type was healthcare-associated infections, followed by procedural complications .
The differences found in our sample indicate that IHA is more frequently associated with subsequent AEs in patients with scheduled admissions. It is previously known that the IHA is associated with scheduled admissions (in this type of patient, the most frequent cause of inappropriateness is due to early admissions; for example, a patient admitted on a Friday for an intervention that is performed on Monday), making this type of patients the most affected by AEs in inappropriate admissions .
However, in the explanatory models, the type of admission did not act as a confounder in the association between IHA and AEs. It was not a predictor of AEs in the predictive models either. In addition, in the bivariate analysis, no association was found between AEs and the type of admission (prevalence in scheduled admissions of 10.7% versus 11.6% in urgent ones; p = 0.751). These results suggest that the type of admission impacts the type of AE associated, but it is not acting as the cause of this increased association between IHA and AE. In any case, future studies with a longitudinal design should further analyze this association.
A total of 36.8% of AEs developed after IHA had a serious impact on patients, a higher percentage than that obtained in another meta-analysis in 2019 (13.0%) . In addition, compared with the AEs developed after appropriate admissions, AEs developed after IHA led to the ICU stay being extended by more than two additional days.
At the economic level, the average daily cost of AEs developed after IHA was 12,600.4 €/day, which represents a total of 4.6 million € per year for the study hospital. Extrapolating these data to the more than 70 hospitals with more than 500 existing beds in Spain , AEs developed after IHA generate an extra cost of €322 million per year for the entire National Health System.
The cross-sectional design of this study has two main limitations: (1) it does not allow establishing causality between IHA and subsequent AEs; and (2) AEs leading to a longer hospital stay could be overrepresented. However, the AEs that lengthen the stay are also those that carry a more serious impact on patients; therefore, their identification and analysis are also more suitable for estimating the association with IHA to prioritize possible strategies for improving patient safety . In addition, the cross-sectional methodology allows a more efficient use of resources  because AEs and IHA can be analyzed simultaneously from a combined surveillance system.
Another limitation would be related to the methodology used to measure the IHA. The AEP is the most used tool, and, despite being old, it is still valid, as shown by recent validations in South Korea in 2019  or how it is been used in the analysis of the economic impact in China in the same year . Nevertheless, some criteria of the form should be updated to the current clinical practice in future research, such as 'the administration of treatments by subcutaneous or intramuscular route' or 'the administration of intravenous medication' criteria, which together made appropriate most hospital admissions in our sample. Furthermore, the fact that it is an objective tool that eliminates any judgment of the reviewer, means that accomplish of any criteria could make admissions appropriate without assessing whether it was really necessary. However, these limitations make the tool very specific for detecting inappropriateness by just considering patients who did not receive any therapy or procedure as IHA. Regarding the results of this article, it is possible that these limitations of the form, which make some inappropriate admissions be considered appropriate, acted by underestimating the association between IHA and AEs.’
In addition, it should be considered that, in our study, the association between inappropriate hospital stays and AEs has not been explored. Although the AEP for admissions shares most of the criteria with the AEP for stays, future studies should analyze (1) the association between inappropriate stays and AEs; (2) whether inappropriate stays can be a confounding variable between IHA and AEs.
The study could have benefited from a larger sample size because although statistically significant differences were identified in clinically relevant results, other comparisons needed greater statistical power. An example could be the variable adjustment methodology. The sample size and the lack of previous evidence of what variables could be confounding variables between IHA and AE did not allow us to adjust for more precise techniques. In addition, the comparison between the differences in the consequences of AEs after IHA is limited for this exact reason. Finally, the economic estimates should be interpreted cautiously because they do not include the cost of complementary tests and cascading events derived from IHA or the AEs. Likewise, its extrapolation to other health systems is complex because not all health providers use the exact monetary costs.
This is the first study that provides a direct estimate of the association between IHA and the subsequent occurrence of AEs. This has been possible thanks to identifying AEs not only in IHAs but also in appropriate admissions. In addition, this measure of association was analyzed based on different study units, and models were adjusted for various clinical and epidemiological variables, such as IRFs and ERFs that were not collected or considered in previous appropriateness studies.
It is also a pioneer study because it combines the AEP, HMPS, and PPS methodologies, which include different versions of standardized, validated, and widely accepted measurement instruments. Their joint and simultaneous use is positioned as a new surveillance system in terms of patient safety, capable of analyzing IHA as a possible contributing factor for subsequent AEs. With this, this study allows proposing the hypothesis that IHA and other forms of overuse act as potential causal factors for AEs, which is a possibility that should be specifically studied using longitudinal methodologies.
Similarly, the use of the AEP as a diagnostic-independent application tool provides a high representativeness of the sample and greater external validity of the results. Finally, the application of the HMPS and PPS methodologies has added an additional quality filter in the identification and characterization of AEs.
Patients with IHA have a risk of subsequent development of AEs more than three times higher than patients with appropriate admissions. Due to the multifactorial nature of AEs, IHA is positioned as a contributing factor.
AEs developed after IHA are associated with scheduled admissions and have greater impacts on both the patient and the health system because extend the stay in the ICU and involve significant economic costs.
The combination of the AEP, HMPS, and PPS methodologies allows the efficient and simultaneous analysis of IHA and subsequent AEs, leading to the establishment of associations between the two. However, longitudinal studies should be conducted to explore the causality between IHA, and other types of overuse, with the subsequent development of AEs by patients.
Availability of data and materials
The data that support the findings of this study are not openly available due to reasons of sensitivity and are available from the corresponding author upon reasonable request.
Adverse events related with health care
Appropriateness Evaluation Protocol
Extrinsic risk factor
Patient Safety Incident Study of Hospitals in the Community of Madrid
Harvard Medical Practice Study
Intensive care unit
Inappropriate hospital admission
Intrinsic risk factor
Modular Review Form 2
European Point Prevalence Survey for healthcare-associated infections
Screening Review Form
Chassin MR, Galvin RW. The urgent need to improve health care quality. Institute of medicine national roundtable on health care quality. JAMA. 1998;280:1000–5.
Peiró S, Meneu R. Revisión de la utilización. Definición, Concepto y Métodos. Rev Calidad Asistencial. 1997;12:122–36.
Gertman PM, Restuccia JD. The appropriateness evaluation protocol: a technique for assessing unnecessary days of hospital care. Med Care. 1981;19:855–71.
Arab-Zozani M, Pezeshki MZ, Khodayari-Zarnaq R, Janati A. Inappropriate rate of admission and hospitalization in the iranian hospitals: a systematic review and meta-analysis. Value Health Reg Issues. 2020;21:105–12.
San Jose-Saras D, Vicente-Guijarro J, Sousa P, Moreno-Nunez P, Espejo-Mambié M, Aranaz-Andres JM. Inappropriate hospital admission according to patient intrinsic risk factors: an epidemiological approach. J Gen Intern Med. 2023;38:1655–63.
Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986;2:53–63.
Hopkins A, Fitzpatrick R, Foster A, Frater A, Grimley J, Hampton J, et al. What do we mean by appropriate health care? Report of a working group prepared for the Director of Research and Development of the NHS Management Executive. Qual Health Care. 1993;2:117–23.
World Health Organization. Conceptual framework for the International Classification for Patient Safety. 2009.
Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, et al. Incidence of adverse events and negligence in hospitalized patients. Results of the harvard medical practice study I. N Engl J Med. 1991;324:370–6.
Aranaz-Andrés JM, Aibar-Remón C, Vitaller-Murillo J, Ruiz-López P, Limón-Ramírez R, Terol-García E, et al. Incidence of adverse events related to health care in Spain: results of the Spanish National Study of Adverse Events. J Epidemiol Community Health. 2008;62:1022–9.
Vincent C, Neale G, Woloshynowych M. Adverse events in British hospitals: preliminary retrospective record review. BMJ. 2001;322:517–9.
Sousa P, Uva AS, Serranheira F, Uva MS, Nunes C. Patient and hospital characteristics that influence incidence of adverse events in acute public hospitals in Portugal: a retrospective cohort study. Int J Qual Health Care. 2018;30:132–7.
Panagioti M, Khan K, Keers RN, Abuzour A, Phipps D, Kontopantelis E, et al. Prevalence, severity, and nature of preventable patient harm across medical care settings: systematic review and meta-analysis. BMJ. 2019;366:l4185.
Tessier L, Guilcher SJT, Bai YQ, Ng R, Wodchis WP. The impact of hospital harm on length of stay, costs of care and length of person-centred episodes of care: a retrospective cohort study. CMAJ. 2019;191:E879–85.
Mira JJ, Lorenzo S, Carrillo I, Ferrús L, Pérez-Pérez P, Iglesias F, et al. Interventions in health organisations to reduce the impact of adverse events in second and third victims. BMC Health Serv Res. 2015;15:341.
Aranaz-Andrés JM, Aibar-Remón C, Limón-Ramírez R, Amarilla A, Restrepo FR, Urroz O, et al. Prevalence of adverse events in the hospitals of five Latin American countries: results of the ‘Iberoamerican Study of Adverse Events’ (IBEAS). BMJ Qual Saf. 2011;20:1043–51.
Valencia-Martín JL, Vicente-Guijarro J, San Jose-Saras D, Moreno-Nunez P, Pardo-Hernández A, Aranaz-Andrés JM, et al. Prevalence, characteristics, and impact of Adverse Events in 34 Madrid hospitals. The ESHMAD study. Eur J Clin Invest. 2022;52:e13851.
European Centre for Disease Prevention and Control. Point prevalence survey of healthcare-associated infections and antimicrobial use in European acute care hospitals :2011 2012. LU: Publications Office; 2013.
Saleem Z, Godman B, Hassali MA, Hashmi FK, Azhar F, Rehman IU. Point prevalence surveys of health-care-associated infections: a systematic review. Pathog Glob Health. 2019;113:191–205.
San Jose-Saras D, Valencia-Martín JL, Vicente-Guijarro J, Moreno-Nunez P, Pardo-Hernández A, Aranaz-Andres JM. Adverse events: an expensive and avoidable hospital problem. Ann Med. 2022;54:3157–68.
Estudio de Prevalencia de Infecciones Nosocomiales. Informe España. 2019. Sociedad Española de Medicina Preventiva, Salud Pública e Higiene. 2019.
Peiró S, Meneu R, Roselló ML, Portella E, Carbonell-Sanchís R, Fernández C, et al. Validity of the protocol for evaluating the inappropriate use of hospitalization. Med Clin (Barc). 1996;107:124–9.
Kreger BE, Restuccia JD. Assessing the need to hospitalize children: pediatric appropriateness evaluation protocol. Pediatrics. 1989;84:242–7.
Casanova Matutano C, Gascón Romero P, CalvoRigual F, Tomás Vila M, ParicioTalayero JM, Blasco González L, et al. Inappropriate utilization of pediatric hospitalization. Validation of the pediatric appropriateness evaluation protocol Spanish version. Gac Sanit. 1999;13:303–11.
Valencia-Martín JL, Martin-Delgado J, Pardo-Hernández A, Vicente-Guijarro J, Requena-Puche J, Aranaz Andrés JM, et al. The Study on Safety in Hospitals in the Region of Madrid (ESHMAD) design: Screening and analysis of incidents and adverse events. J Healthc Qual Res. 2021;S2603-6479(21):00035–X.
Hiatt HH, Barnes BA, Brennan TA, Laird NM, Lawthers AG, Leape LL, et al. A study of medical injury and medical malpractice. N Engl J Med. 1989;321:480–4.
Woloshynowych M, Neale G, Vincent C. Case record review of adverse events: a new approach. Qual Saf Health Care. 2003;12:411–5.
Vincent C, Taylor-Adams S, Stanhope N. Framework for analysing risk and safety in clinical medicine. BMJ. 1998;316:1154–7.
Aranaz-Andrés JM, Aibar-Remón C, Vitaller-Murillo J, Ruiz P. Estudio nacional sobre los efectos adversos ligados a la hospitalización: ENEAS 2005. Madrid: Ministerio de Sanidad y Consumo; 2006.
Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.
Marill KA. Advanced statistics: linear regression, part II: multiple linear regression. Acad Emerg Med. 2004;11:94–102.
Stoltzfus JC. Logistic regression: a brief primer. Acad Emerg Med. 2011;18:1099–104.
Nick TG, Campbell KM. Logistic regression. Methods Mol Biol. 2007;404:273–301.
StataCorp. Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC; 2019.
Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390:156–68.
Cushner F, Agnelli G, FitzGerald G, Warwick D. Complications and functional outcomes after total hip arthroplasty and total knee arthroplasty: results from the Global Orthopaedic Registry (GLORY). Am J Orthop (Belle Mead NJ). 2010;39:22–8.
Quintana JM, Arostegui I, Escobar A, Azkarate J, Goenaga JI, Lafuente I. Prevalence of knee and hip osteoarthritis and the appropriateness of joint replacement in an older population. Arch Intern Med. 2008;168:1576–84.
Badgery-Parker T, Pearson SA, Dunn S, Elshaug AG. Measuring hospital-acquired complications associated with low-value care. JAMA Intern Med. 2019;179:499–505.
Mira JJ, Carrillo I, Pérez-Pérez P, Astier-Peña MP, Caro-Mendivelso J, Olivera G, et al. Avoidable adverse events related to ignoring the do-not-do recommendations: a retrospective cohort study conducted in the spanish primary care setting. J Patient Saf. 2021;17:e858–65.
Varavithya V, Tirapat C, Rojpibulstit P, Poovichayasumlit P, Prasert V, Vatcharavongvan P. Potentially inappropriate medication use and the hospitalization rate among Thai elderly patients: a retrospective cohort study. Eur J Clin Pharmacol. 2022;78:847–55.
Canzoniero JV, Afshar E, Hedian H, Koch C, Morgan DJ. Unnecessary hospitalization and related harm for patients with low-risk syncope. JAMA Intern Med. 2015;175:1065–7.
Vincent CA. Analysis of clinical incidents: a window on the system not a search for root causes. Qual Saf Health Care. 2004;13:242–3.
Carayon P, Xie A, Kianfar S. Human factors and ergonomics as a patient safety practice. BMJ Qual Saf. 2014;23:196–205.
Schwendimann R, Blatter C, Dhaini S, Simon M, Ausserhofer D. The occurrence, types, consequences and preventability of in-hospital adverse events - a scoping review. BMC Health Serv Res. 2018;18:521.
Campos Rodríguez F, De la Cruz MI, López Rodríguez L, Díaz Martínez A, Tejedor Fernández M. Muñoz Lucena F. Appropriateness of hospital admissions to a pulmonology department. Arch Bronconeumol. 2006;42:440–5.
Ministerio de Sanidad. Información estadística de hospitales: Estadística de Centros de Atención Especializada. 2020.
Aranaz Andrés JM, Limón Ramírez R, Aibar Remón C, Gea-Velázquez de Castro MT, Bolúmar F, Hernández-Aguado I, et al. Comparison of two methods to estimate adverse events in the IBEAS Study (Ibero-American study of adverse events): cross-sectional versus retrospective cohort design. BMJ Open. 2017;7:e016546.
Michel P, Quenon JL, de Sarasqueta AM, Scemama O. Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. BMJ. 2004;328:199.
Lee C, Kim SJH, Lee C, Shin E. Reliability and Validity of the Appropriateness Evaluation Protocol for Public Hospitals in Korea. J Prev Med Public Health. 2019;52:316–22.
Chang JJ, Chen YC, Gao HX, Zhang Y, Li HM, Su D, et al. Effect of inappropriate admissions on hospitalization performance in county hospitals: a cross-sectional study in rural China. Cost Eff Resour Alloc. 2019;17:8.
Health Outcomes Research Group of the Instituto Ramón y Cajal de Investigación Sanitaria (IRYCIS): Cristina Díaz-Agero Pérez, Miguel Ignacio Cuchi Alfaro, Juan Manuel Ramos López, Jorge de Vicente Guijarro, Paloma Moreno Núñez, Mercedes García Haro, Abelardo Claudio Fernández Chávez, Cornelia Bischofberger Valdés, Amaranta Mcgee Laso, Carmen Garrote Liarte, Gerardo Gómez Montero, Juan Daniel Miranda Cortes, Gema Nieto Gomez, Jessica Alia Herrero, Sara de la Hoz San Clemente, Marta Gonzalez Touya, Moisés David Espejo Mambié, Diana Carretero Gomez, Diego San José Saras, Manuela Serrano Pareja, Marco Antonio Espinel Ruiz, Raquel Gutierrez Gallardo, Eva Elisa Álvarez León, María del Carmen Martínez Ortega, Paloma Navas Gutiérrez, Nerea Armenteros Arzá, Francisco Bolumar Montrull, Ana García de la Santa Viñuela, Raquel Arguedas Sanz, Miriam Roncal Redín.
No funding was received during the investigation.
Ethics approval and consent to participate
As a whole, the different phases of the study were approved by the Ethics Committee of the Hospital Universitario Ramon y Cajal (March 19, 2019; reference 057/19) and by the Research Ethics Committee of the Universidad Internacional La Rioja (March 3, 2022; PI reference: 006/2022).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appropriateness Evaluation Protocol for Admissions. Table S2. Pediatric Appropriateness Evaluation Protocol for Admissions. Table S3. Definition and applied criteria of variables. Table S4. Definition and applied criteria of intrinsic and extrinsic risk factors. Table S5. Crude association between inappropriate admissions and the subsequent development of adverse events, by records. Table S6. Crude association between inappropriate admissions and the subsequent development of adverse events, per patient. Table S7. Predictive model of the number of Adverse Events developed after hospital admissions, per patient.
About this article
Cite this article
San Jose-Saras, D., Vicente-Guijarro, J., Sousa, P. et al. Inappropriate hospital admission as a risk factor for the subsequent development of adverse events: a cross-sectional study. BMC Med 21, 312 (2023). https://doi.org/10.1186/s12916-023-03024-0