Abstract
Accurate and standardized methods for assessing the vital status of patients are crucial for patient care and scientific research. This study introduces the Patient Vital Status (PVS), which quantifies and contextualizes a patient's physical status based on continuous variables such as vital signs and deviations from age-dependent normative values. The vital signs, heart rate, oxygen saturation, respiratory rate, mean arterial blood pressure, and temperature were selected as input to the PVS pipeline. The method was applied to 70 pediatric patients in the intensive care unit (ICU), and its efficacy was evaluated by matching high values with septic events at different time points in patient care. Septic events included systemic inflammatory response syndrome (SIRS) and suspected or proven sepsis. The comparison of maximum PVS values between the presence and absence of a septic event showed significant differences (SIRS/No SIRS: p < 0.0001, η2 = 0.54; Suspected Sepsis/No Suspected Sepsis: p = 0.00047, η2 = 0.43; Proven Sepsis/No Proven Sepsis: p = 0.0055, η2 = 0.34). A further comparison between the most severe PVS in septic patients with the PVS at ICU discharge showed even higher effect sizes (SIRS: p < 0.0001, η2 = 0.8; Suspected Sepsis: p < 0.0001, η2 = 0.8; Proven Sepsis: p = 0.002, η2 = 0.84). The PVS is emerging as a data-driven tool with the potential to assess a patient's vital status in the ICU objectively. Despite real-world data challenges and potential annotation biases, it shows promise for monitoring disease progression and treatment responses. Its adaptability to different disease markers and reliance on age-dependent reference values further broaden its application possibilities. Real-time implementation of PVS in personalized patient monitoring may be a promising way to improve critical care. However, PVS requires further research and external validation to realize its true potential.
Similar content being viewed by others
Introduction
In a fast-paced critical care environment, it is essential but challenging to accurately assess the severity of illness and the patient's overall condition1,2. This study proposes a novel approach that combines critical care-related variables with predetermined reference values, transforming continuously monitored vital signs into a time-sensitive, quantitative Patient Vital Status (PVS).
Despite advances in diagnostics and computation in the intensive care unit (ICU), traditional indicators such as skin complexion and capillary refill time remain invaluable3. However, these approaches may not be easily quantified or adapted to capture the many nuances of changes in patient status at every possible time point.
The challenges of deciphering complex patient data, big data analytics, and digital health applications are recognized as core components of critical care4,5. Clinical scores, e.g., determining the severity of illness, complement these efforts by consolidating and aggregating patient data2,6. Together, they can generate new knowledge, improve clinical practice, and advance healthcare by providing deeper insights and information on treatment decisions7,8,9,10.
Recent animal research has identified several characteristics contributing to the disease severity of animals undergoing experimental procedures in biomedical research11,12,13,14. By employing machine learning techniques to combine these multiple variables, it is possible to achieve improved validation and comprehensive understanding of severity classes compared to relying on single variables that may have high variance15,16,17.
The Relative Severity Assessment (RELSA) score represents the most recent and advanced method for integrative and multimodal quantitative severity assessment in preclinical settings. This validated approach calculates a latent severity scalar by comparing observed differences in outcome measures to a standardized reference set18. However, assessing disease severity in humans is more complex than in animals.
Systemic inflammatory response syndrome (SIRS) and sepsis in pediatric intensive care units (PICUs) and ICUs are common reasons for admission or occur during the stay19,20. Therefore, using individualized severity scores is critical to ensure qualitative assessments21,22. Timely detection and treatment are essential but challenging due to time constraints, limited resources, and complex diagnoses23,24,25,26. Sepsis-related scores, such as the Sepsis-related Organ Failure Assessment (SOFA) score, play a significant role in timely detection and intervention27,28. Other scores, such as the Sepsis Mortality Risk Score (SMRS), directly address sepsis patients and allow classification according to mortality risk29,30,31,32,33.
In the current landscape of critical care, assessing disease severity and detecting minor trend-indicating vital changes, especially for ICU patients, remains a complex challenge10,34,35,36,37. This requirement raises a crucial question: How can computational and data-driven methods be used to address this problem? Our study presents the Patient Vital Status, an adaptation of the RELSA method suited for human application. Using multiple clinical input variables provides a solution to minimize information loss, allows the comparison of individuals and groups, and generates disease-differentiating results using a fusion score38. It detects deviations from normative vital signs, most often associated with increasing disease severity.
In our application, we address the challenge of quantifying the vital status of patients with SIRS, suspected and proven sepsis in a PICU using retrospective, cross-sectional data. In this context, we hypothesize that the PVS can identify differences between patients with and without SIRS and those with more severe conditions such as sepsis.
Material and methods
PVS data collation and annotation
The data for this study were sourced from an existing data set of the PICU at the Hannover Medical School (MHH)39. The data underwent annotation and compilation, resulting in a finalized collection of tables. The selection criteria involved considering the measurement frequency, presence of vital parameters, and information about septic conditions. Any duplicate entries were removed. To calculate the composite PVS, only records containing values for all variables were utilized to guarantee complete data.
Seven outcome measures were utilized for the calculation: heart rate, peripheral pulse, respiratory rate, oxygen saturation, systolic blood pressure, mean arterial pressure, and temperature. The data included information about admission and discharge dates, date of birth, the time point of each measurement, and a unique but anonymized patient ID.
A moving average with a window size of five consecutive entries was calculated to mitigate potential noise in the raw data. This window size was chosen to emphasize the underlying trend and minimize the influence of single spurious peaks (Supplemental Material 1). For example, a smaller window size allowed an erroneously assessed 14% oxygen saturation to impact the saturation trend substantially. Due to the extensive data, the selected window size allowed us to filter out false data sufficiently. In addition, only temperatures above 34 °C were included to avoid biased results, e.g., by cooling mats. The data encompassed information regarding the timing of SIRS, proven sepsis, and suspected sepsis occurrences. The labeling followed the criteria reported at the 2005 International Pediatric Sepsis Consensus Conference40. In addition, the exact times these conditions occurred were utilized in calculating PVS changes. A patient could have more than one of these conditions. Individual time series data were merged on the time scale for continuous outcomes. Therefore, periods between measurements were not shown, and possible disease events and annotations were indexed on an absolute scale.
The final data contained 70 unique patients: 33 females (47%) and 37 males (53%) aged less than one year. Twenty-nine patients had no SIRS (41%), and 41 had SIRS (59%). Within this cohort, seven patients had proven sepsis, and 28 had suspected sepsis. No patient died.
Establishment of the vital sign reference values
The reference values for heart rate, blood pressure, and respiratory rate used in this study, which represented the typical values for specific ages, were sourced from the European Resuscitation Council (ERC) Guidelines 2021 in Pediatric Life Support41. The midpoint between the upper and lower limits was used in the subsequent calculations. The fiftieth percentile was deployed for systolic blood pressure and mean arterial pressure (MAP). Reference values for oxygen saturation and body temperature were derived from other studies (Table 1)42,43.
PVS calculation
The variables contributing to the fusion process resulting in the PVS were normalized according to the age-dependent reference values in Table 1 (Eq. 1). The patient's age was determined based on the date of birth and the measurement time. The reference age closest to the patient's age determined the respective reference values. The reference values did not change within one patient (e.g. because a different reference age became closer during the stay).
Disease severity was associated with increasing or decreasing values. Therefore, deviations in either direction indicated aggravated conditions. For such ambivalent variables, the normalized values below 100% were corrected to an equivalent above 100% (Eq. 2).
Since the basic functions of PVS are based on the RELSA procedure18, a reference was required that showed the maximum deviations in all contributing variables for a specific disease condition. Here, we specified the non-SIRS group as the reference. Consequently, the contrasts of the normalized values of each patient and the reference generated severity-related weights [w] for each variable. Finally, the combined weights were summarized with a root mean square procedure, resulting in a fused scalar called PVS. Thus, values above PVS = 1 indicated multidimensional measures that exceeded the highest severity in all contributing variables of the reference set.
Statistical analyses
The PVS methodology was developed in R (v4.2.1). Data were processed using tidyverse, janitor, writexl, and readxl. Further, data were visualized with the ggplot2, ggsignif, and patchwork packages. The psych, lsr, lme4, lmerTest, car, zoo, rstatix, coin, and survival packages were used for statistical analyses.
The Shapiro–Wilk test was used to test against the hypothesis of normally distributed data. The Wilcoxon-Mann–Whitney test was utilized for non-normally distributed data. For normally distributed data with sample sizes of n = 30 and larger, two-tailed z-tests were used to compare the means of disease groups. Effect sizes were calculated as Cohen's d (for normally distributed data) or as Wilcoxon effect size (eta-squared (η2), for non-normally distributed data) to evaluate the potential relevance of clinical effects compared to inferential analyses dependent on sample sizes. To test bivariate correlations, we used the Pearson product-moment correlation coefficient. A generalized linear mixed-effects regression (GLMER) from the binomial family with anonymized patient IDs as random effects was used to test the individual vital signs as fixed effects on disease severity. The full model was tested against the null model with only the random effects in a likelihood ratio test to determine the effect of patient characteristics. Results of the GLMER were given as log-odds and the odds ratio (OR) with 95% confidence intervals. The vital sign data were normalized to zero mean and a standard deviation of 1 to ensure equal scales in the model. Trend analysis in single patient time series data was performed with a linear regression model, using the PVS as the dependent variable and time as the independent variable. The significance levels to interpret the resulting p-values were as follows: not significant (ns.), 0.05 (*), 0.01 (**), 0.001 (***), and 0.0001 (****).
Ethical approval
All study participants, their parents, or legal guardians gave written informed consent. The study has been approved by the Ethics Committee of Hannover Medical School (No. 7804 BO S 2018 and No. 9819 BO S 2021). The study complied with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects and was reviewed by the Ethics Committee of Hannover Medical School. All methods were carried out in accordance with relevant guidelines and regulations.
Results
Cohort characterization
Table 2 characterizes the cohort, including information about the mean PICU stay and the average age of each group. Strikingly, the length of stay was significantly longer in patients with SIRS than those without (p < 0.0001, η2 = 0.53). In addition, the average length of stay was higher for proven sepsis (19.71 days) than for suspected sepsis (16.21 days).
Variable selection for PVS composite scoring
Pulse and systolic blood pressure were excluded from the PVS calculation because their severity weights were highly correlated with heart rate (ρ = 0.91, p < 0.0001) and MAP (ρ = 0.67, p < 0.0001). Therefore, the final variable set comprised heart rate, oxygen saturation, respiratory rate, MAP, and temperature, each showing low cross-correlation. For example, the highest correlation among the other variables was between heart rate and oxygen saturation with ρ = -0.24, which was considered acceptable for further analysis. All variables, except oxygen saturation, were considered ambivalent variables. Table 3 shows descriptive statistics of the final variable set. Supplemental Material 2 shows descriptive statistics divided into age groups of one month (n = 47) and one year (n = 23). Further, there was no significant difference between the sexes in the PVS, consistent with the reference values in the literature, which also reported no difference between sexes (Supplemental Material 3)41.
Disease severity-related vital sign analysis in SIRS patients
A generalized linear mixed-effects regression model from the binomial family was used to evaluate the individual effects of each vital sign on the presence of SIRS, independent of time. The binary status of SIRS (present/not present) was the dependent variable, and the time factor was excluded from the analysis. Additionally, we accounted for the influence of patient IDs as random effects. We found the random effects component to have a significant variance (var = 9.16, Χ2 = 3829.8, df = 5, p < 0.0001), indicating that the patients' characteristics captured by the independent variables significantly influenced the outcome.
All vital signs were significant factors in the presence of SIRS (p < 0.0001). The log-odds of present SIRS increased with increasing oxygen saturation (0.36, OR = 1.43 CI95%[1.39; 1.49]), respiratory rate (0.27, OR = 1.31 CI95%[1.29; 1.33]), MAP (0.16, OR = 1.17 CI95%[1.16; 1.20]) and temperature (0.39, OR = 1.48 CI95%[1.45; 1.50]), whereas the log-odds decreased with increasing heart rate (-0.19, OR = 0.83 CI95%[0.81; 0.85]). The results showed that the included vital signs were differentially effective predictors in the presence of highly heterogeneous patient data (Supplemental Material 4).
Using the PVS in continuous disease severity monitoring
The data showed that PICU patients exhibited substantial heterogeneity in values over time (Supplemental Materials 1 & 5). Therefore, as a use case, we focused on time series data from a patient with the highest PVS score (PVS = 1.09) to demonstrate disease monitoring. The vital sign values were also smoothed with a window size of 5 consecutive entries to exclude spurious spikes. In the following example, we will present the vital sign characteristics as the original measurement, the relative PVS weight (w), and the age-dependent reference values (ref) from the ERC Guidelines 2021 in Pediatric Life Support to provide situational context. The one-year-old male example patient had SIRS. The high PVS peak was consistent with co-occurring suspected sepsis (Fig. 1A). At the time of the highest PVS, the patient had a heart rate of 111 bpm (w = 0.37, ref = 135 bpm, 1B), oxygen saturation of 69.4% (w = 0.93, ref = 100%; 1C), respiratory rate of 112 rpm (w = 2.14, ref = 35 rpm; 1D), MAP of 98.8 mmHg (w = 0.59, ref = 70 mmHg; 1E), and temperature of 37 °C (w = 0.12, ref = 37.3 °C; 1F). The oxygen saturation and respiratory rate were mainly responsible for the PVS peak (Supplemental Material 5C-D). The average PVS for the entire PICU stay was PVSav = 0.35, and the lowest PVS for this patient was 0.19.
The patient reached his lowest PVS on the first entry of his stay. He had the following vital signs at that time: a heart rate of 135 bpm (w = 0), oxygen saturation of 93.8% (w = 0.19), respiratory rate of 41.4 rpm (w = 0.18), MAP of 62.8 mmHg (w = 0.15), and a temperature of 38.1 °C (w = 0.31). As the temperature was slightly elevated, the temperature weight was mainly responsible for the elevated PVS. The difference between the last PVS before suspected sepsis (PVS = 0.36) and the maximum of the first four PVS values during suspected sepsis (PVS = 1.09) was ∆PVS = 0.73. As the trend in this patient showed, the PVS peaked at the onset of suspected sepsis and decreased until the end of the suspected sepsis.
In contrast, a second male patient had SIRS but with proven sepsis. He was 0.37 years (4.4 months) old at admission. Although the patient had proven sepsis, the maximum PVS (0.82) was lower than in the first use case (Fig. 1G). However, he exhibited a spike in temperature (highest temperature in the data set) that was not present in the patient with suspected sepsis. Further, during the period of proven sepsis, the patient also had an elevated respiratory rate and MAP. The heart rate also showed a spike, while the oxygen saturation decreased (Fig. 1 H–L). The average PVS of this patient was PVSav = 0.28, and the lowest possible PVS was 0.1 (Supplemental Material 6). The PVS values during proven sepsis (median = 0.47, IQR = 0.11) were significantly higher than those during times of no sepsis, showing a substantial effect (median = 0.25, IQR = 0.11); W = 5102, p < 0.0001, η2 = 0.4).
In both patients, slight trends before the sepsis events were visible in the time series but were difficult to observe when considering multiple vital parameters simultaneously. The fused PVS signal uncovered these trends and indicated a rising risk of health impairment through linear analysis over the entire observation time, culminating in the highest PVS peak (Patient 1: slope = 0.0055, df = 164, p < 0.0001; Patient 2: slope = 0.00064, df = 943, p < 0.0001).
Larger PVS values corresponded with higher disease severity compared to values at patient discharge
The two use cases showed that suspected and actual sepsis events correlated with higher PVS values. However, in the current cross-sectional data, no controls were available. Therefore, we compared the maximum PVS [PVSmax] in each group (No SIRS/SIRS, No Suspected Sepsis/Suspected Sepsis, and No Proven Sepsis/Proven Sepsis) with the last available PVS before discharge, assuming a lower disease-related burden for these values since no patient died. Also, the reason for the PICU stay was no longer present. Patients could have multiple status labels, i.e., some patients with suspected sepsis were also included in the group without proven sepsis, etc.
All disease-related groups showed significantly higher PVSmax values than before discharge (Fig. 2). The effect sizes were considerably large (SIRS: p < 0.0001, η2 = 0.8; Suspected Sepsis: p < 0.0001, η2 = 0.8; Proven Sepsis: p = 0.002, η2 = 0.84). The corresponding groups without these conditions also showed significantly higher PVSmax values than before discharge: (No SIRS: p < 0.0001, η2 = 0.55; No Suspected Sepsis: p < 0.0001, η2 = 0.59; No Proven Sepsis: p < 0.0001, η2 = 0.66). Furthermore, the PVSmax values of disease-related groups were significantly higher than those of the groups without the corresponding disease (SIRS/No SIRS: p < 0.0001, η2 = 0.54; Suspected Sepsis/No Suspected Sepsis: p = 0.00047, η2 = 0.43; Proven Sepsis/No Proven Sepsis: p = 0.0055, η2 = 0.34). No significant differences were observed between the last PVS values in each condition, corroborating the assumption of stable patients immediately before discharge.
Multidimensional PVS-related septic states were different from non-SIRS patients
We analyzed the PVSmax values in four groups (No SIRS, SIRS (without suspected or proven sepsis), Suspected Sepsis, and Proven Sepsis) to compare septic states with non-SIRS patients. In the PICU setting, non-SIRS patients were still health-impaired, also showing elevated PVS values. However, three patients had both suspected and proven sepsis. Thus, they were categorized as having proven sepsis. Significant differences were observed between patients without and with SIRS (p = 0.036, η2 = 0.352) and patients without SIRS and suspected sepsis (p = 0.00017, η2 = 0.53). Finally, there was a significant difference in PVSmax values between non-SIRS patients and patients with proven sepsis (p = 0.00031, η2 = 0.64) (Fig. 3). Therefore, each additional disease severity category showed higher average PVSmax values than non-SIRS patients. However, the variance between septic states was considerable, which rendered SIRS-sepsis discrimination solely based on the PVS difficult without further information.
Discussion
PVS for continuous monitoring in patient care and research
There is a growing demand for more objective, comparable, and evidence-based methods to assess the quantified vital status of patients4,7,8. These methods are critical for improving the overall quality of research by providing higher standards for hypothesis testing, real-time patient monitoring, and data quality. In response to this need, the PVS was developed to address these issues by incorporating multiple outcome measures to form a composite and weighed score representing the body's current state. To indicate whether vital signs deviate from their normative values, the PVS focuses on out-of-norm conditions and changes in vital status. Therefore, we hypothesize that PVS identifies differences between patients with and without SIRS and those with more severe conditions such as sepsis. The basic idea for this approach is derived from the RELSA method18, which is successfully implemented in animal-based research to evaluate the severity of experimental procedures quantitatively44,45,46.
We adapted and translated the RELSA methodology to the clinical scale in this proof-of-concept study. Then, we retrospectively analyzed a cohort of PICU data obtained from very young patients aged 0 to 1 year. The corresponding analyses were challenging because of large variances, age-dependent baseline values, and the ambiguity of annotations. For example, we encountered spurious spikes in the data that had to be eliminated with a moving average to avoid false positives. Also, we found several unrealistic values (e.g., zero heart rate) even though the data were clinically validated. These examples illustrate that translating concepts from highly standardized animal experiments into human medicine can be difficult because real-world data introduces additional complexity.
Disease-related variable analysis revealed that the vital signs sometimes appeared to behave counterintuitively, e.g., the log-odds of present SIRS increased with increasing oxygen saturation. This demonstrated the complexity of the real-world data and may have been due to severe non-SIRS conditions, vital sign abnormalities that occurred only briefly during the SIRS period, and SIRS conditions with no abnormalities in one or more vital signs.
Nevertheless, valuable insights into the application of the PVS score were gained. We found, e.g., that all septic label types corresponded to higher maximum PVS scores (Fig. 2). Further, PVS scores also increased with a septic event and were significantly higher in the presence of proven sepsis. This finding corresponds with the result that the last PVS before discharge was significantly lower than the patients' maximum PVS, corroborating the research hypothesis of this study. These results imply that the PVS methodology provides a quantitative framework for continuously monitoring the vital status of patients.
This technology can be used to monitor disease progression and responses to treatment. Further, the PVS provides an overview of multidimensional patient data by reducing multiple occurring changes into one number. Theoretically, ICUs, medical facilities, and physicians can monitor many patients and conditions in parallel, while the PVS provides valuable input in decision-making processes during treatment. However, further studies are required to validate the procedure, e.g., for specific diseases, and compare the PVS with a defined set of variables to existing validated scores that use a similar methodology, such as the Pediatric Early Warning System (PEWS)23,47.
Enhancing the precision for PVS assessment
We used a set of regularly monitored physical measures aligned with German ICU standards. The selection focused on continuously measured variables in this proof-of-concept, but other variables such as hemoglobin, C-reactive protein, or other clinical variables are also promising candidates28,48,49. We see this as an advantage of the PVS because it can be customized to particular disease markers while monitoring the overall medical situation. Further, physiological context is always maintained by referencing the measurements to reference values. The included variables did not show significant correlations, resulting in a diverse set of outcome measures that did not disproportionately influence the PVS calculation. Also, these variables had similar measurement frequencies to ensure the comparability and completeness of the results. Time-delayed measurements require data integration on larger time frames. While possible, this procedure always results in information loss and the necessity to impute data on a larger scale, which can be critical in medical decision-making processes.
The PVS generally remained low when variables evolved around the reference values. We visualized how the different variables affected the PVS in the presented use cases for suspected and proven sepsis (Fig. 1). The more variables deviated from the norm, the higher the PVS increased. Single outliers affected the PVS, but since the score is a weighted construct of multiple variables, substantial increases occurred only when multiple variables showed deviations from physiological levels. As in the RELSA, the root mean square calculation ensures that small fluctuations receive less weight in the final score, which helps minimize noise. However, future validation studies may require sensitivity analyses to address the problem of overfitting and construct validity for more specific disease-related questions.
Another critical aspect lies within the definition of reference values. Here, we included age-dependent values that changed considerably in the evaluated range from 0 to 1 year (Table 1). These references exhibit potential for improvement, e.g., smaller age scales offer more precise calculations of the PVS in pediatric patients when available. Adaptive reference values provide many possibilities for further customization, such as sex or specific medical conditions. Such adaptations could include, e.g., a fluid transformation of the oxygen saturation reference for patients with underlying cyanotic heart disease. We found no significant differences between the sexes due to the young patients’ ages. However, sex-specific effects can be expected in adults due to differences in reference values and the severity of illness in ICU patients50,51,52.
To comprehensively assess a patient's overall vital status, it is advisable to employ general variables or variables encompassing multiple aspects of the body. For instance, despite its normality in most measurements, incorporating body temperature as a variable proves advantageous as it indicates that the disease has not yet exerted a pervasive impact on the entire body. This holistic approach facilitates a more precise evaluation of the overall effect on a patient's vital status. Conversely, only pertinent variables associated with that particular disease should be incorporated when investigating a specific condition.
PVS validation
The PVS is a mathematical tool that can help clinicians and researchers in disease-related decision-making processes. As such, it enables the possible evaluation of different drugs, conditions, therapy options, or treatment modalities on the patient's vital status. It provides an effective way of identifying substantial vital sign deviations and emerging disease trends. However, it is not suited for predicting the likelihood of death or specific outcomes such as ICU discharge. Instead, we focused on the patient's current state, enabling relative comparisons and differentiation between disease severities. A correlation was expected using similar variables as in the sepsis and SIRS definitions. However, the PVS has the potential to be extended to other clinically relevant variables.
In our example, SIRS or sepsis-related conditions showed spikes in the PVS. The maxima of these values (PVSmax) were used to characterize and compare the maximum disease-related severity in multiple patients (Fig. 2). The comparisons showed significant differences in terms of the highest achieved severity. This outcome is relevant because sepsis or SIRS were only brief events during the entire PICU stay. Also, timely treatment may counteract the detection of escalating vital signs as values quickly return to lower numbers.
While we found significant differences between sepsis-related conditions, we also provided evidence-based effect sizes to emphasize the clinical potential of these findings. At the same time, the PVSmax comparisons showed large effect sizes between disease conditions, and the average PVS values of the entire data set showed no significant differences. This outcome was expected, as the lower PVS values in the time series diluted the spiking events.
Since the present data had no controls, we hypothesized that the PVS on the last day before discharge had better 'health quality' than during the PICU stay. When we compared these data to the PVSmax in the annotated regions of the disease-related data, we found significant differences in all groups concerning the maximum and discharge PVS values. In the case of proven sepsis, e.g., the vast effect size indicated PVS-related discrimination between septic patients and the respective data on discharge day (Fig. 2). Further, we compared the PVS values on discharge day between all conditions and found no significant difference. This analysis acted as internal control with externally annotated data and further confirmed the ability of the PVS to indicate deviations in the patients' vital status (Fig. 1). In addition, significant differences were observed when comparing non-SIRS patients with patients in any septic state, further emphasizing the potentially discriminative power of the score (Fig. 3).
Limitations and prospects of PVS
The PVS is not a classic bedside score at this point, but it can be implemented in ICUs. It requires computational equipment, coding skills, and population-derived reference data. At this stage, the PVS differs from conventional scores used to assess, e.g., disease severity or risks. However, recent advances in artificial intelligence and other data-hungry processes have not stopped in medicine. They can potentially beat subjective scoring systems regarding precision, sensitivity, and specificity. Therefore, the PVS offers many options regarding future technological advances, such as disease and severity classification, risk assessment, and outcome prediction. However, in the current context of science and medicine, these methods serve only an advisory role. Despite remarkable advancements in the data sciences, the authority for interpretation and decision-making will remain in human hands for the foreseeable future.
Also, a more user-friendly application with less coding and better accessibility via a graphical user interface, such as a mobile phone application, is likely to enhance the acceptance and usability of the PVS method after future developments. Alternatively, the PVS could easily be implemented in any stationary ICU monitoring equipment. However, a deeper understanding and characterization of disease-specific variables and their sensitivity is needed for these prospects. Since any medicine-related measurements can be included in the PVS, new combinations, markers, and discriminators that accurately characterize specific diseases and the corresponding recovery processes may be found.
An essential aspect of the PVS calculation is the implemented scaling of the input variables before weight calculations. In the vital parameters, the measured ranges are different. While a temperature deviation of a few degrees is life-threatening, a higher heart rate, for example, is temporarily survivable. This range aspect is accurately addressed in the PVS score. Therefore, with sufficient data, it is possible to implement a risk prediction system using PVS scores in the future. However, while this study showed that the PVS could discriminate between the absence and presence of proven sepsis, it is essential to note that the score is not predictive using the data presented herein. The reason for this lies in the annotation of the data. Predictions require a model that is trained with labeled data. In the current data, patients were marked SIRS or suspected sepsis by the clinicians based on external parameters (see the Methods section) that were not optimized for machine learning.
Interestingly, many data points do not show any corresponding changes or noticeable deviations in vital signs. Without proper annotation or rules, the PVS introduces this annotation bias and further variance into any discriminatory system. Other methods must be found to discriminate between time series data and conditional transitions for specific diseases. This challenge also means that the PVS does not explain why a patient has a particular health status.
Furthermore, a physiological deviation of vital parameters also leads to a deviation in the PVS, with no underlying increase in disease severity. Still, the methodology can be adapted to specific clinical contexts that decide how to interpret future PVS applications. In this study, an increase in PVS was correlated with disease severity as physiological vital changes were not expected in a PICU setting with invasive blood pressure monitoring.
Future applications must address false values derived from, e.g., misplaced sensors and technical or human errors. It is also possible to use other artificial intelligence tools, such as the Random Forest model, to distinguish between accurate alerts and artifacts53,54.
The PVS aligns seamlessly with the computational methods prevalent in modern medical practice. In line with surgical robotics or fall detection devices, PVS supports assessing a patient's current vital status by fusing sensor data into one number – a technology that could easily be integrated into wearables, etc. Nevertheless, the PVS's potential and visionary application is its use in real-time vital status monitoring in ICUs and PICUs. This innovative application would provide invaluable information about improving or deteriorating patient conditions, treatment effects, and recovery. Ultimately, this enables healthcare professionals to respond more quickly to changes, which helps improve patients' health.
Conclusion
Our study demonstrates the substantial potential of the PVS as a quantitative tool for assessing the continuous physical status in an ICU setting. Although the PVS faces challenges from biased annotations, variable selection, and variance, it is well-suited to monitor the multidimensional vital status of individual patients. Therefore, PVS can be envisioned as a real-time patient monitoring method in critical care. Its potential ability to classify disease severity and monitor the interaction of different health markers provides a rich scope for study. Within this application alone, the PVS offers outstanding potential to improve patient care and adds meaningful contributions to critical care medicine. However, future research must explore its full potential, especially its broader applicability in other areas of medicine.
Data availability
The PVS code and documentation are available on GitHub (https://github.com/phohland/PVS). The data that support the findings of this study are available from41. Still, restrictions apply to the availability of these data, which were used under license for the current study and are not publicly available. Data are, however, available from the authors upon reasonable request and with permission of the ELISE project (https://www.zdin.de/digitales-niedersachsen/projektubersicht/elise).
Abbreviations
- ERC:
-
European resuscitation council
- ICU:
-
Intensive care unit
- MHH:
-
Hannover medical school
- MAP:
-
Mean arterial pressure
- PVS:
-
Patient vital status
- PEWS:
-
Pediatric early warning system
- PICU:
-
Pediatric intensive care unit
- RELSA:
-
Relative severity assessment score
- SMRS:
-
Sepsis mortality risk score
- SIRS:
-
Systemic inflammatory response syndrome
- SOFA:
-
Sepsis-related organ failure assessment Score
- bpm:
-
Beats per minute
- η2 :
-
Eta-squared
- m:
-
Number of entries
- mmHg:
-
Millimeter mercury
- n:
-
Sample size
- PVSmax :
-
Maximum patient vital status
- PVSav :
-
Average patient vital status
- ref:
-
Reference value
- ρ:
-
Pearson's correlation coefficient
- rpm:
-
Respirations per minute
- SD:
-
Standard deviation
- ID:
-
Patient identification number
- w:
-
Severity weight
References
Pellathy, T. P., Pinsky, M. R. & Hravnak, M. Intensive care unit scoring systems. Crit. Care Nurse 41(4), 54–64 (2021).
Vincent, J. & BruzzideCarvalho, F. Severity of illness. Semin. Respir. Crit. Care Med. 31(1), 31–38 (2010).
Lamprea, S. et al. Capillary refill time in sepsis: A useful and easily accessible tool for evaluating perfusion in children. Front. Pediatr. 10, 1035567 (2022).
Sanchez-Pinto, L. N., Luo, Y. & Churpek, M. M. Big data and data science in critical care. Chest 154(5), 1239–1248 (2018).
Falini, S., Angelotti, G. & Cecconi, M. ICU management based on big data. Curr. Opin. Anaesthesiol. 33(2), 162–169 (2020).
Sedhai, Y. R. et al. Validating measures of disease severity in acute respiratory distress syndrome. Ann. Am. Thorac. Soc. 18(7), 1211–1218 (2021).
Beckmann, J. S. & Lew, D. Reconciling evidence-based medicine and precision medicine in the era of big data: challenges and opportunities. Genome Med. 8(1), 134 (2016).
Carra, G., Salluh, J. I. F., da Silva Ramos, F. J. & Meyfroidt, G. Data-driven ICU management: Using big data and algorithms to improve outcomes. J. Crit. Care 60, 300–304 (2020).
Izonin, I. & Shakhovska, N. Special issue: Informatics & data-driven medicine-2021. Math Biosci. Eng. 19(10), 9769–9772 (2022).
Stone, D. J. & Csete, M. Actuating critical care therapeutics. J. Crit. Care 35, 90–95 (2016).
Talbot, S. R. et al. Defining body-weight reduction as a humane endpoint: A critical appraisal. Lab Anim. 54(1), 99–110 (2020).
Ernst, L. et al. Semi-automated generation of pictures for the Mouse Grimace Scale: A multi-laboratory analysis (Part 2). Lab Anim. 54(1), 92–98 (2020).
Ernst, L. et al. Improvement of the mouse grimace scale set-up for implementing a semi-automated mouse grimace scale scoring (Part 1). Lab Anim. 54(1), 83–91 (2020).
Schwabe, K. et al. Nest-building performance in rats: impact of vendor, experience, and sex. Lab Anim. 54(1), 17–25 (2020).
Wassermann, L. et al. Monitoring of heart rate and activity using telemetry allows grading of experimental procedures used in neuroscientific rat models. Front. Neurosci. 14, 587760 (2020).
Häger, C. et al. Running in the wheel: Defining individual severity levels in mice. PLoS Biol 16(10), e2006159 (2018).
Tang, G. et al. Comparing distress of mouse models for liver damage. Sci. Rep. 10(1), 19814 (2020).
Talbot, S. R. et al. RELSA-A multidimensional procedure for the comparative assessment of well-being and the quantitative determination of severity in experimental procedures. Front. Vet. Sci. 9, 937711 (2022).
Vincent, J. et al. Sepsis in European intensive care units: Results of the SOAP study. Crit. Care Med. 34(2), 344–353 (2006).
Damas, P. et al. Intensive care unit acquired infection and organ failure. Intensive Care Med. 34(5), 856–864 (2008).
Sivayoham, N. et al. Prognostic performance of the REDS score, SOFA score, NEWS2 score, and the red-flag, NICE high-risk, and SIRS criteria to predict survival at 180 days, in emergency department patients admitted with suspected sepsis - An observational cohort study. Front. Med. (Lausanne) 10, 985444 (2023).
Nunnally, M. E. et al. The Surviving Sepsis Campaign: Research priorities for the administration, epidemiology, scoring and identification of sepsis. Intensive Care Med. Exp. 9(1), 34 (2021).
Böhnke, J. et al. Prediction models for SIRS, sepsis and associated organ dysfunctions in paediatric intensive care: Study protocol for a diagnostic test accuracy study. BMJ Paediatr Open 6(1), e001618 (2022).
Lamping, F. et al. Development and validation of a diagnostic model for early differentiation of sepsis and non-infectious SIRS in critically ill children - a data-driven approach using machine-learning algorithms. BMC Pediatr 18(1), 112 (2018).
Seymour, C. W. et al. Time to treatment and mortality during mandated emergency care for sepsis. N. Engl. J. Med. 376(23), 2235–2244 (2017).
Fleuren, L. M. et al. Machine learning for the prediction of sepsis: A systematic review and meta-analysis of diagnostic test accuracy. Intensive Care Med. 46(3), 383–400 (2020).
Vincent, J. L. et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 22(7), 707–710 (1996).
Moreno, R. et al. The sequential organ failure assessment (SOFA) score: Has the time come for an update?. Crit. Care 27(1), 15 (2023).
Zhang, K. et al. Development and validation of a sepsis mortality risk score for sepsis-3 patients in intensive care unit. Front. Med. (Lausanne) 7, 609769 (2020).
Singer, M. et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 315(8), 801–810 (2016).
Liaw, P. C. et al. Mortality risk profiles for sepsis: A novel longitudinal and multivariable approach. Crit. Care Explor. 1(8), e0032 (2019).
Minne, L., Ludikhuize, J., de Jonge, E., de Rooij, S. & Abu-Hanna, A. Prognostic models for predicting mortality in elderly ICU patients: A systematic review. Intensive Care Med. 37(8), 1258–1268 (2011).
Klein Klouwenberg, P. M. C., Ong, D. S. Y., Bonten, M. J. M. & Cremer, O. L. Classification of sepsis, severe sepsis and septic shock: the impact of minor variations in data capture and definition of SIRS criteria. Intensive Care Med. 38(5), 811–819 (2012).
Gopalan, P. D. & Pershad, S. Decision-making in ICU - A systematic review of factors considered important by ICU clinician decision makers with regard to ICU triage decisions. J. Crit. Care 50, 99–110 (2019).
Liu, A. C. et al. Sepsis in the era of data-driven medicine: Personalizing risks, diagnoses, treatments and prognoses. Brief Bioinform. 21(4), 1182–1195 (2020).
Gunning, K. & Rowan, K. ABC of intensive care: Outcome data and scoring systems. BMJ 319(7204), 241–244 (1999).
De Backer, D. et al. A plea for personalization of the hemodynamic management of septic shock. Crit. Care 26(1), 372 (2022).
Parry, S. M. et al. Assessment of impairment and activity limitations in the critically ill: A systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 41(5), 744–762 (2015).
Wulff, A., Mast, M., Bode, L., Rathert, H. & Jack, T. Towards an evolutionary open pediatric intensive care dataset in the ELISE project. Stud. Health Technol. Inform. 295, 100–103 (2022).
Goldstein, B., Giroir, B. & Randolph, A. International pediatric sepsis consensus conference: Definitions for sepsis and organ dysfunction in pediatrics. Pediatr. Crit. Care Med. 6(1), 2–8 (2005).
Van de Voorde, P. et al. Paediatric life support. Resuscitation 2021–04(161), 327–387 (2021).
Fouzas, S. & Priftis, K. N. Anthracopoulos MB. Pulse oximetry in pediatric practice. Pediatrics 128(4), 740–752 (2011).
Temperature measurement in paediatrics. Paediatr Child Health 5(5), 273–276 (2000).
Mallien, A. S. et al. Comparative severity assessment of genetic, stress-based, and pharmacological mouse models of depression. Front. Behav. Neurosci. 16, 908366 (2022).
Talbot, S. R. et al. Robustness of a multivariate composite score when evaluating distress of animal models for gastrointestinal diseases. Sci. Rep. 13(1), 2605 (2023).
Segelcke, D. et al. Experimenter familiarization is a crucial prerequisite for assessing behavioral outcomes and reduces stress in mice not only under chronic pain conditions. Sci. Rep. 13(1), 2289 (2023).
Duncan, H., Hutchison, J. & Parshuram, C. S. The Pediatric Early Warning System score: A severity of illness score to predict urgent medical need in hospitalized children. J. Crit. Care 21(3), 271–278 (2006).
Nguyen, B. V., Bota, D. P., Mélot, C. & Vincent, J. Time course of hemoglobin concentrations in nonbleeding intensive care unit patients. Crit. Care Med. 31(2), 406–410 (2003).
Djuma, J., Kalenga, P., Kazadi, C., Orbegozo, D. & Vincent, J. L. Assessment of the severity of the condition of patients admitted to intensive care by measuring CRP. Pan. Afr. Med. J. 20, 401 (2015).
Modra, L. et al. Sex differences in illness severity and mortality among adult intensive care patients: A systematic review and meta-analysis. J. Crit. Care 65, 116–123 (2021).
Todorov, A. et al. Gender differences in the provision of intensive care: a Bayesian approach. Intensive Care Med. 47(5), 577–587 (2021).
Merdji, H. et al. Sex and gender differences in intensive care medicine. Intensive Care Med. 49(10), 1155–1167 (2023).
Chen, L. et al. Using supervised machine learning to classify real alerts and artifact in online multisignal vital sign monitoring data. Crit. Care Med. 44(7), 456 (2016).
Zhang, Z. et al. Effectiveness of automated alerting system compared to usual care for the management of sepsis. NPJ Digit. Med. 5(1), 101 (2022).
Funding
Open Access funding enabled and organized by Projekt DEAL. This study was supported by Else Kröner-Fresenius-Stiftung (Promotionsprogramm DigiStrucMed 2020_EKPK.20) and the German Research Foundation (DFG) – research group FOR 2591 (BL953/11–1, 11–2, and TA 2072/1-1).
Author information
Authors and Affiliations
Contributions
Conceptualization: S.R.T.; Methodology: S.R.T. and P.L.S.O.; Data provision and curation: T.J. and M.M.; Formal analysis, P.V.S. coding, and visualization: P.L.S.O. and S.R.T.; A.M. and A.B. contributed to methodology and writing—review and editing; Medical supervision: T.J. and A.M.; Writing and editing: P.L.S.O. and S.R.T.; Review and editing: A.B., A.M., M.M. and T.J. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ohland, P.L.S., Jack, T., Mast, M. et al. Continuous monitoring of physiological data using the patient vital status fusion score in septic critical care patients. Sci Rep 14, 7198 (2024). https://doi.org/10.1038/s41598-024-57712-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-57712-9
Keywords
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.