Skip to main content

Validation of an adapted Pediatric Sepsis Score in children admitted to PICU with invasive infection and sepsis: a retrospective analysis of a Dutch national cohort

Abstract

We validated an adapted form of the Pediatric Sepsis Score (aPSS), a disease-specific severity score available within 60 min of PICU admission, in children with invasive infection. aPSS consist of all components of PSS except lactate. aPSS predicted mortality in children with invasive infection (n = 4096; AUC 0.70 (95% CI 0.67–0.73)) and in children with sepsis (n = 1690; AUC 0.71 (0.67–0.76)). aPSS can be an adequate tool to predict outcome in children admitted to PICU with invasive infection or sepsis, especially in situations where lactate is not available within 60 min.

To the editor,

The revised sepsis definitions in adults [1] highlight the need to identify patients with infection subject to substantially higher mortality. Early recognition of high-risk sepsis patients by organ dysfunction scores is key to select patients for specific therapies and for enrolment in trials.

While most organ dysfunction scores are based on the worst state within 24 h [2], the fulminant nature of pediatric sepsis warrants tools that can be applied to patients upon presentation. We previously developed the Pediatric Sepsis Score (PSS) [3], available within 60 min of PICU admission and predicting mortality superior to Paediatric Index of Mortality-2 (PIM2), also calculated within 60 min of PICU admission [4].

The PSS includes respiratory, cardiovascular, metabolic (lactate) and neurologic variables. As lactate is not always available within 60 min of PICU admission, we omitted this and studied an adapted form of PSS (aPSS).

This study aims to validate aPSS in an independent cohort and to compare its performance with PIM2.

Materials and methods

A retrospective analysis of the Dutch Pediatric Intensive Care Evaluation (PICE) registry (www.pice.nl) which prospectively records all children admitted to the 8 Dutch PICUs. We included non-elective patients < 16 years, who were admitted to PICU from 2003 to 2016, when a diagnosis of any invasive infection or sepsis was registered in the principal and/or the first underlying diagnostic fields. Invasive infection includes meningitis, pneumonia/pneumonitis, peritonitis, necrotizing fasciitis, osteomyelitis, endocarditis, tracheitis, epiglottitis, sepsis, septic shock, or toxic shock. This coding system is similar to the ANZPIC registry diagnostic code list [5]. The aPSS was calculated as sum of scores allocated for each predictor; PaO2/FiO2 ratio (0 =  ≥ 300, 3 = 100–300, 5 =  < 100), ventilation during the first hour (0 = no, 3 = yes), systolic blood pressure (3 = age-specific hypotension), cardiac arrest (0 = no, 5 = yes), and pupils (0 = both reactive, 10 = both dilated, unresponsive) [3]. The primary outcome was PICU mortality. Patients were classified as “having an underlying condition” if a chronic condition was present in any diagnostic field including the associated diagnostic fields [6, 7]. The AUC of aPSS was compared with PIM2.

Results

4096 children (57% male, median age 2 years (IQR 0–7y)) were admitted to PICU with any invasive infection, including a subgroup of 1690 patients with sepsis (56% male, median age 2 years (IQR 0-8y)). Of all children, 1987/4096 (49%) were mechanically ventilated in the first hour of admission, the median PICU length of stay was 3.9 days (IQR 1.6–8.5 days), with a mean predicted death rate of 6.7% (SD 11.7) as per PIM2 and an observed mortality of 8.0% (329/4096). In the subgroup of patients with sepsis, 794/1690 (47%) were mechanically ventilated in the first hour, the median PICU length of stay was 3.2 days (IQR 1.3–7.3d), with a mean predicted death rate of 8.9% (SD 14.5) as per PIM2 and an observed mortality of 12% (210/1690).

aPSS was correlated to mortality in children with any invasive infection (Spearman r = 0.20, p < 0.001) and in the subgroup of children with sepsis (Spearman r = 0.26, p < 0.001) (Fig. 1). This finding was present in both children without underlying conditions and with underlying conditions (p < 0.001).

Fig. 1
figure 1

PICU mortality in children admitted to the Dutch PICUs is stratified by the adapted Pediatric Sepsis Score. A Children with any invasive infection (n = 4096. B Children with sepsis (n = 1690)

In children with any invasive infection, aPSS predicted mortality with an AUC of 0.70 (95%-CI 0.67–0.73) (Table 1). In children with sepsis, aPSS predicted mortality with an AUC of 0.71 (95%-CI 0.67–0.76). aPSS discriminated better in children without underlying conditions than in children with underlying conditions. Comparing the aPSS with PIM2, the discrimination ability on the primary outcome was less in any invasive infection, but equal in sepsis.

Table 1 AUC for aPSS as compared with the PIM2 are shown for PICU mortality

Discussion

Improving treatment of children with suspected sepsis relies on accurate and rapid recognition of patients at higher risk of poor outcomes. Whereas PSS was developed in Australia and New Zealand, this independent validation demonstrates that aPSS performs adequately for mortality. aPSS seems an important addition as in many locations lactate is not available within 60 min of admission to a PICU.

Overall, the performance of aPSS in the Dutch validation dataset was lower compared to the performance of PSS reported in the Australian and New Zealand cohort, in which the PSS was derived. First, lactate was an independent predictor of mortality in the original dataset [3], and hence lack of lactate likely contributed to lower score performance. Second, different practices in coding strategies may affect patient severity. However, the findings demonstrate the importance of independent validation as the original score was developed within cohort.

Despite these limitations, this validation study demonstrates that aPSS could be a tool to detect organ dysfunction, to predict mortality, and can be used especially in situations where lactate is not available within 60 min. The discriminative performance of aPSS was less in invasive infections, but equally compared to PIM2 in sepsis.

Future studies should aim to validate the aPSS and full PSS including lactate more extensive.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

aPSS:

Adapted Pediatric Sepsis Score

PICE:

Pediatric intensive care evaluation

PIM2:

Paediatric index of mortality-2

PSS:

Pediatric Sepsis Score

SKIC:

Dutch collaborative PICU research network

References

  1. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  2. Schlapbach LJ, Straney L, Bellomo R, MacLaren G, Pilcher D. Prognostic accuracy of age-adapted SOFA, SIRS, PELOD-2, and qSOFA for in-hospital mortality among children with suspected infection admitted to the intensive care unit. Intensive Care Med. 2018;44(2):179–88.

    Article  PubMed  Google Scholar 

  3. Schlapbach LJ, MacLaren G, Festa M, Alexander J, Erickson S, Beca J, et al. Prediction of pediatric sepsis mortality within 1 h of intensive care admission. Intensive Care Med. 2017;43(8):1085–96.

    Article  PubMed  Google Scholar 

  4. Slater A, Shann F, Pearson G, Paediatric Index of Mortality Study G. PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med. 2003;29(2):278–85.

    Article  PubMed  Google Scholar 

  5. Slater A, Shann F, McEniery J, Group AS. The ANZPIC registry diagnostic codes: a system for coding reasons for admitting children to intensive care. Intensive Care Med. 2003;29(2):271–7.

    Article  Google Scholar 

  6. Verlaat CW, Visser IH, Wubben N, Hazelzet JA, Lemson J, van Waardenburg D, et al. Factors associated with mortality in low-risk pediatric critical care patients in The Netherlands. Pediatr Crit Care Med. 2017;18(4):e155–61.

    Article  PubMed  Google Scholar 

  7. Feudtner C, Christakis DA, Connell FA. Pediatric deaths attributable to complex chronic conditions: a population-based study of Washington State, 1980–1997. Pediatrics. 2000;106(1 Pt 2):205–9.

    CAS  Article  PubMed  Google Scholar 

Download references

Acknowledgements

On behalf of the SKIC (Dutch collaborative PICU Research Network), the Pediatric Intensive Care Evaluation (PICE) working group members: Casper Bollen, MD, PhD (Department of Pediatric Intensive Care, University Medical Center Utrecht, Utrecht, The Netherlands); Marc van Heerde, MD, PhD (Department of Pediatric Intensive Care, Emma Children’s Hospital, Amsterdam University Medical Centers, location AMC, Amsterdam, The Netherlands); Douwe van der Heide, RN (Faculty Board Member, PICE Registry, The Netherlands); Richard Klein, MD, PhD (Department of Pediatric Intensive Care, Leiden University Medical Center, Leiden, The Netherlands); Martin Kneyber, MD, PhD, FCCM (Department of Pediatric Intensive Care, University Medical Center Groningen, Groningen, The Netherlands); Jan-Willem Kuiper, MD, PhD (Department of Pediatric Intensive Care, Erasmus University Medical Center-Sophia Children’s Hospital, Rotterdam, The Netherlands); Maaike Riedijk, MD, PhD (Department of Pediatric Intensive Care, Emma Children’s Hospital, Amsterdam University Medical Centers, location AMC, Amsterdam, The Netherlands)); Carin Verlaat, MD (Department of Pediatric Intensive Care, Radboud University Medical Center, Nijmegen, The Netherlands); and Dick van Waardenburg, MD, PhD (Department of Pediatric Intensive Care, Academic Hospital Maastricht, Maastricht, The Netherlands).

Funding

LJS was supported by a Practitioner Fellowship of the National Health and Medical Research Council of Australia and New Zealand, and by the Children`s Hospital Foundation, Brisbane, Australia. The funders were not involved in the design of the study, collection, analysis, interpretation of data, or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

LJS and NPB designed the study, led analyses, interpreted the data, wrote the first draft and the final manuscript. IHV and NJGJ were involved in design, data interpretation, manuscript writing and approved the final manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Navin P. Boeddha.

Ethics declarations

Ethics approval and consent to participate

This study was conducted in accordance with the Declaration of Helsinki and Good Clinical Practice guidelines. The Medical Ethics Review Board of University Medical Center Groningen reviewed the study and waived the necessity for written informed consent as this study is considered not a clinical research with human subjects as meant in the Medical Research Involving Human Subjects Act (WMO) (METc UMCG number 2021/498).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Boeddha, N.P., Schlapbach, L.J., Visser, I.H. et al. Validation of an adapted Pediatric Sepsis Score in children admitted to PICU with invasive infection and sepsis: a retrospective analysis of a Dutch national cohort. j intensive care 10, 26 (2022). https://doi.org/10.1186/s40560-022-00618-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40560-022-00618-3

Keywords

  • Child
  • Mortality
  • Organ dysfunction
  • Sepsis
  • Septic shock
  • Score