- Letter to the Editor
- Open Access
Validation of an adapted Pediatric Sepsis Score in children admitted to PICU with invasive infection and sepsis: a retrospective analysis of a Dutch national cohort
Journal of Intensive Care volume 10, Article number: 26 (2022)
We validated an adapted form of the Pediatric Sepsis Score (aPSS), a disease-specific severity score available within 60 min of PICU admission, in children with invasive infection. aPSS consist of all components of PSS except lactate. aPSS predicted mortality in children with invasive infection (n = 4096; AUC 0.70 (95% CI 0.67–0.73)) and in children with sepsis (n = 1690; AUC 0.71 (0.67–0.76)). aPSS can be an adequate tool to predict outcome in children admitted to PICU with invasive infection or sepsis, especially in situations where lactate is not available within 60 min.
To the editor,
The revised sepsis definitions in adults  highlight the need to identify patients with infection subject to substantially higher mortality. Early recognition of high-risk sepsis patients by organ dysfunction scores is key to select patients for specific therapies and for enrolment in trials.
While most organ dysfunction scores are based on the worst state within 24 h , the fulminant nature of pediatric sepsis warrants tools that can be applied to patients upon presentation. We previously developed the Pediatric Sepsis Score (PSS) , available within 60 min of PICU admission and predicting mortality superior to Paediatric Index of Mortality-2 (PIM2), also calculated within 60 min of PICU admission .
The PSS includes respiratory, cardiovascular, metabolic (lactate) and neurologic variables. As lactate is not always available within 60 min of PICU admission, we omitted this and studied an adapted form of PSS (aPSS).
This study aims to validate aPSS in an independent cohort and to compare its performance with PIM2.
Materials and methods
A retrospective analysis of the Dutch Pediatric Intensive Care Evaluation (PICE) registry (www.pice.nl) which prospectively records all children admitted to the 8 Dutch PICUs. We included non-elective patients < 16 years, who were admitted to PICU from 2003 to 2016, when a diagnosis of any invasive infection or sepsis was registered in the principal and/or the first underlying diagnostic fields. Invasive infection includes meningitis, pneumonia/pneumonitis, peritonitis, necrotizing fasciitis, osteomyelitis, endocarditis, tracheitis, epiglottitis, sepsis, septic shock, or toxic shock. This coding system is similar to the ANZPIC registry diagnostic code list . The aPSS was calculated as sum of scores allocated for each predictor; PaO2/FiO2 ratio (0 = ≥ 300, 3 = 100–300, 5 = < 100), ventilation during the first hour (0 = no, 3 = yes), systolic blood pressure (3 = age-specific hypotension), cardiac arrest (0 = no, 5 = yes), and pupils (0 = both reactive, 10 = both dilated, unresponsive) . The primary outcome was PICU mortality. Patients were classified as “having an underlying condition” if a chronic condition was present in any diagnostic field including the associated diagnostic fields [6, 7]. The AUC of aPSS was compared with PIM2.
4096 children (57% male, median age 2 years (IQR 0–7y)) were admitted to PICU with any invasive infection, including a subgroup of 1690 patients with sepsis (56% male, median age 2 years (IQR 0-8y)). Of all children, 1987/4096 (49%) were mechanically ventilated in the first hour of admission, the median PICU length of stay was 3.9 days (IQR 1.6–8.5 days), with a mean predicted death rate of 6.7% (SD 11.7) as per PIM2 and an observed mortality of 8.0% (329/4096). In the subgroup of patients with sepsis, 794/1690 (47%) were mechanically ventilated in the first hour, the median PICU length of stay was 3.2 days (IQR 1.3–7.3d), with a mean predicted death rate of 8.9% (SD 14.5) as per PIM2 and an observed mortality of 12% (210/1690).
aPSS was correlated to mortality in children with any invasive infection (Spearman r = 0.20, p < 0.001) and in the subgroup of children with sepsis (Spearman r = 0.26, p < 0.001) (Fig. 1). This finding was present in both children without underlying conditions and with underlying conditions (p < 0.001).
In children with any invasive infection, aPSS predicted mortality with an AUC of 0.70 (95%-CI 0.67–0.73) (Table 1). In children with sepsis, aPSS predicted mortality with an AUC of 0.71 (95%-CI 0.67–0.76). aPSS discriminated better in children without underlying conditions than in children with underlying conditions. Comparing the aPSS with PIM2, the discrimination ability on the primary outcome was less in any invasive infection, but equal in sepsis.
Improving treatment of children with suspected sepsis relies on accurate and rapid recognition of patients at higher risk of poor outcomes. Whereas PSS was developed in Australia and New Zealand, this independent validation demonstrates that aPSS performs adequately for mortality. aPSS seems an important addition as in many locations lactate is not available within 60 min of admission to a PICU.
Overall, the performance of aPSS in the Dutch validation dataset was lower compared to the performance of PSS reported in the Australian and New Zealand cohort, in which the PSS was derived. First, lactate was an independent predictor of mortality in the original dataset , and hence lack of lactate likely contributed to lower score performance. Second, different practices in coding strategies may affect patient severity. However, the findings demonstrate the importance of independent validation as the original score was developed within cohort.
Despite these limitations, this validation study demonstrates that aPSS could be a tool to detect organ dysfunction, to predict mortality, and can be used especially in situations where lactate is not available within 60 min. The discriminative performance of aPSS was less in invasive infections, but equally compared to PIM2 in sepsis.
Future studies should aim to validate the aPSS and full PSS including lactate more extensive.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Adapted Pediatric Sepsis Score
Pediatric intensive care evaluation
Paediatric index of mortality-2
Pediatric Sepsis Score
Dutch collaborative PICU research network
Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10.
Schlapbach LJ, Straney L, Bellomo R, MacLaren G, Pilcher D. Prognostic accuracy of age-adapted SOFA, SIRS, PELOD-2, and qSOFA for in-hospital mortality among children with suspected infection admitted to the intensive care unit. Intensive Care Med. 2018;44(2):179–88.
Schlapbach LJ, MacLaren G, Festa M, Alexander J, Erickson S, Beca J, et al. Prediction of pediatric sepsis mortality within 1 h of intensive care admission. Intensive Care Med. 2017;43(8):1085–96.
Slater A, Shann F, Pearson G, Paediatric Index of Mortality Study G. PIM2: a revised version of the Paediatric Index of Mortality. Intensive Care Med. 2003;29(2):278–85.
Slater A, Shann F, McEniery J, Group AS. The ANZPIC registry diagnostic codes: a system for coding reasons for admitting children to intensive care. Intensive Care Med. 2003;29(2):271–7.
Verlaat CW, Visser IH, Wubben N, Hazelzet JA, Lemson J, van Waardenburg D, et al. Factors associated with mortality in low-risk pediatric critical care patients in The Netherlands. Pediatr Crit Care Med. 2017;18(4):e155–61.
Feudtner C, Christakis DA, Connell FA. Pediatric deaths attributable to complex chronic conditions: a population-based study of Washington State, 1980–1997. Pediatrics. 2000;106(1 Pt 2):205–9.
On behalf of the SKIC (Dutch collaborative PICU Research Network), the Pediatric Intensive Care Evaluation (PICE) working group members: Casper Bollen, MD, PhD (Department of Pediatric Intensive Care, University Medical Center Utrecht, Utrecht, The Netherlands); Marc van Heerde, MD, PhD (Department of Pediatric Intensive Care, Emma Children’s Hospital, Amsterdam University Medical Centers, location AMC, Amsterdam, The Netherlands); Douwe van der Heide, RN (Faculty Board Member, PICE Registry, The Netherlands); Richard Klein, MD, PhD (Department of Pediatric Intensive Care, Leiden University Medical Center, Leiden, The Netherlands); Martin Kneyber, MD, PhD, FCCM (Department of Pediatric Intensive Care, University Medical Center Groningen, Groningen, The Netherlands); Jan-Willem Kuiper, MD, PhD (Department of Pediatric Intensive Care, Erasmus University Medical Center-Sophia Children’s Hospital, Rotterdam, The Netherlands); Maaike Riedijk, MD, PhD (Department of Pediatric Intensive Care, Emma Children’s Hospital, Amsterdam University Medical Centers, location AMC, Amsterdam, The Netherlands)); Carin Verlaat, MD (Department of Pediatric Intensive Care, Radboud University Medical Center, Nijmegen, The Netherlands); and Dick van Waardenburg, MD, PhD (Department of Pediatric Intensive Care, Academic Hospital Maastricht, Maastricht, The Netherlands).
LJS was supported by a Practitioner Fellowship of the National Health and Medical Research Council of Australia and New Zealand, and by the Children`s Hospital Foundation, Brisbane, Australia. The funders were not involved in the design of the study, collection, analysis, interpretation of data, or in writing the manuscript.
Ethics approval and consent to participate
This study was conducted in accordance with the Declaration of Helsinki and Good Clinical Practice guidelines. The Medical Ethics Review Board of University Medical Center Groningen reviewed the study and waived the necessity for written informed consent as this study is considered not a clinical research with human subjects as meant in the Medical Research Involving Human Subjects Act (WMO) (METc UMCG number 2021/498).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Boeddha, N.P., Schlapbach, L.J., Visser, I.H. et al. Validation of an adapted Pediatric Sepsis Score in children admitted to PICU with invasive infection and sepsis: a retrospective analysis of a Dutch national cohort. j intensive care 10, 26 (2022). https://doi.org/10.1186/s40560-022-00618-3
- Organ dysfunction
- Septic shock