- Open Access
Predicting treatment failure in patients with community acquired pneumonia: a case-control study
Respiratory Research volume 15, Article number: 75 (2014)
Treatment failure in community-acquired-pneumonia (CAP) patients is associated with a high mortality rate, and therefore are a matter of great concern in clinical management. Those patients have increased mortality and are a target population for randomized clinical trials.
A case–control study was performed in patients with CAP (non-failure cases vs. failure cases, discriminating by late and early failure). CRP, PCT, interleukin 1, 6, 8 and 10 and TNF were determined at days 1 and 3 of hospitalization.
A total of 253 patients were included in this study where 83 patients presented treatment failure. Of these, 40 (48.2%) had early failure. A discriminative effect was found for a higher CURB-65 score among late failure patients (p = 0.004). A significant increase on day 1 of hospitalization in CRP (p < 0.001), PCT (p = 0.004), IL-6 (p < 0.001) and IL-8 (p = 0.02), and a decrease in IL-1 (p = 0.06) in patients with failure was observed compared with patients without failure. On day 3, only the increase in CRP (p < 0.001), PCT (p = 0.007) and IL-6 (p < 0.001) remained significant. Independent predictors for early failure were higher IL-6 levels on day 1 (OR = 1.78, IC = 1.2-2.6) and pleural effusion (OR = 2.25, IC = 1.0-5.3), and for late failure, higher PCT levels on day 3 (OR = 1.60, IC = 1.0-2.5), CURB-65 score ≥ 3 (OR = 1.43, IC = 1.0-2.0), and multilobar involvement (OR = 4.50, IC = 2.1-9.9).
There was a good correlation of IL-6 levels and CAP failure and IL-6 & PCT with late CAP failure. Pleural effusion and multilobar involvement were simple clinical predictors of early and late failure, respectively.
IRB Register: http://2009/5451.
Community-acquired pneumonia (CAP) is a major health problem worldwide. Clinically, CAP exhibits enormous variety in the severity of presentation, from septic shock at one end of the spectrum to almost asymptomatic disease at the other . Treatment failure is a matter of great concern in the management of CAP. The reported incidence of treatment failure among hospitalized patients with CAP ranges from 2.4% to 31% for early failure and from 3.9% to 11% for late failure .
It has been recognized that an excessive systemic proinflammatory response in patients with sepsis and severe CAP is associated with deleterious effects and a worse prognosis . Conversely, an exaggerated anti-inflammatory response conducted by some grade of impaired immune response may have a negative effect on clinical resolution . Among the cytokines involved in the inflammatory response, we can include interleukin 10 (IL-10) as a critical anti-inflammatory cytokine that attenuates inflammatory responses in macrophages and T cells, tumor necrosis factor (TNF-α), interleukin 1 (IL-1), interleukin 6 (IL-6) and interleukin 8 (IL-8) . Some inflammation markers, such as C-reactive protein (CRP) and procalcitonin (PCT), have been recognized for some time in clinical management, . Therefore, besides clinical factors, cytokine levels can predict CAP-failure and should be included to determine those patients with CAP who are most at risk of developing treatment failure. Early prediction of CAP-failure is a critical step toward better management and improvement of survival. In this study, we aimed to determine clinical and cytokine-level predictors of CAP-failure, including the different types of failure (early and late). The aim of this research is to ascertain the parameters, including cytokine levels, for predicting CAP failure in general, and more specifically, late and early failure.
This study was approved by the Ethics Committee of Hospital Clinic, Barcelona, Spain (IRB Register: 2009/5451) and patients or their relatives signed informed consent.
Patients and methods
A case–control study in patients with CAP was conducted by the Pneumology Department in Hospital Clínic, Barcelona, Spain and Hospital de la Fe, Valencia, Spain. Cases were considered to be patients with CAP who developed treatment failure and controls were CAP patients who did not develop failure after a follow-up until they were discharged. Patients with CAP (failure and non-failure) were enrolled between January 2002 and December 2003. For each case, 1 to 2 controls were included and matched by age and time of hospitalization (hospitalized during the same week).
The diagnosis of pneumonia was based on the presence of acute onset of signs and symptoms suggesting lower respiratory tract infection on admission, and radiographic evidence of a pulmonary infiltrate that had no other known cause . CAP and Health Care—Associated Pneumonia (HCAP) patients were included in the present study. Exclusion criteria were patients with tuberculosis, obstructive pneumonia caused by neoplasia or pneumonia as a terminal event of chronic and progressive disease, HIV infection, neoplasia, those taking cytotoxic drugs or long-term oral steroid therapy, such as daily dose of 20 mg of prednisolone or the equivalent for >2 weeks and patients with a previous admission within the previous 15 days.
Patients with CAP (failure and non-failure) were enrolled over a 24 month period. All CAP-failure without exclusion criteria were included, and 1 to 2 non-failure CAP hospitalized within the same period of admission (within the same week) were included as controls.
The following data were recorded from CAP patients using a standard questionnaire: age, gender, smoking history, alcohol abuse (> 80 g/day) and comorbidities (chronic obstructive pulmonary disease (COPD), cardiac, liver, renal, digestive or central nervous system diseases). The initial severity was assessed using the pneumonia severity index (PSI) and CURB 65 (confusion, urea, respiratory rate, blood pressure and age) score .
Early treatment failure was defined, as clinical deterioration within 72 h of treatment, as indicated by development of shock, need for invasive mechanical ventilation, or death. Late treatment failure was defined as radiographic progression (increase > 50% of pulmonary infiltrates compared to baseline), persistence of severe respiratory failure (PaO2/FiO2 < 200, with respiratory rate > 30 min-1 in non-intubated patients), development of shock, need for invasive mechanical ventilation, or death between 72 and 96 h after start of treatment [9, 10]. Severe sepsis and septic shock were defined following the criteria of the American College of Chest Physicians and the Society of Critical Care Medicine . The indications for mechanical ventilation and/or inotropic support were left to the discretion of the attending physicians.
Measurements of serum cytokines and laboratory procedures
Blood samples were drawn from all patients on enrolment in the study, immediately at the moment of pneumonia diagnosis, and at day three after admission. Blood was centrifuged, coded, and serum aliquoted and frozen at -80°C until subsequent analysis. IL-10, TNF-α, IL-1, IL-8 and IL-6 protein levels were measured blinded to the groups, using a commercial enzyme immunoassay technique (BioSource, Nivelles, Belgium). The limit of detection was 1 pg/mL. CRP and PCT were measured using standard procedures. Cytokine measurements were carried out on the day of hospitalization (day 1) and at day 3 of hospitalization. Microbiological diagnostic were carried out using routine procedures.
Statistical analysis and data management
Statistical analysis was performed using the SPSS 17.0 and STATA 10.0 software programs. Results are presented as mean, standard deviation (SD), median, frequency or percentage, as required. Continuous variables were analyzed using the t test, whereas categorical variables were analyzed using the χ2 test. Non-parametric tests (Mann–Whitney U, Kruskal-Wallis or Fisher test) were used when necessary. The association was adjusted using multivariate logistic regression and multinomial (polytomous) logistic regression when stratifying cases by early and late failure . ROC analysis was performed for each cytokine level regarding CAP failure, early CAP failure and late CAP failure. CRP levels were used as a baseline for comparisons. Cut-offs of maximum sensitivity/specificity were determined for each cytokine level and different outcomes (failure, early failure and late failure), at day 1 and day 3 of hospitalization. Cytokine levels were categorized and analyzed in equivalent quartiles. Effects were calculated as odds ratios (OR) with their corresponding 95% confidence intervals (CI). A p-value of 0.05 was considered significant for the univariate analysis, and variables with p < 0.1 were considered in the logistic regression model. Early failure cases were dropped when considering cytokine levels at day 3 of admission.
A total of 253 patients with CAP were included in this study (mean [SD] age, 69.1 [16.1] years; range, 19–91 years): Briefly, the distribution of subjects of CURB 65 classes among CAP patients was: 0-I, n = 102 (40.3%); II-III, n = 117 (46.1%); IV-V, n = 34 (13.4%). Septic shock was present in 31 patients (12.8%). The main demographic characteristics, comorbid conditions and severity are shown in Table 1. Eighty-three patients (32.9%) developed treatment failure, of which 40 (48.2%) had early failure. Table 1 shows the general results and univariate analysis of CAP and CAP failure.
Microbiological documentation of CAP was achieved in 106 patients (41.9%). Streptococcus pneumoniae was the most common pathogen isolated (17.8%), followed by Legionella pneumophila (5.1%) and Staphylococcus aureus (3.9%). A total of 46.9% of the patients received third generation cephalosporin and a macrolide, 23.2% quinolone alone and 8.7% third generation cephalosporin and quinolone as first line treatment. Significant differences were found between patients with and without treatment failure. Patients with treatment failure presented higher severity index or PSI scores (mean [SD], 109.6 [42.2] vs. 97.8 [36.6]; p = 0.02), higher prevalence of pleural effusion (26.5% vs. 14.1%; p = 0.006), and ICU admission (36% vs. 3%; p < 0.001) with multilobar involvement (52.1% vs. 47.2%; p < 0.001) than those without treatment failure. Length of hospital stay was higher in patients who presented treatment failure (mean [SD], 17.1 [14.1] days vs. 8.1 [5.7] days; p < 0.001). Thirty-one patients died (12.3%): 28 of 83 with treatment failure (33%) and 3 of 170 without treatment failure (1.8%) (p < 0.001). Data are summarized in Table 1.
Cytokine levels and CAP failure
With regard to cytokine levels, when comparing CAP vs. CAP failure, we found a significant increase on day 1 of hospitalization in CRP (p < 0.001), PCT (p = 0.004), IL-6 (p < 0.001) and IL-8 (p = 0.02). When stratifying CAP-failure cases by early failure or late failure, we found a discriminating effect of PCT for late failure on day 1 (p = 0.005), while it remained non-significant among patients with early failure (p = 0.3). This was also observed, though less marked, in IL-8 on day 1 (p = 0.06) and a protective effect of IL-1 against late failure was found only on day 1 (p = 0.04). On day 3, CRP levels (p = 0.05), IL-6 levels (p = 0.007) and PCT levels (p = 0.001), were significantly higher among patients that developed late failure compared to non-failure cases. No significant increases or decreases were observed in IL-10 or TNF. Figures 1, 2, 3 and 4 show the box-plots and OR comparing CAP vs. CAP failure and CRP, Il-6, IL-8 and PCT on day 1 of hospitalization. Supplementary material (Additional file 1: Figure S1–S10) shows the box-plots and OR for trend for each outcome and cytokine level and day of hospitalization. No measurable predicting effect was observed when considering the coefficient of variation between day 1 and day 3 in cases with treatment failure.
To determine the usefulness of those parameters for predicting CAP failure, we performed ROC (area under the curve, AUC) analysis of significant cytokine levels (CRP, PCT, IL-1, IL-6 and IL-8) (Tables 2, 3 and 4). Taking CRP AUC analysis as a reference, we found that IL-6 showed better performance at predicting CAP failure on day 1. This difference was also observed when stratifying the analysis into early and late failure (Table 4). In addition, we found a discriminating effect of PCT levels compared to CRP in the CAP late-failure group, with a better sensitivity/specificity ratio compared to CRP levels on day 1 and day 3 (Table 3).
Predicting CAP failure
A logistic regression model was applied to all clinical and cytokine levels included in this study to determine independent predictive factors for CAP failure, including early and late failure. A final model to predict CAP failure includes higher IL-6 levels on day 1, CURB 65 score ≥ 3, pleural effusion and multilobar involvement. Regarding early failure, significant and independent predictors were higher IL-6 levels on day 1 and pleural effusion, and for late failure, higher PCT levels on day 3, CURB 65 score ≥ 3, and multilobar involvement. Table 5 shows raw and adjusted analysis of the variables included in the final logistic regression model.
We determined a set of clinical and biological factors that can be used to predict CAP failure and to discriminate those patients at risk of developing early (IL-6) and late (IL-6 and PCT) failure to improve prevention measures and clinical management. It is important to remark that, in some conditions, clinical symptoms are not accurate enough and clinicians must look for biological markers. In consequence, proper follow-up using specific biological markers should help to discriminate early and late failure and better monitoring of patients at risk.
Early failure has been commonly used as a surrogate for progressive pneumonia with clinical deterioration within the first 72 h after hospital admission . It is in this phase that the patient is more vulnerable to serious deterioration and often requires advance support treatment based on vasopressors and/or mechanical ventilation. In our study, IL-6 showed the best correlation in predicting early CAP failure (better than the widely used CRP). It is important to remark that blood levels of CRP are primarily regulated by the production of IL-6 . In clinical practice the use of CRP can be seen as a surrogate marker for levels of IL-6 . Furthermore, the presence of elevated levels of IL-6 has a good correlation with not only early but also late failure on day 1 and 3 Unfortunately, IL-6 is not used in clinical practice and merits further discussion. IL-6 is a pleiotropic cytokine and its function is yet to be fully determined . IL-6 is a marker of severity and prognosis of severe infections, although their causal relationship remains unclear. IL-6 can be secreted in response to specific microbial molecules that induce intracellular signaling cascades that give rise to inflammatory cytokine production . We also found that IL-6 is a better marker for detecting treatment than PCT. However, PCT may be more valuable for discriminating late failure at an earlier phase than IL-6 and CRP and, therefore, defining a subset of patients who deserve close monitoring. In addition to these results, we show the AUC analysis of the different cytokines considered and the cut-off for sensitivity and sensibility, to explore their usefulness as treatment failure predictors in future prospective studies. No relevant association was found for IL-10 and TNF levels and CAP failure.
In terms of the clinical factors under study, we found that multilobar involvement associated not only with general with CAP failure, but also specifically with late treatment failure. Other authors have investigated independent factors associated with early deaths in CAP and have shown that age, abnormal mental status, multilobar pneumonia, shock, bacteremia, and inadequate empiric antibiotic therapy were predictors of death within 48 hours . Knowing predictors of treatment failure is important because this outcome parameter may assist further studies in understanding the benefits of new antibacterial or co-adjuvant therapies without including a large population, which would be needed if mortality was the outcome chosen .
To our knowledge, this is the first study in which the kinetics of biomarkers have been investigated to detect treatment failure using a case–control design. In this sense, it is remarkably different than previous observational studies. Our findings reinforce results from previous studies , . Nevertheless, this study has a more suitable design, which may sustain implementation of scientific results in clinical practice. In the case of treatment failure in CAP, we have followed recommendations: 1-Starting with cross sectional studies, 2-Confirming these results with a case–control and 3-The final step would be to carry out proper cohort studies.
This study has some limitations that should be mentioned. The number of critically ill patients admitted is low and our results need to be validated in a cohort of patients admitted to ICU in order to minimize selection bias. One of the limitations of this study as well as several other studies of biomarkers of severity or failure is that although the mean values of certain cytokines are statistically different from patients with failure vs patients without failure, the wide range of values for particular cytokines make it difficult to use the value of a single patient to predict clinical outcomes. Although samples were not taken from patients on a daily basis, we chose to obtain samples at day 1 and 3 in order to implement our study design in current clinical practice, and some patients without treatment failure were discharged before day three (n = 24). However, when excluding those patients from the general analysis, results and conclusions showed no significant changes.
In summary, patients with treatment failure presented higher levels of IL-6 on admission to hospital and a CURB 65 score of 3 or more. Interestingly, high levels of IL-6 had a high predictive value for early and late failure on days 1 and for late failure on day 3, showing that IL-6 is a good marker for progression to treatment failure, and PCT may have a discriminative effect for predicting late failure. In conclusion, a combination of IL-6, PCT and CURB 65 score could provide a new tool for predicting failure and early and late failure. Pleural effusion and multilobar involvement were simple clinical predictors of early and late failure, respectively.
Menéndez R, Sahuquillo-Arce JM, Reyes S, Martínez R, Polverino E, Cillóniz C, Córdoba JG, Montull B, Torres A: Cytokine activation patterns and biomarkers are influenced by microorganisms in community-acquired pneumonia. Chest. 2012, 141: 1537-45.
Garcia-Vidal C, Carratalà J: Early and late treatment failure in community-acquired pneumonia. Semin Respir Crit Care Med. 2009, 30: 154-60.
Ramírez P, Ferrer M, Martí V, Reyes S, Martínez R, Menéndez R, Ewig S, Torres A: Inflammatory biomarkers and prediction for intensive care unit admission in severe community-acquired pneumonia. Crit Care Med. 2011, 39: 2211-7.
Boomer JS, To K, Chang KC, Takasu O, Osborne DF, Walton AH, Bricker TL, Jarman SD, Kreisel D, Krupnick AS, Srivastava A, Swanson PE, Green JM, Hotchkiss RS: Immunosuppression in patients who die of sepsis and multiple organ failure. JAMA. 2011, 306: 2594-605.
Yende S, D’Angelo G, Kellum JA, Weissfeld L, Fine J, Welch RD, Kong L, Carter M, Angus DC: Inflammatory markers at hospital discharge predict subsequent mortality after pneumonia and sepsis. Am J Respir Crit Care Med. 2008, 177: 1242-7.
Bloos F, Marshall JC, Dellinger RP, Vincent J-L, Gutierrez G, Rivers E, Balk RA, Laterre P-F, Angus DC, Reinhart K, Brunkhorst FM: Multinational, observational study of procalcitonin in ICU patients with pneumonia requiring mechanical ventilation: a multicenter observational study. Crit Care. 2011, 15: R88-
Mandell LA, Wunderink RG, Anzueto A, Bartlett JG, Campbell GD, Dean NC, Dowell SF, File TM, Musher DM, Niederman MS, Torres A, Whitney CG: Infectious Diseases Society of America/American Thoracic Society consensus guidelines on the management of community-acquired pneumonia in adults. Clin Infect Dis. 2007, 44 Suppl 2 (Suppl 2): S27-S72.
Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA, Singer DE, Coley CM, Marrie TJ, Kapoor WN: A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med. 1997, 336: 243-50.
Arancibia F, Ewig S, Martinez JA, Ruiz M, Bauer T, Marcos MA, Mensa J, Torres A: Antimicrobial treatment failures in patients with community-acquired pneumonia: causes and prognostic implications. Am J Respir Crit Care Med. 2000, 162: 154-60.
Menéndez R, Torres A, Zalacaín R, Aspa J, Martín Villasclaras JJ, Borderías L, Benítez Moya JM, Ruiz-Manzano J, Rodríguez de Castro F, Blanquer J, Pérez D, Puzo C, Sánchez Gascón F, Gallardo J, Alvarez C, Molinos L: Risk factors of treatment failure in community acquired pneumonia: implications for disease outcome. Thorax. 2004, 59: 960-5.
Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent J-L, Ramsay G: SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Intensive Care Med. 2001, 2003 (29): 530-8.
Biesheuvel CJ, Vergouwe Y, Steyerberg EW, Grobbee DE, Moons KGM: Polytomous logistic regression analysis could be applied more often in diagnostic research. J Clin Epidemiol. 2008, 61: 125-34.
Rodriguez A, Lisboa T, Blot S, Martin-Loeches I, Solé-Violan J, De Mendoza D, Rello J: Mortality in ICU patients with bacterial community-acquired pneumonia: when antibiotics are not enough. Intensive Care Med. 2009, 35: 430-8.
Eklund CM: Proinflammatory cytokines in CRP baseline regulation. Adv Clin Chem. 2009, 48: 111-36.
Coelho LM, Salluh JIF, Soares M, Bozza FA, Verdeal JCR, Castro-Faria-Neto HC, Silva JR L e, Bozza PT, Póvoa P: Patterns of c-reactive protein RATIO response in severe community-acquired pneumonia: a cohort study. Crit Care. 2012, 16: R53-
Kishimoto T: IL-6: from its discovery to clinical applications. Int Immunol. 2010, 22: 347-52.
Radtke S, Wüller S, Yang X, Lippok BE, Mütze B, Mais C, de Leur HS-V, Bode JG, Gaestel M, Heinrich PC, Behrmann I, Schaper F, Hermanns HM: Cross-regulation of cytokine signalling: pro-inflammatory cytokines restrict IL-6 signalling through receptor internalisation and degradation. J Cell Sci. 2010, 123 (Pt 6): 947-59.
Garcia-Vidal C, Fernández-Sabé N, Carratalà J, Díaz V, Verdaguer R, Dorca J, Manresa F, Gudiol F: Early mortality in patients with community-acquired pneumonia: causes and risk factors. Eur Respir J. 2008, 32: 733-9.
Talbot GH, Powers JH, Fleming TR, Siuciak JA, Bradley J, Boucher H: Progress on developing endpoints for registrational clinical trials of community-acquired bacterial pneumonia and acute bacterial skin and skin structure infections: update from the Biomarkers Consortium of the Foundation for the National Institutes of He. Clin Infect Dis. 2012, 55: 1114-21.
CIBER enfermedades respiratorias, PII de Infecciones respiratorias de la SEPAR.
The authors declare that they have no competing interests.
IM-L, XV and AT assisted in the design of the study, coordinated patient recruitment, analyzed and interpreted the data, and assisted in writing the paper. CE, OS, CC, RM and BM made important contributions to the acquisition and analysis of data. IML, XV, AA and AT were involved in revising the manuscript critically for important intellectual content. AT, XV and IML made substantial contributions to the concept, design, analysis and interpretation of data and revised the final manuscript version. All authors read and approved the final manuscript. AT acted as guarantor of/person responsible for the entire manuscript.
Ignacio Martin-Loeches, Xavier Valles contributed equally to this work.
Electronic supplementary material
Additional file 1: Figure S1: Box-plot and OR for trend for early and late treatment failure and CRP at day 1 of hospitalization. Box-plot and OR for trend for late treatment failure and CRP at day 3 of hospitalization. Figure S3. Box-plot and OR for trend for early and late treatment failure and PCT at day 1 of hospitalization. Figure S4. Box-plot and OR for trend for late treatment failure and PCT at day 3 of hospitalization. Figure S5. Box-plot and OR for trend for treatment failure and IL-1 at day 1 of hospitalization. Figure S6. Box-plot and OR for trend for early and late treatment failure and IL-1 at day 1 of hospitalization. Figure S7. Box-plot and OR for trend for late treatment failure and IL-1 at day 3 of hospitalization. Figure S8. Box-plot and OR for trend for early and late treatment failure and IL-6 at day 1 of hospitalization. Figure S9. Box-plot and OR for trend for late treatment failure and IL-6 at day 3 of hospitalization. Figure S10. Box-plot and OR for trend for early and late treatment failure and IL-8 at day 1 of hospitalization. (PPT 120 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Martin-Loeches, I., Valles, X., Menendez, R. et al. Predicting treatment failure in patients with community acquired pneumonia: a case-control study. Respir Res 15, 75 (2014). https://doi.org/10.1186/1465-9921-15-75
- Treatment failure
- Community acquired pneumonia