Skip to main content
  • Letter to the Editor
  • Open access
  • Published:

Is the 2013 American Thoracic Society CPAP-tracking system algorithm useful for managing non-adherence in long-term CPAP-treated patients?

Abstract

Background

Whereas telemedicine usage is growing, the only clinical algorithm for Continuous Positive Airway Pressure (CPAP) adherence management is that stipulated by the 2013 American Thoracic Society (ATS). The capacity of the latter to predict non-adherence in long-term CPAP-treated patients has not been validated.

Methods

Patients from the prospective real-life InterfaceVent study (NCT03013283, study conducted in an adult cohort undergoing at least 3 months of CPAP) and eligible for ATS algorithm usage were analysed. The residual device Apnea–Hypopnea-Index (AHIflow) and High Large Leak (HLL) thresholds proposed in the ATS algorithm were evaluated for predicting adherence (i.e. AHIflow > 10/h, HLLs 95th > 24 L/min for ResMed® devices and ResMed® nasal mask, HLLs 95th > 36 l/min for ResMed® devices and ResMed® oronasal masks, HLLs > 1 h for Philips® devices and HHLs > 60 l/min for Fisher & Paykel® devices). Adherence was defined according to the 2013 ATS algorithm (i.e. CPAP use > 4 h/j for at least 70% of days).

Results

650/1484 patients eligible for ATS algorithm usage were analysed (15.38% non-adherent, 74% male with a median (IQ25–75) age of 68 (61–77) years, a body mass index of 30.8 (27.7–34.5) kg/m2, an initial AHI of 39 (31–55) events/h, and CPAP-treatment-duration of 5.1 (2.2–7.8) years). Logistic regression analysis demonstrated no significant relationship between the ATS proposed AHIflow or HLL thresholds and non-adherence. Complementary ROC curve analysis failed to determine satisfactory AHIflow and HLL thresholds.

Conclusion

When managing non-adherence in long-term CPAP-treated patients, our data do not validate absolute AHIflow or HLL thresholds in general.

Trial registration

The INTERFACE-VENT study is registered on ClinicalTrials.gov (Identifier: study (NCT03013283).

Background

Continuous Positive Airway Pressure (CPAP) is the cornerstone of obstructive sleep apnea treatment. Previous studies have reported a correlation between patient adherence and treatment outcomes [1]. CPAP devices can track adherence, but also leaks and residual Apnea–Hypopnea-Index (AHIflow) values. CPAP tracking systems intuitively seem useful, but there are few data demonstrating the benefit of such systems in improving CPAP adherence [2]. In particular, the clinical significance of device-reported leaks or device reported AHIflow is unknown. As underlined in the 2013 American Thoracic Society (ATS) statement, it was speculated that High Large Leaks (HLLs) and high AHIflow may affect CPAP adherence. Thus, HLLs and AHIflow reported by manufacturers were cautiously included in the 2013 ATS clinical algorithm for using CPAP adherence tracking systems [3]. This statement is the only one available to clinicians, and despite increasing telemedicine usage in the field, it remains untested. In this context, the aim of this study is to assess the impact of HLLs and high AHIflow on the adherence of long-term CPAP-treated patients in real-life conditions.

Methods

Study design

The InterfaceVent study is a prospective real-life study conducted in an adult cohort undergoing at least 3 months of CPAP for sleep apnea syndrome (SAS), defined according to the French Social Security system criteria: 1) Apnea Hypopnea Index (AHI) ≥ 30/h (or AHI ≥ 15/h and more than 10/h respiratory-effort-related arousal), and 2) associated with sleepiness and > 3 symptoms from among snoring, headaches, hypertension, reduced vigilance, libido disorders, nycturia). Following an initial prescription by one of the 336 device-prescribing physicians in the Occitanie region of France, these patients were provided care by the association “Apard”, ADENE group, a non-profit home-care provider. Patient inclusions were performed during a home-visit by one of the 32 Apard technicians. Patients included in the analysis are those for whom it is possible to apply the 2013 ATS clinical algorithm for using CPAP adherence tracking systems (Fig. 1).

Fig. 1
figure 1

The study flow chart. Patients in the InterfaceVent study (NCT03013283) meeting 2013 ATS algorithm criteria and lacking interface or data availability problems were included in the final analysis. The four subgroups correspond to different device-mask combinations and their associated thresholds* as foreseen in the ATS criteria

ATS algorithm thresholds

The AHIflow threshold and HLLs thresholds chosen in the present paper are those proposed in the 2013 ATS algorithm (i.e. AHIflow > 10/h, HLL 95th > 24 L/min for ResMed® devices and ResMed® nasal mask, HLL 95th > 36 l/min for ResMed® devices and ResMed® oronasal masks, HLL > 1 h of large leaks for Philips® devices and HHL >  60 l/min for Fisher & Paykel® devices whatever the type and brand of the interface). Adherence was also defined according to the 2013 algorithm (CPAP use > 4 h/j at least 70% of days).

Collected data

In addition to demographic/clinical data and the mask/device data, the response to the Epworth Sleepiness Scale (ESS) and the Euroqol 5 Dimensions 3 level version (EQ-5D-3 L) questionnaires were also collected. Patient perceptions of leaks and mouth dryness were assessed using an 11-point visual analogue scale (VAS) (ranging from no discomfort (0) to very uncomfortable (10)).

Statistical analyses

Multivariable logistic regression analyses were used to study associations between adherence and collected data. Using forward-stepwise selection, covariates with a univariable p-value < 0.15 were fed into multivariable analyses. Odds-ratios with their 95% CI were calculated according to Woolf’s method, with an alpha risk of 0.05. Model goodness-of-fit was assessed using the Hosmer-Lemeshow test. Receiver operating curves (ROC) were created to determine AHIflow and HLL thresholds predictive of non-adherence, as determined by maximizing the Youden index.

Results

Six hundred fifty patients were analysed: 155 with a ResMed® CPAP and ResMed® nasal mask, 131 with a ResMed® device and ResMed® oronasal mask, 356 with a Philips® device regardless of the interface used and 8 with Fisher & Paykel Device. The results of the logistic regression analysis with adherence as the dependent variable are summarized in Table 1.

Table 1 Logistic regression analysis with adherence (> 4 h /day, 70% of the days) as the dependent variable

Univariable analysis failed to demonstrate a significant HLL or AHIflow effect on adherence (Table 1). Interestingly, the VAS for leaks was not associated with non-adherence in the univariable analysis, whereas mouth dryness was (p = 0.019). Finally, multivariable logistic regression demonstrated that increased body mass index or the presence of a partner was significantly positively associated with adherence.

In order to re-evaluate AHIflow and HLL thresholds associated with non-adherence, we generated ROCs curves. For ResMed®-reported AHIflow, accuracy was low (area under curve (AUC) of 0.53 [0.44–0.62]) for a threshold of 13.3/h (sensitivity was 0.04 and specificity was 0.99, positive predictive value (PPV) was 0.50 and negative predictive value (NPV) was 0.85). For Philips®-reported AHIflow, accuracy was low (AUC of 0.51 [0.43–0.60]) for a threshold of 1.4/h (sensitivity was 0.87 and specificity was 0.21, PPV was 0.17 and NPV) was 0.90. For 95th ResMed® nasal leaks, accuracy was low with an AUC of 0.62 [0.49–0.75] for a threshold of 18 L/min (sensitivity was 0.77 and specificity was 0.45, PPV was 0.19 and NPV was 0.92). For 95th ResMed® oronasal leaks, accuracy was low (AUC of 0.58 [0.45–0.72]) for a threshold of 15.6 L/min (sensitivity was 0.65 and specificity was 0.51, PPV was 0.22 and NPV was 0.87). The HLL Philips® ROC curve could not be created because of a Hosmer and Lemeshow positive test, indicating invalid (ROC) values. We did not generate AHIflow and HLL ROC curves for the 8 adherent patients treated with Fisher & Paykel® devices.

Discussion

The 2013 American Thoracic Society statement [3] on the CPAP device tracking systems underlined the absence of standards for scoring flow signals, or measuring mask leaks, as well as the non-existence of standards on how to use these data in order to improve outcomes. Our analysis suggests that in long-term CPAP-treated patients, the 2013 ATS statement proposed thresholds for HLLs and AHIflow are not associated with non-adherence. In addition, we failed to find statistically satisfactory AHIflow and HLL thresholds for predicting non-adherence.

AHIflow thresholds

As underlined by the 2013 ATS statement, AHIflow is not a true surrogate of AHI measured by polysomnography (AHIPSG). Indeed, previous studies have reported that AHIflow was not always correlated or concordant with AHIPSG and major differences exist between manufacturer definitions of the residual events [4, 5]. In this regard, different ROC-determined AHIflow thresholds were found for different machines (as can be expected, considering that device manufacturers all use different event definitions [3]). Similarly, in short-term treated patients, Valentin et al. reported that Philips®-reported AHIflow during the first week of treatment was associated with lower adherence to CPAP therapy at 5 weeks of treatment, but the authors were unable to propose an AHIflow threshold [6].

Leak thresholds

Our long-term study agrees with two other short-term studies focused on leaks. Valentin et al. demonstrated that device-reported leaks during the first week of treatment were slightly associated with lower adherence to CPAP therapy at 5 weeks of treatment (a threshold-adjusted leak-level of 4.9 L/min/cm H2O was associated with a sensitivity of 0.62 and specificity of 0.65 for discriminating adherent and non-adherent patients) [6]. Baltzan et al. reported (using a manual score of device-reported leaks with a cut-off of 20 l/min of unintentional leaks and patterns of continuous leaks or serrated leaks) that the highest quartile of percentage time in continuous leaks may be linked to adherence during the first 3 months of treatment (but the relationship did not reach statistical significance) [7]. The aetiology of leaks is also an important issue, and more attention should be given to mouth leaks, as recommended by the 2013 ATS statement [3]. Bachour et al. have reported that mouth breathing patients were less adherent to CPAP-treatment at 3 months [8]. In this regard, the fact that the present study indicates that the mouth dryness VAS score is associated with lower adherence during univariable analysis is quite interesting. Mouth dryness may potentially be the consequence of mouth leaks, although we cannot overcome other confounding factors in our study (medical prescriptions and co-morbidities) [9] that help explain the absence of significance at the multivariable level. A VAS score is not sufficient for the accurate evaluation of mouth opening and new tools are required. Recently, the suitability of a mandibular movement sensor for evaluating mouth opening effects on unintentional leaks was demonstrated [10] and may respond to this need [11].

Study limits

Beyond these negative results, it is important to remember that our population was treated on a long-term basis and our conclusions may not be applicable to short-term situations. For long-term patients, in contrast with absolute-value thresholds, the percentage-change may be of greater interest [12]. However, our study design did not enable us to test this hypothesis.

Conclusions

Six years after the 2013 ATS statement and during a time when telemedicine is growing, our data suggest that before proceeding with remote monitoring initiatives, it is necessary to validate the diagnostic potential of data generated by CPAP tracking systems before they are implicated in a decision making process.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AHIflow :

Residual Apnea–Hypopnea-Index

ATS:

American Thoracic Society

AUC:

Area Under Curve

BMI:

Body Mass Index

CPAP:

Continuous Positive Airway Pressure

EQ-5D-3 L:

Euroqol 5 Dimensions 3 level version

ESS:

Epworth Sleepiness Scale

HLLs:

High Large Leaks

VAS:

Visual Analog Scale

References

  1. Yu J, Zhou Z, McEvoy RD, Anderson CS, Rodgers A, Perkovic V, et al. Association of Positive Airway Pressure with Cardiovascular Events and Death in adults with sleep apnea: a systematic review and meta-analysis. JAMA. 2017;318:156–66.

    Article  Google Scholar 

  2. Hwang D, Chang JW, Benjafield AV, Crocker ME, Kelly C, Becker KA, et al. Effect of telemedicine education and Telemonitoring on continuous positive airway pressure adherence. The tele-OSA randomized trial. Am J Respir Crit Care Med. 2018;197:117–26.

    Article  Google Scholar 

  3. Schwab RJ, Badr SM, Epstein LJ, Gay PC, Gozal D, Kohler M, et al. An official American Thoracic Society statement: continuous positive airway pressure adherence tracking systems. The optimal monitoring strategies and outcome measures in adults. Am J Respir Crit Care Med. 2013;188:613–20.

    Article  Google Scholar 

  4. Huang H-CC, Hillman DR, McArdle N. Control of OSA during automatic positive airway pressure titration in a clinical case series: predictors and accuracy of device download data. Sleep. 2012;35:1277–1283A.

    Article  Google Scholar 

  5. Reiter J, Zleik B, Bazalakova M, Mehta P, Thomas RJ. Residual events during use of CPAP: prevalence, predictors, and detection accuracy. J Clin Sleep Med. 2016;12:1153–8.

    Article  Google Scholar 

  6. Valentin A, Subramanian S, Quan SF, Berry RB, Parthasarathy S. Air leak is associated with poor adherence to autoPAP therapy. Sleep. 2011;34:801–6.

    Article  Google Scholar 

  7. Baltzan MA, Dabrusin R, Garcia-Asensi A, Sully J-L, Parenteau M, Tansimat G, et al. Leak profile inspection during nasal continuous positive airway pressure. Respir Care. 2011;56:591–5.

    Article  Google Scholar 

  8. Bachour A, Maasilta P. Mouth breathing compromises adherence to nasal continuous positive airway pressure therapy. Chest. 2004;126:1248–54.

    Article  Google Scholar 

  9. Rakotonanahary D, Pelletier-Fleury N, Gagnadoux F, Fleury B. Predictive factors for the need for additional humidification during nasal continuous positive airway pressure therapy. Chest. 2001;119:460–5.

    Article  CAS  Google Scholar 

  10. Lebret M, Arnol N, Martinot J-B, Lambert L, Tamisier R, Pepin J-L, et al. Determinants of unintentional leaks during CPAP treatment in OSA. Chest. 2018;153:834–42.

    Article  Google Scholar 

  11. Genta PR, Lorenzi-Filho G. Sealing the leak: a step forward in improving CPAP adherence. Chest. 2018;153:774–5.

    Article  Google Scholar 

  12. Borel J-C, Pelletier J, Taleux N, Briault A, Arnol N, Pison C, et al. Parameters recorded by software of non-invasive ventilators predict COPD exacerbation: a proof-of-concept study. Thorax. 2015;70:284–5.

    Article  Google Scholar 

Download references

Acknowledgements

The InterfaceVent investigators gratefully recognise the vital input and support of the non-profit home care provider APARD and the ADENE group.

Administrative Team: Bernard Alsina, Valérie Bachelier, Pierre Coulot, Christophe Jeanjean, Philippe Lansard, Joël Nogue.

Technician Team: Matthieu Alberti, Julien Bauchu, Yannick Baudelot, Gregory Bel, Julien Bernard, Julien Bourrel, Frédéric Bousquet, David Crespy, Olivier Cubero, Eric Deghal, Fabien Deville, Sébastien Faure, Laure Ferraz, Olivier Gaubert, Georges Guichard, Franck Issert, Renaud Lopez, Mounia Maachou, Clément Maurin, David Minguez, Fabien Moubeche, Christophe Pinotti, Liva Ranaivo, Lazhar Saighi, Frédéric Sola, Frédéric Tallavignes, Olivier Tramier, Jean-Michel Tribe, Jean-Marc Uriol, Romain Vernet.

Funding

The authors have no support nor funding to report in relation with the present study.

Author information

Authors and Affiliations

Authors

Contributions

DJ access to the data and takes responsibility for the integrity and accuracy of the analysis. All authors contributed to and approved the final submitted manuscript. MCR: study design, data collection, analysis, and manuscript preparation; JPM: study design and manuscript preparation, CMS: study design and manuscript preparation, CM: study design, data collection, JCB: analysis, manuscript preparation, CR: analysis, manuscript preparation, AB: study design, analysis and manuscript preparation, NM: study design, data collection, analysis, and manuscript preparation, DJ: study design, data collection, analysis, and manuscript preparation.

Corresponding author

Correspondence to Dany Jaffuel.

Ethics declarations

Ethics approval and consent to participate

This study presents an analysis of the InterfaceVent study registered on ClinicalTrials.gov (NCT03013283). The protocol was reviewed and approved by an independent ethics committee (Comité de Protection des Personnes Sud Mediterranée 1; reference number RO-2016/50).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rotty, MC., Mallet, JP., Suehs, C.M. et al. Is the 2013 American Thoracic Society CPAP-tracking system algorithm useful for managing non-adherence in long-term CPAP-treated patients?. Respir Res 20, 209 (2019). https://doi.org/10.1186/s12931-019-1150-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12931-019-1150-7

Keywords