- Letter to the Editor
- Open Access
Is the 2013 American Thoracic Society CPAP-tracking system algorithm useful for managing non-adherence in long-term CPAP-treated patients?
Respiratory Research volume 20, Article number: 209 (2019)
Whereas telemedicine usage is growing, the only clinical algorithm for Continuous Positive Airway Pressure (CPAP) adherence management is that stipulated by the 2013 American Thoracic Society (ATS). The capacity of the latter to predict non-adherence in long-term CPAP-treated patients has not been validated.
Patients from the prospective real-life InterfaceVent study (NCT03013283, study conducted in an adult cohort undergoing at least 3 months of CPAP) and eligible for ATS algorithm usage were analysed. The residual device Apnea–Hypopnea-Index (AHIflow) and High Large Leak (HLL) thresholds proposed in the ATS algorithm were evaluated for predicting adherence (i.e. AHIflow > 10/h, HLLs 95th > 24 L/min for ResMed® devices and ResMed® nasal mask, HLLs 95th > 36 l/min for ResMed® devices and ResMed® oronasal masks, HLLs > 1 h for Philips® devices and HHLs > 60 l/min for Fisher & Paykel® devices). Adherence was defined according to the 2013 ATS algorithm (i.e. CPAP use > 4 h/j for at least 70% of days).
650/1484 patients eligible for ATS algorithm usage were analysed (15.38% non-adherent, 74% male with a median (IQ25–75) age of 68 (61–77) years, a body mass index of 30.8 (27.7–34.5) kg/m2, an initial AHI of 39 (31–55) events/h, and CPAP-treatment-duration of 5.1 (2.2–7.8) years). Logistic regression analysis demonstrated no significant relationship between the ATS proposed AHIflow or HLL thresholds and non-adherence. Complementary ROC curve analysis failed to determine satisfactory AHIflow and HLL thresholds.
When managing non-adherence in long-term CPAP-treated patients, our data do not validate absolute AHIflow or HLL thresholds in general.
The INTERFACE-VENT study is registered on ClinicalTrials.gov (Identifier: study (NCT03013283).
Continuous Positive Airway Pressure (CPAP) is the cornerstone of obstructive sleep apnea treatment. Previous studies have reported a correlation between patient adherence and treatment outcomes . CPAP devices can track adherence, but also leaks and residual Apnea–Hypopnea-Index (AHIflow) values. CPAP tracking systems intuitively seem useful, but there are few data demonstrating the benefit of such systems in improving CPAP adherence . In particular, the clinical significance of device-reported leaks or device reported AHIflow is unknown. As underlined in the 2013 American Thoracic Society (ATS) statement, it was speculated that High Large Leaks (HLLs) and high AHIflow may affect CPAP adherence. Thus, HLLs and AHIflow reported by manufacturers were cautiously included in the 2013 ATS clinical algorithm for using CPAP adherence tracking systems . This statement is the only one available to clinicians, and despite increasing telemedicine usage in the field, it remains untested. In this context, the aim of this study is to assess the impact of HLLs and high AHIflow on the adherence of long-term CPAP-treated patients in real-life conditions.
The InterfaceVent study is a prospective real-life study conducted in an adult cohort undergoing at least 3 months of CPAP for sleep apnea syndrome (SAS), defined according to the French Social Security system criteria: 1) Apnea Hypopnea Index (AHI) ≥ 30/h (or AHI ≥ 15/h and more than 10/h respiratory-effort-related arousal), and 2) associated with sleepiness and > 3 symptoms from among snoring, headaches, hypertension, reduced vigilance, libido disorders, nycturia). Following an initial prescription by one of the 336 device-prescribing physicians in the Occitanie region of France, these patients were provided care by the association “Apard”, ADENE group, a non-profit home-care provider. Patient inclusions were performed during a home-visit by one of the 32 Apard technicians. Patients included in the analysis are those for whom it is possible to apply the 2013 ATS clinical algorithm for using CPAP adherence tracking systems (Fig. 1).
ATS algorithm thresholds
The AHIflow threshold and HLLs thresholds chosen in the present paper are those proposed in the 2013 ATS algorithm (i.e. AHIflow > 10/h, HLL 95th > 24 L/min for ResMed® devices and ResMed® nasal mask, HLL 95th > 36 l/min for ResMed® devices and ResMed® oronasal masks, HLL > 1 h of large leaks for Philips® devices and HHL > 60 l/min for Fisher & Paykel® devices whatever the type and brand of the interface). Adherence was also defined according to the 2013 algorithm (CPAP use > 4 h/j at least 70% of days).
In addition to demographic/clinical data and the mask/device data, the response to the Epworth Sleepiness Scale (ESS) and the Euroqol 5 Dimensions 3 level version (EQ-5D-3 L) questionnaires were also collected. Patient perceptions of leaks and mouth dryness were assessed using an 11-point visual analogue scale (VAS) (ranging from no discomfort (0) to very uncomfortable (10)).
Multivariable logistic regression analyses were used to study associations between adherence and collected data. Using forward-stepwise selection, covariates with a univariable p-value < 0.15 were fed into multivariable analyses. Odds-ratios with their 95% CI were calculated according to Woolf’s method, with an alpha risk of 0.05. Model goodness-of-fit was assessed using the Hosmer-Lemeshow test. Receiver operating curves (ROC) were created to determine AHIflow and HLL thresholds predictive of non-adherence, as determined by maximizing the Youden index.
Six hundred fifty patients were analysed: 155 with a ResMed® CPAP and ResMed® nasal mask, 131 with a ResMed® device and ResMed® oronasal mask, 356 with a Philips® device regardless of the interface used and 8 with Fisher & Paykel Device. The results of the logistic regression analysis with adherence as the dependent variable are summarized in Table 1.
Univariable analysis failed to demonstrate a significant HLL or AHIflow effect on adherence (Table 1). Interestingly, the VAS for leaks was not associated with non-adherence in the univariable analysis, whereas mouth dryness was (p = 0.019). Finally, multivariable logistic regression demonstrated that increased body mass index or the presence of a partner was significantly positively associated with adherence.
In order to re-evaluate AHIflow and HLL thresholds associated with non-adherence, we generated ROCs curves. For ResMed®-reported AHIflow, accuracy was low (area under curve (AUC) of 0.53 [0.44–0.62]) for a threshold of 13.3/h (sensitivity was 0.04 and specificity was 0.99, positive predictive value (PPV) was 0.50 and negative predictive value (NPV) was 0.85). For Philips®-reported AHIflow, accuracy was low (AUC of 0.51 [0.43–0.60]) for a threshold of 1.4/h (sensitivity was 0.87 and specificity was 0.21, PPV was 0.17 and NPV) was 0.90. For 95th ResMed® nasal leaks, accuracy was low with an AUC of 0.62 [0.49–0.75] for a threshold of 18 L/min (sensitivity was 0.77 and specificity was 0.45, PPV was 0.19 and NPV was 0.92). For 95th ResMed® oronasal leaks, accuracy was low (AUC of 0.58 [0.45–0.72]) for a threshold of 15.6 L/min (sensitivity was 0.65 and specificity was 0.51, PPV was 0.22 and NPV was 0.87). The HLL Philips® ROC curve could not be created because of a Hosmer and Lemeshow positive test, indicating invalid (ROC) values. We did not generate AHIflow and HLL ROC curves for the 8 adherent patients treated with Fisher & Paykel® devices.
The 2013 American Thoracic Society statement  on the CPAP device tracking systems underlined the absence of standards for scoring flow signals, or measuring mask leaks, as well as the non-existence of standards on how to use these data in order to improve outcomes. Our analysis suggests that in long-term CPAP-treated patients, the 2013 ATS statement proposed thresholds for HLLs and AHIflow are not associated with non-adherence. In addition, we failed to find statistically satisfactory AHIflow and HLL thresholds for predicting non-adherence.
As underlined by the 2013 ATS statement, AHIflow is not a true surrogate of AHI measured by polysomnography (AHIPSG). Indeed, previous studies have reported that AHIflow was not always correlated or concordant with AHIPSG and major differences exist between manufacturer definitions of the residual events [4, 5]. In this regard, different ROC-determined AHIflow thresholds were found for different machines (as can be expected, considering that device manufacturers all use different event definitions ). Similarly, in short-term treated patients, Valentin et al. reported that Philips®-reported AHIflow during the first week of treatment was associated with lower adherence to CPAP therapy at 5 weeks of treatment, but the authors were unable to propose an AHIflow threshold .
Our long-term study agrees with two other short-term studies focused on leaks. Valentin et al. demonstrated that device-reported leaks during the first week of treatment were slightly associated with lower adherence to CPAP therapy at 5 weeks of treatment (a threshold-adjusted leak-level of 4.9 L/min/cm H2O was associated with a sensitivity of 0.62 and specificity of 0.65 for discriminating adherent and non-adherent patients) . Baltzan et al. reported (using a manual score of device-reported leaks with a cut-off of 20 l/min of unintentional leaks and patterns of continuous leaks or serrated leaks) that the highest quartile of percentage time in continuous leaks may be linked to adherence during the first 3 months of treatment (but the relationship did not reach statistical significance) . The aetiology of leaks is also an important issue, and more attention should be given to mouth leaks, as recommended by the 2013 ATS statement . Bachour et al. have reported that mouth breathing patients were less adherent to CPAP-treatment at 3 months . In this regard, the fact that the present study indicates that the mouth dryness VAS score is associated with lower adherence during univariable analysis is quite interesting. Mouth dryness may potentially be the consequence of mouth leaks, although we cannot overcome other confounding factors in our study (medical prescriptions and co-morbidities)  that help explain the absence of significance at the multivariable level. A VAS score is not sufficient for the accurate evaluation of mouth opening and new tools are required. Recently, the suitability of a mandibular movement sensor for evaluating mouth opening effects on unintentional leaks was demonstrated  and may respond to this need .
Beyond these negative results, it is important to remember that our population was treated on a long-term basis and our conclusions may not be applicable to short-term situations. For long-term patients, in contrast with absolute-value thresholds, the percentage-change may be of greater interest . However, our study design did not enable us to test this hypothesis.
Six years after the 2013 ATS statement and during a time when telemedicine is growing, our data suggest that before proceeding with remote monitoring initiatives, it is necessary to validate the diagnostic potential of data generated by CPAP tracking systems before they are implicated in a decision making process.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
- AHIflow :
American Thoracic Society
Area Under Curve
Body Mass Index
Continuous Positive Airway Pressure
- EQ-5D-3 L:
Euroqol 5 Dimensions 3 level version
Epworth Sleepiness Scale
High Large Leaks
Visual Analog Scale
Yu J, Zhou Z, McEvoy RD, Anderson CS, Rodgers A, Perkovic V, et al. Association of Positive Airway Pressure with Cardiovascular Events and Death in adults with sleep apnea: a systematic review and meta-analysis. JAMA. 2017;318:156–66.
Hwang D, Chang JW, Benjafield AV, Crocker ME, Kelly C, Becker KA, et al. Effect of telemedicine education and Telemonitoring on continuous positive airway pressure adherence. The tele-OSA randomized trial. Am J Respir Crit Care Med. 2018;197:117–26.
Schwab RJ, Badr SM, Epstein LJ, Gay PC, Gozal D, Kohler M, et al. An official American Thoracic Society statement: continuous positive airway pressure adherence tracking systems. The optimal monitoring strategies and outcome measures in adults. Am J Respir Crit Care Med. 2013;188:613–20.
Huang H-CC, Hillman DR, McArdle N. Control of OSA during automatic positive airway pressure titration in a clinical case series: predictors and accuracy of device download data. Sleep. 2012;35:1277–1283A.
Reiter J, Zleik B, Bazalakova M, Mehta P, Thomas RJ. Residual events during use of CPAP: prevalence, predictors, and detection accuracy. J Clin Sleep Med. 2016;12:1153–8.
Valentin A, Subramanian S, Quan SF, Berry RB, Parthasarathy S. Air leak is associated with poor adherence to autoPAP therapy. Sleep. 2011;34:801–6.
Baltzan MA, Dabrusin R, Garcia-Asensi A, Sully J-L, Parenteau M, Tansimat G, et al. Leak profile inspection during nasal continuous positive airway pressure. Respir Care. 2011;56:591–5.
Bachour A, Maasilta P. Mouth breathing compromises adherence to nasal continuous positive airway pressure therapy. Chest. 2004;126:1248–54.
Rakotonanahary D, Pelletier-Fleury N, Gagnadoux F, Fleury B. Predictive factors for the need for additional humidification during nasal continuous positive airway pressure therapy. Chest. 2001;119:460–5.
Lebret M, Arnol N, Martinot J-B, Lambert L, Tamisier R, Pepin J-L, et al. Determinants of unintentional leaks during CPAP treatment in OSA. Chest. 2018;153:834–42.
Genta PR, Lorenzi-Filho G. Sealing the leak: a step forward in improving CPAP adherence. Chest. 2018;153:774–5.
Borel J-C, Pelletier J, Taleux N, Briault A, Arnol N, Pison C, et al. Parameters recorded by software of non-invasive ventilators predict COPD exacerbation: a proof-of-concept study. Thorax. 2015;70:284–5.
The InterfaceVent investigators gratefully recognise the vital input and support of the non-profit home care provider APARD and the ADENE group.
Administrative Team: Bernard Alsina, Valérie Bachelier, Pierre Coulot, Christophe Jeanjean, Philippe Lansard, Joël Nogue.
Technician Team: Matthieu Alberti, Julien Bauchu, Yannick Baudelot, Gregory Bel, Julien Bernard, Julien Bourrel, Frédéric Bousquet, David Crespy, Olivier Cubero, Eric Deghal, Fabien Deville, Sébastien Faure, Laure Ferraz, Olivier Gaubert, Georges Guichard, Franck Issert, Renaud Lopez, Mounia Maachou, Clément Maurin, David Minguez, Fabien Moubeche, Christophe Pinotti, Liva Ranaivo, Lazhar Saighi, Frédéric Sola, Frédéric Tallavignes, Olivier Tramier, Jean-Michel Tribe, Jean-Marc Uriol, Romain Vernet.
The authors have no support nor funding to report in relation with the present study.
Ethics approval and consent to participate
This study presents an analysis of the InterfaceVent study registered on ClinicalTrials.gov (NCT03013283). The protocol was reviewed and approved by an independent ethics committee (Comité de Protection des Personnes Sud Mediterranée 1; reference number RO-2016/50).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.