Performance of a new hand-held device for exhaled nitric oxide measurement in adults and children
© Alving et al. 2006
Received: 20 December 2005
Accepted: 20 April 2006
Published: 20 April 2006
Exhaled nitric oxide (NO) measurement has been shown to be a valuable tool in the management of patients with asthma. Up to now, most measurements have been done with stationary, chemiluminescence-based NO analysers, which are not suitable for the primary health care setting. A hand-held NO analyser which simplifies the measurement would be of value both in specialized and primary health care. In this study, the performance of a new electrochemical hand-held device for exhaled NO measurements (NIOX MINO) was compared with a standard stationary chemiluminescence unit (NIOX).
A total of 71 subjects (6–60 years; 36 males), both healthy controls and atopic patients with and without asthma were included. The mean of three approved exhalations (50 ml/s) in each device, and the first approved measurement in the hand-held device, were compared with regard to NO readings (Bland-Altman plots), measurement feasibility (success rate with 6 attempts) and repeatability (intrasubject SD).
Success rate was high (≥ 84%) in both devices for both adults and children. The subjects represented a FENO range of 8–147 parts per billion (ppb). When comparing the mean of three measurements (n = 61), the median of the intrasubject difference in exhaled NO for the two devices was -1.2 ppb; thus generally the hand-held device gave slightly higher readings. The Bland-Altman plot shows that the 95% limits of agreement were -9.8 and 8.0 ppb. The intrasubject median difference between the NIOX and the first approved measurement in the NIOX MINO was -2.0 ppb, and limits of agreement were -13.2 and 10.2 ppb. The median repeatability for NIOX and NIOX MINO were 1.1 and 1.2 ppb, respectively.
The hand-held device (NIOX MINO) and the stationary system (NIOX) are in clinically acceptable agreement both when the mean of three measurements and the first approved measurement (NIOX MINO) is used. The hand-held device shows good repeatability, and it can be used successfully on adults and most children. The new hand-held device will enable the introduction of exhaled NO measurements into the primary health care.
Since the original reports of the presence of nitric oxide (NO) in exhaled breath of mammals including humans , and of the increased levels in subjects with asthma , there has been a rapidly increasing interest in the measurement of exhaled NO. The concentration of NO in exhaled breath relates to the degree of eosinophilic inflammation in the airways [3–5], and NO measurement has been shown to be a valuable tool both to diagnose [6, 7] and to monitor the therapy of patients with asthma [8, 9].
Up to now, a single type of NO analyser has been used for nearly all measurement of exhaled NO: the chemiluminescence NO analyser . These instruments are based on a technology developed in the 1970's  and were originally used for environmental and atmospheric analyses. The chemiluminescence-based NO analysers are fast-responding, highly sensitive (detection limit 1 parts per billion (ppb) or lower) and specific for NO gas. However, they are also rather bulky and expensive, and they need to be calibrated on site, drawbacks that have been limiting factors for the introduction of exhaled NO measurements in routine clinical work. An alternative would be to use electrochemical sensors, but they have not been sensitive enough for analysis of NO in the low ppb range. Recently, however, a new electrochemical sensor has been developed, based on the amperometric technique (the production of a current when a potential is applied between two electrodes), which is suitable for NO analysis in exhaled breath . This sensor has been incorporated into a hand-held measuring device that complies with international guidelines for exhaled NO measurements .
In this study, the new hand-held device was compared to a chemiluminescence-based stationary device for exhaled NO measurements that has previously proven to provide repeatable results . Both these instruments are now cleared for clinical use in Europe and the stationary device has also been cleared by the US Food and Drug Administration . The two devices were compared with regard to NO readings, measurement repeatability and feasibility, in a sample of 71 children and adults with and without asthma.
Device comparison. Some characteristics that are not identical in the two devices are given. Most other characteristics are similar, for example NO scrubbing of inhaled air and the exhalation flow control.
Measurement range (ppb)
< 50 ppb: ± 2.5 ppb
≥ 50 ppb: ± 5%
< 50 ppb: ± 5 ppb
≥ 50 ppb: ± 10%
Display via mirror
Calibration on site
50 × 30 × 40
24 × 13 × 10
Measurements were performed in randomized device order (at most 6 attempts per device). The mean of three measurements in each device, or the first approved measurement in the NIOX MINO were used for agreement studies. After these measurements, subjects also attempted one valid FENO measurement (at most 3 attempts) in the hand-held device in a simulated home-use environment where each subject performed the FENO measurement without the assistance of clinical personnel.
Data are presented as arithmetic mean ± standard deviation (SD), or median [interquartile range] when appropriate. For comparison between devices, intraclass correlation coefficients (ICCs) were calculated and presented as reliability coefficients, and Bland-Altman plots were constructed. Repeatability was calculated from intrasubject SD. Student's paired t-test was used to compare the mean number of attempts in the two devices. The success rate was calculated as the proportion of subjects succeeding in obtaining three valid FENO measurements out of a maximum of six attempts in each device, or one successful measurement out of a maximum of three attempts using the NIOX MINO in the simulated home use. Differences in success rate was evaluated by Fisher's exact test.
Success rate for approved measurements
Success rate. Fraction of patients (%) that were able to achieve three accepted measurements out of at most 6 attempts under guidance (clinical setting), or one accepted measurement out of at most 3 attempts without guidance (simulated home use).
All subjects (n = 71)
Children (n = 37)
Adults (n = 34)
In subjects that were successful in all three sets of measurements (n = 61), the mean number of attempts required to obtain three approved measurements was 3.8 ± 1.0 and 3.4 ± 0.8 for the NIOX and the NIOX MINO, respectively. The number of attempts was significantly lower for the NIOX MINO (p < 0.05; paired t-test). The mean number of attempts required by successful patients to obtain one approved measurement in the home-use environment was 1.1 ± 0.3.
Three adverse eventswere reported (mental stress, throat dryness, uncomfortable inhalation); they were all considered mild and were deemed unlikely to be caused directly by the study devices.
Agreement between devices
In addition, we find the same degree of agreement between the NIOX and the NIOX MINO when comparing the mean of three approved exhaled NO measurements in the NIOX and the first approved measurement in the NIOX MINO in the clinical setting (Fig 2B, 3B). The median of the intra-subject FENO difference was -2.0 [-4.0, 1.0) ppb, again suggesting that FENO measurements with NIOX MINO were slightly higher than FENO measurements using NIOX. The 95% limits of agreement were -13.2 and 10.2 ppb.
Exhaled NO has been studied extensively over the past decade and reports of the clinical utility of this method in the management of patients with asthma are now appearing in the literature [8, 9]. However, the introduction of the method into clinical routine has been restricted by the cost and complexity of existing NO analysers. In this study, the performance of a new hand-held device for exhaled NO measurements has been compared with that of a standard stationary unit.
When we compare the mean of three valid FENO measurements using the established chemiluminescence-based NIOX and the NIOX MINO, which incorporates an electrochemical sensor, the results suggest clinically acceptable agreement between the two instruments. Measured FENO levels obtained using the NIOX MINO were on average slightly higher than those obtained with the NIOX, and there was a tendency that the intrasubject FENO difference increased with increasing FENO. We believe that the difference between the two instruments is acceptable, considering the different measurement technologies and calibration procedures used in the two devices, and the results are in conformity with the declared accuracy for both the NIOX and the NIOX MINO. From a clinical point of view, accuracy will be more important in a FENO range close to a cut-off between health and disease (20–35 ppb) than at higher FENO levels. The NIOX MINO showed good agreement (within 95% limits of agreement) with the NIOX up to approximately 60 ppb, which indicates that the new hand-held device will be able to give clinical guidance with similar accuracy as the conventional chemiluminescence-based unit.
In general, the NIOX MINO and the NIOX had similar repeatability, except for one extreme observation with poor reproducibility in the NIOX MINO. However, this was seen in a subject with very high exhaled NO values (range 125–147 ppb in the NIOX MINO), and such variability at these high NO levels is of minor clinical importance. The repeatability agreed with the devices' technical specifications.
Success rates in achieving the required number of acceptable measurements were at least 84% for both devices and for both subject groups. Since all subjects were considered unexperienced with NO measurements, this indicates that both measurement techniques are generally well accepted by the patients. However, younger children failed slightly more frequently than adults when attempting to use the NIOX MINO. Interestingly, the number of attempts needed for successful subjects to achieve three acceptable measurements was significantly lower in the NIOX MINO compared to the NIOX. This could at least partly be explained by the fact that some measurements in the NIOX may be discarded after a linear regression analysis of the NO plateau has been performed, even though the number of regression failures was not recorded in the present study. The linearized plateau must not deviate more than 10% from the horizontal axis according to current guidelines . In the NIOX MINO, the NO level in the last 3-s portion of mixed exhaled air is analyzed. Thus, the need for an analysis of the quality of a real-time NO plateau is avoided in the hand-held instrument.
Four subjects were excluded because of a low exhaled NO value (< 8 ppb). However, three of these subjects had a measurement above 5 ppb which is now the established lower detection limit of the NIOX MINO.
During the simulated home use, subjects were given the opportunity to use the NIOX MINO unassisted by study staff (children were assisted by their parents as they likely would be at home). This was performed after the clinical session, which would imitate what would normally happen, namely that the patient would receive training in the clinic prior to taking home the device. All subjects that succeeded in the clinical setting also succeeded in the simulated home environment. Using the mean of three measurements was advised in earlier guidelines , but this was recently changed to two measurements . We found essentially the same agreement between the two devices when comparing the mean of three valid measurements in the NIOX and the first valid measurement in the NIOX MINO. We thus suggest that one measurement is adequate when using the NIOX MINO, which would save valuable time in the clinic. The time for NO analysis in the NIOX MINO is 100 s, but since one measurement seems to be adequate in most instances, the total measurement time will still be acceptable.
The results show that there is clinically acceptable agreement between the stationary NIOX and the new hand-held NIOX MINO, when similar conditions were considered and examinations were made as consistently as possible. The repeatability of measurements done using the hand-held device was similar to the stationary device, and adults and most children were able to successfully use both instruments. In addition, subjects displayed ability to operate the new hand-held device in a simulated home-use environment. The new hand-held instrument will enable the introduction of exhaled NO measurements in the primary health care.
We are grateful for the help from research nurses Pia Kalm-Stephens and Ulrike Spetz Nyström. The study was supported by the Swedish Heart Lung Foundation. Aerocrine provided the NO instruments.
- Gustafsson LE, Leone AM, Persson MG, Wiklund NP, Moncada S: Endogenous nitric oxide is present in the exhaled air of rabbits, guinea pigs and humans. Biochem Biophys Res Commun 1991, 181:852–857.View ArticlePubMedGoogle Scholar
- Alving K, Weitzberg E, Lundberg JM: Increased amount of nitric oxide in exhaled air of asthmatics. Eur Respir J 1993, 6:1368–1370.PubMedGoogle Scholar
- van den Toorn LM, Overbeek SE, de Jongste JC, Leman K, Hoogsteden HC, Prins JB: Airway inflammation is present during clinical remission of atopic asthma. Am J Respir Crit Care Med 2001, 164:2107–2113.View ArticlePubMedGoogle Scholar
- Mattes J, Storm van's Gravesande K, Reining U, Alving K, Ihorst G, Henschen M, Kuehr J: NO in exhaled air is correlated with markers of eosinophilic airway inflammation in corticosteroid-dependent childhood asthma. Eur Respir J 1999, 13:1391–1395.PubMedGoogle Scholar
- Jatakanon A, Lim S, Kharitonov SA, Chung KF, Barnes PJ: Correlation between exhaled nitric oxide, sputum eosinophils, and methacholine responsiveness in patients with mild asthma. Thorax 1998, 53:91–95.View ArticlePubMedPubMed CentralGoogle Scholar
- Dupont LJ, Demedts MG, Verleden GM: Prospective evaluation of the validity of exhaled nitric oxide for the diagnosis of asthma. Chest 2003, 123:751–756.View ArticlePubMedGoogle Scholar
- Smith AD, Cowan JO, Filsell S, McLachlan C, Monti-Sheehan G, Jackson P, Taylor DR: Diagnosing asthma: comparisons between exhaled nitric oxide measurements and conventional tests. Am J Respir Crit Care Med 2004, 169:473–478.View ArticlePubMedGoogle Scholar
- Smith AD, Cowan JO, Brassett KP, Herbison GP, Taylor DR: Use of exhaled nitric oxide measurements to guide treatment in chronic asthma. N Engl J Med 2005, 352:2163–2173.View ArticlePubMedGoogle Scholar
- Pijnenburg MW, Bakker EM, Hop WC, De Jongste JC: Titrating Steroids on Exhaled Nitric Oxide in Asthmatic Children: a Randomized Controlled Trial. Am J Respir Crit Care Med 2005, 172:831–836.View ArticlePubMedGoogle Scholar
- Archer S: Measurement of nitric oxide in biological models. Faseb J 1993, 7:349–360.PubMedGoogle Scholar
- Fontijn A, Sabadell A, Ronco R: Homogenous chemiluminescent measurement of nitric oxide with ozone. Implications for continuous selective monitoring of gaseous air pollutants. Anal Chem 1970, 42:575–579.View ArticleGoogle Scholar
- Hemmingsson T, Linnarsson D, Gambert R: Novel hand-held device for exhaled nitric oxide-analysis in research and clinical applications. J Clin Monit Comput 2004, 18:379–387.View ArticlePubMedGoogle Scholar
- Anonymous: ATS/ERS Recommendations for Standardized Procedures for the Online and Offline Measurement of Exhaled Lower Respiratory Nitric Oxide and Nasal Nitric Oxide, 2005. Am J Respir Crit Care Med 2005, 171:912–930.View ArticleGoogle Scholar
- Kharitonov SA, Gonio F, Kelly C, Meah S, Barnes PJ: Reproducibility of exhaled nitric oxide measurements in healthy and asthmatic adults and children. Eur Respir J 2003, 21:433–438.View ArticlePubMedGoogle Scholar
- Silkoff PE, Carlson M, Bourke T, Katial R, Ogren E, Szefler SJ: The Aerocrine exhaled nitric oxide monitoring system NIOX is cleared by the US Food and Drug Administration for monitoring therapy in asthma. J Allergy Clin Immunol 2004, 114:1241–1256.View ArticlePubMedGoogle Scholar
- Anonymous: Recommendations for standardized procedures for the on-line and off-line measurement of exhaled lower respiratory nitric oxide and nasal nitric oxide in adults and children-1999. This official statement of the American Thoracic Society was adopted by the ATS Board of Directors, July 1999. Am J Respir Crit Care Med 1999, 160:2104–2117.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.