- Open Access
Are exhaled nitric oxide measurements using the portable NIOX MINO repeatable?
Respiratory Research volume 11, Article number: 43 (2010)
Exhaled nitric oxide is a non-invasive marker of airway inflammation and a portable analyser, the NIOX MINO (Aerocrine AB, Solna, Sweden), is now available. This study aimed to assess the reproducibility of the NIOX MINO measurements across age, sex and lung function for both absolute and categorical exhaled nitric oxide values in two distinct groups of children and teenagers.
Paired exhaled nitric oxide readings were obtained from 494 teenagers, aged 16-18 years, enrolled in an unselected birth cohort and 65 young people, aged 6-17 years, with asthma enrolled in an interventional asthma management study.
The birth cohort participants showed a high degree of variability between first and second exhaled nitric oxide readings (mean intra-participant difference 1.37 ppb, 95% limits of agreement -7.61 to 10.34 ppb), although there was very close agreement when values were categorised as low, normal, intermediate or high (kappa = 0.907, p < 0.001). Similar findings were seen in subgroup analyses by sex, lung function and asthma status. Similar findings were seen in the interventional study participants.
The reproducibility of exhaled nitric oxide is poor for absolute values but acceptable when values are categorised as low, normal, intermediate or high in children and teenagers. One measurement is therefore sufficient when using categorical exhaled nitric oxide values to direct asthma management but a mean of at least two measurements is required for absolute values.
Asthma is a chronic inflammatory disorder of the airways associated with airway hyperresponsiveness and recurrent episodes of reversible airflow limitation that are accompanied by wheeze, shortness of breath, chest tightness and cough . It is the most common chronic condition of childhood  affecting approximately 20% of school-aged children in the United Kingdom . Decisions regarding asthma management are currently based on symptoms and conventional lung function tests. Exhaled nitric oxide (FeNO) has recently emerged as a potentially useful tool in the assessment of patients with asthma . Exhaled nitric oxide measurements correlate well with measures of airway inflammation, including sputum levels of eosinophils , airway eosinophilia in bronchial biopsies  and allergen exposure . Measurements can be made within minutes, even in young school children. Furthermore, FeNO has been shown to rise prior to asthma exacerbations  and decrease following administration of inhaled corticosteroids  or leukotriene receptor antagonists . Potential applications for FeNO may therefore be found in the diagnostic work up of patients with possible asthma, monitoring of treatment responses, adherence with treatment and prediction of exacerbations [4, 11]. Its role in directing the chronic management of asthma has though been questioned recently [12, 13]. Previously, FeNO measurement required static, chemiluminesence-based NO analysers, such as the NIOX Nitric Oxide Monitoring System (Aerocrine AB, Solna, Sweden). The use of these analysers in routine clinical practice is, however, limited by their size and expense. A portable hand-held NO-analyser, the NIOX MINO Asthma Inflammation Monitor (Aerocrine AB, Solna, Sweden), which uses electrochemical sensors to measure FeNO levels, is now available. This is ideally suited for use in primary care, where the majority of asthma patients are managed .
Studies comparing the performance of the NIOX MINO and the NIOX have shown that the level of agreement between the two devices is clinically acceptable [15–18] and the NIOX MINO is now approved by the Federal Drugs Administration in the United States for assessing asthma-related airway inflammation . The manufacturer recommends that one measurement is sufficient when using the NIOX MINO  rather than two as recommended in the latest ATS/ERS guidelines . The manufacturer states an accuracy of ±5 ppb of measured value below 50 ppb and ±10% at or above 50 ppb . There are a number of studies that support this recommendation of a single measurement [15, 16, 21, 22], however, to date only one small paediatric study has addressed this question . In this study of fifty-five children aged 4-15 years, the first acceptable FeNO measurement obtained using the NIOX MINO was not significantly different from the mean of all measurements (24 versus 27 ppb, p > 0.5) but the median coefficient of variation for the NIOX MINO was 7.4% (range: 0-44.6) suggesting that one FeNO measurement is not sufficient when using the NIOX MINO. The aim of the current validation study was to assess the reproducibility of NIOX MINO measurements in children and teenagers across age, sex and lung function, in terms of both the absolute and categorical FeNO values.
Study design and participants
In this validation study, the reproducibility of NIOX MINO measurements was assessed in two separate populations.
Unselected, community-based, birth cohort
The birth cohort consisting of teenagers aged 16-18 years enrolled in a whole population birth cohort (Research ethics reference 06/Q1701/34) of 1536 infants born on the Isle of Wight, United Kingdom in 1989/1990 to investigate the natural history of asthma and allergic disorders. All these teenagers were assessed with questionnaires, FeNO measurements, spirometry and skin prick testing. In accordance with the ATS/ERS guidelines , FeNO measurements (NIOX MINO, Aerocrine AB, Solna, Sweden) were performed prior to spirometric testing with participants standing. The NIOX MINO 300 sensor was used with the sensor being changed after 300 measurements. Participants were asked to inhale to total lung capacity through the NIOX MINO and then exhale for 10 seconds at 50 ml/sec (assisted by visual and auditory cues). Spirometry (KoKo, nSpire Health, Hertford, United Kingdom) was performed according to the ATS/ERS guidelines . FEV1 was recorded as percent predicted for age, height, sex and ethnic origin. Skin prick testing was performed by a standardised method  to a panel of common allergens: house dust mite (Dermatophagoides pteronyssinus), grass pollen mix, tree pollen mix, cat and dog epithelia, Alternaria alternata, Cladosporium herbarum, milk, hens' egg, wheat, soya, cod and peanut as well as histamine and physiological saline (Alk-Abello, Horsholm, Denmark). Single-headed lancets were used and the skin pricked at an angle of 90°. The wheal diameter was recorded at 15 minutes.
Interventional asthma study
This multi-centre study was designed to investigate whether monitoring FeNO levels can improve the management of children with asthma (Research ethics reference 06/Q1702/9). The study sites were Southampton University Hospital NHS Trust, St Mary's Hospital in Newport on the Isle of Wight and St Mary's Hospital in Portsmouth. Inclusion criteria for the interventional study were age 6-17 years, clinical diagnosis of asthma (based on typical symptoms, at least a 15% increase in FEV1 (forced expiratory volume in 1 second) with bronchodilator or at least 15% diurnal variability in PEF rates) and receiving treatment with at least 400 mcg beclomethasone equivalent daily. Exclusion criteria were cigarette smoking, poor adherence with medication, previous life-threatening exacerbations or the need for maintenance oral prednisolone. In the intervention study, participants were assessed 2-monthly for a year. The spirometry data (KoKo, nSpire Health, Hertford, United Kingdom) and two FeNO measurements (NIOX MINO, Aerocrine AB, Solna, Sweden) used in this study were obtained at the same visit. Both were measured as per the cohort participants. Demographic details, asthma history, asthma treatment and history of other atopic diseases were recorded for all participants. Skin prick testing was performed as per the cohort participants to a grass pollen mix, tree pollen mix, cat, dog, house dust mite, saline and histamine (ALK-Abello, Horsholm, Denmark). A single wheal of at least 3 mm was considered indicative of atopy in the presence of appropriate negative and positive control results.
Data were transferred to SPSS version 15 for analysis. Bland-Altman plots were constructed to assess the degree of agreement between the absolute values of paired FeNO readings measured using the NIOX MINO. FeNO were logarithmically transformed to normalise the data. Cohen's Kappa was used to assess the degree of agreement between paired categorical NIOX MINO measurements. Nitric oxide values were categorised as low, normal, intermediate or high according to the reference ranges for age less than 12 years and 12 years or more provided by Aerocrine  (Table 1). Subgroup analyses were undertaken for males and females, participants with low and high FEV1 values, older and younger participants and participants with and without asthma.
Paired NIOX MINO measurements were obtained from 494 of the participants enrolled in the 17 year follow-up study up to 11th December 2007. Of these, 71 were classified as having current asthma on the basis of positive responses to both ISAAC validated questions 'Have you ever been diagnosed with asthma by a physician?', and, 'Have you had wheezing or whistling in the chest in the last 12 months?'. The demographic and clinical characteristics of the participants in this population alongside those of the intervention study participants are shown in Table 2.
Reproducibility of the absolute value of FeNO
Although a statistically significant linear association was found between the first and second FeNO readings in individual participants (Pearson's correlation coefficient = 0.980, p < 0.001), a Bland-Altman plot showed a high degree of variability between these paired NIOX MINO measurements (Figure 1). The mean intra-participant difference in FeNO (second FeNO reading minus first FeNO reading) was 1.37 ppb, suggesting that the second FeNO reading in each participant was on average higher than the first. This difference was statistically different from zero (one sample t-test, p < 0.001). The 95% limits of agreement of -7.61 to 10.34 ppb imply that if two NIOX MINO measurements are undertaken in the same assessment, there is a 95% chance that the second FeNO value will be up to 10 ppb above or 8 ppb below the first. Much of this variability occurs at higher FeNO levels (Figure 1) and, when subjects with FeNO values above 75 ppb were excluded from the analysis, the mean intra-participant difference in FeNO was 0.90 ppb and the 95% limits of agreement were -4.89 to 6.70 ppb. Similar findings were seen in subgroup analyses for males and females, participants with an FEV1 in the lowest and highest tertiles, and participants with and without asthma (Table 3). In participants with asthma, the mean intra-participant difference in FeNO was 2.37 ppb and the 95% limits of agreement were -11.38 to 16.12 ppb.
Reproducibility of categorical FeNO values
When FeNO values were categorised as low, normal, intermediate or high (using <12 or ≥12 year values as appropriate), very close agreement between paired NIOX MINO measurements in individual participants was observed (Kappa (κ) = 0.907, p < 0.001) (Table 4). In the planned subgroup analyses, very close agreement was seen in males (κ = 0.894, p < 0.001) and females (κ = 0.919, p < 0.001), participants with an FEV1 in the lowest (κ = 0.943, p < 0.001) and highest (κ = 0.872, p < 0.001) tertiles, and in those with current asthma (κ = 0.935, p < 0.001).
Paired FeNO readings were obtained from 65 of the participants enrolled in the intervention study. The characteristics of these participants are outlined in Table 2, all had typical symptoms of asthma. As expected, these participants had more severe asthma and were more likely to be atopic.
Reproducibility of the absolute value of FeNO
Once again, there was a statistically significant linear association between the first and second FeNO readings in individual participants (Pearson's correlation coefficient = 0.977, p < 0.001). Although the mean intra-participant difference in FeNO for all participants was only 0.31 ppb, which was not different from zero (one sample t-test, p = 0.740), the 95% limits of agreement were widely spread (-14.28 to 14.90 ppb) (Figure 2). Even wider limits of agreement were observed in males, participants in the highest tertile for age and participants with an FEV1 in the lowest tertile (Table 5). When FeNO values above 75 ppb were excluded the intra-participant difference in FeNO was 0.64 ppb with 95% limits of agreement of -8.35 to 9.62 ppb.
Reproducibility of categorical FeNO values
For all participants, a Kappa value (κ) of 0.879 (p < 0.001) was ascertained, suggesting very close agreement between the first and second FeNO readings in individual participants when FeNO values were categorised as low, normal, intermediate or high (Table 6). A similarly high degree of agreement between categorical FeNO values was observed in males (κ = 0.823, p < 0.001) and females (κ = 0.940, p < 0.001), participants in the lowest tertile for age (κ = 0.921, p < 0.001) and participants with an FEV1 in the lowest (κ = 0.845, p < 0.001) and highest (κ = 1.000, p < 0.001) tertiles. It was lower for participants in the highest tertile for age (κ = 0.667, p < 0.001), although even in this group, agreement was reasonable.
This study aimed to validate the reproducibility of a new, portable NO-analyser (the NIOX MINO, Aerocrine AB, Solna, Sweden) in children and teenagers. The results from two complementary groups of children and teenagers indicate that the reproducibility of NIOX MINO measurements across the paediatric age range is poor when considering the absolute value FeNO but is acceptable when FeNO values are categorised as low, normal, intermediate or high. This suggests that if clinical decisions in future are based on specific cut-off values of FeNO, the mean of at least two FeNO measurements should be reported when using the NIOX MINO. However, for treatment algorithms based on FeNO categories, one NIOX MINO measurement would be sufficient, saving cost and time in clinic. This study is the largest of its kind to date and is the first to consider the effect of patient characteristics on reproducibility of NIOX MINO measurements.
Our findings contradict those of other studies, which have reported excellent reproducibility of the absolute value of FeNO measurements obtained using the NIOX MINO [15, 16, 21, 22]. These studies have, however, included both adults and children, so their results do not validate the use of the NIOX MINO in paediatric practice. Much of this intra-subject variability is seen at higher levels of FeNO and so it may be more patient related than monitor related  and unlikely to cause any indecision about clinical management. For the intervention asthma study participants, the reproducibility of the absolute value of FeNO was poorer in those with a low FEV1 whilst in the birth cohort participants, greater variability was observed in participants with asthma. These are precisely the participants in whom FeNO measurement would be performed in clinical practice. Our results therefore support McGill's recommendation that the mean of at least two FeNO measurements should be used when reporting absolute values using the NIOX MINO with children and teenagers . It has been suggested that greater variability between FeNO measurements is more likely in those who are not consistently able to record FeNO . Given that the success rate with the NIOX MINO increases with age , it is therefore surprising that we observed closer agreement between paired NIOX MINO measurements in the youngest participants (Table 5). Potentially, taking the average of three or more measurements may have further increased the reliability of the FeNO value but this was outside the scope of this study. The other potential limitation of this study is that a gold standard measure of FeNO, such as the NIOX monitor (Aerocrine AB, Solna, Sweden) was not included; again this was outside the scope of this study which was focusing on the reproducibility of NIOX MINO readings within one assessment rather than their validity.
No previous studies have evaluated the reproducibility of categorical FeNO values obtained using the NIOX MINO. Our data suggests that the reproducibility of this approach is acceptable although 10% of subjects may be misclassified by one category. These categories are based on cut off values from a number of studies [25, 27] and there may be a certain amount of imprecision in the boundaries chosen. The small amount of misclassification bias is likely to be of minimal clinical importance unless FeNO levels are being used in isolation to diagnose asthma  or direct the clinical management of patients with asthma . Different research groups are, however, using different cut off values, so it is important to assess whether reproducibility is comparable with other cut off values. Additionally, future research should seek to determine whether the accuracy of NIOX MINO measurements is affected by the number of attempts required to record FeNO, as this would have implications for the interpretation of FeNO measurements in clinical practice. This is particularly important for patients less than 12 years of age who often need more attempts and were relatively poorly represented in our study. Lastly, given the number of influences on FeNO levels, these measurement may proved to be most useful when standardised to the patient's baseline FeNO level while their asthma is well controlled as we have previously suggested . Such a strategy would necessitate a further look at the consequences of relying on a single estimate of the level of FeNO in driving clinical management.
In summary, the NIOX MINO could improve the management of children with asthma by enabling physicians to monitor underlying airway inflammation more easily than has been possible to date. According to the manufacturer (Aerocrine AB, Solna, Sweden), one FeNO measurement is sufficient when using the NIOX MINO, instead of two as recommended by the ATS/ERS guidelines. This study has found that in two distinct groups of children and teenagers, one NIOX MINO measurement is acceptable when using FeNO to direct asthma management, based on FeNO categories, but when using the absolute value of FeNO, the mean of at least two NIOX MINO measurements should be used.
GINA: Global Strategy for Asthma Management and Prevention. 2004.
von Mutius E: The burden of childhood asthma. Arch Dis Child 2000,82(Suppl II):ii2-ii5.
The International Study of Asthma and Allergies in Childhood (ISAAC) steering committee: Worldwide variations in the prevalence of asthma symptoms: the International Study of Asthma and Allergies in Childhood (ISAAC). Eur Resp J 1998, 12:315–35.
American Thoracic Society, European Respiratory Society: ATS/ERS Recommendations for standardized procedures for the online and offline measurement of exhaled lower respiratory nitric oxide and nasal nitric oxide. Am J Resp Crit Care Med 2005, 171:912–30.
Jatakanon A, Lim S, Kharitonov SA, Chung KF, Barnes PJ: Correlation between exhaled nitric oxide, sputum eosinophils, and methacholine responsiveness in patients with mild asthma. Thorax 1998, 53:91–5.
Payne D, Adcock I, Wilson N, Oates T, Scallan M, Bush A: Relationship between exhaled nitric oxide and mucosal eosinophilic inflammation in children with difficult asthma, after treatment with oral prednisolone. Am J Respir Crit Care Med 2001, 164:1376–81.
Roberts G, Hurley C, Bush A, Lack G: Longitudinal study of grass pollen exposure, seasonal allergic asthma symptoms, and exhaled nitric oxide in childhood seasonal allergic asthma. Thorax 2004, 59:752–6.
Jones SL, Kittelson J, Cowan JO, Flannery EM, Hancox RJ, McLachlan CR, Taylor DR: The Predictive value of exhaled nitric oxide measurements in assessing changes in asthma control. Am J Respir Crit Care Med 2001, 164:738–43.
Jones SL, Herbison P, Cowan JO, Flannery EM, Hancox RJ, McLachlan CR, Taylor DR: Exhaled NO and assessment of anti-inflammatory effects of inhaled steroid: dose-response relationship. Eur Respir J 2002, 20:601–8.
Montuschi P, Mondino C, Koch P, Ciabattoni G, Barnes PJ, Baviera G: Effects of montelukast treatment and withdrawal on fractional exhaled nitric oxide and lung function in children with asthma. Chest 2007, 132:1876–81.
Zacharasiewicz A, Wilson N, Lex C, Erin EM, Li AM, Hansel T, Khan M, Bush A: Clinical use of noninvasive measurements of airway inflammation in steroid reduction in children. Am J Respir Crit Care Med 2005, 171:1077–1082.
Szefler SJ, Mitchell H, Sorkness CA, Gergen PJ, O'Connor GT, Morgan WJ, Kattan M, Pongracic JA, Teach SJ, Bloomberg GR, Eggleston PA, Gruchalla RS, Kercsmar CM, Liu AH, Wildfire JJ, Curry MD, Busse WW: Management of asthma based on exhaled nitric oxide in addition to guideline-based treatment for inner-city adolescents and young adults: a randomised controlled trial. Am J Resp Crit Care Medicine 2008, 372:1065–1072.
Jongste JC, Carraro S, Hop WC, CHARISM Study Group, Baraldi E: Daily Telemonitoring of Exhaled Nitric Oxide and Symptoms in the Treatment of Childhood Asthma. Am J Respir Crit Care Med 2009, 179:93–97.
Asthma UK. Where do We Stand?Asthma in the UK Today 2004.
Alving K, Janson C, Nordvall L: Performance of a new hand-held device for exhaled nitric oxide measurement in adults and children. Respir Res 2006, 7:67.
Khalili B, Boggs PB, L BS: Reliability of a new hand-held device for the measurement of exhaled nitric oxide. Allergy 2007, 62:1171–4.
Menzies D, Nair A, Lipworth BJ: Portable exhaled nitric oxide measurement: comparison with the "gold standard" technique. Chest 2007, 131:410–4.
McGill C, Malik G, Turner SW: Validation of a hand-held exhaled nitric oxide analyzer for use in children. Pediatr Pulmonol 2006, 41:1053–7.
US Food and Drug Administration [http://www.accessdata.fda.gov/cdrh_docs/pdf7/K072816.pdf]
Aerocrine AB: Measuring exhaled NO with NIOX MINO ® . [http://www.aerocrine.com/en/niox-mino/Procedure/]
Gill M, Graff GR, Adler AJ, Dweik RA: Validation study of fractional exhaled nitric oxide measurements using a handheld monitoring device. J Asthma 2006, 43:731–4.
Tamasi L, Bohacs A, Bikov A, Andorka C, Rigo J, Losonczy G, Horvath I: Exhaled Nitric Oxide in Pregnant Healthy and Asthmatic Women. Journal of Asthma 2009, 46:786–791.
Miller MR, Hankinson J, Brusasco V, Burgos F, Casaburi R, Coates A, Crapo R, Enright P, Grinten CP, Gustafsson P, Jensen R, Johnson DC, MacIntyre N, McKay R, Navajas D, Pedersen OF, Pellegrino R, Viegi G, Wanger J: Standardisation of spirometry. Eur Resp J 2005, 26:319–38.
Dreborg S: Skin tests for the diagnosis of IgE-mediated allergy. Allergy 1989,144(supple 10):31–37.
Aerocrine: Guide to Interpretation of eNO Values. [http://www.aerocrine.com/Global/pdf/Interpretation_guide.pdf]
Gill M, Walker S, Khan A, Green SM, Kim L, Gray S, Krauss B: Exhaled nitric oxide levels during acute asthma exacerbation. Acad Emerg Med 2005, 12:579–86.
Taylor DR, Pijnenburg MW, Smith AD, de Jongste JC: Exhaled nitric oxide measurements: clinical application and interpretation. Thorax 2006, 61:817–827.
Schneider A, Tilemann L, Schermer T, Gindner L, Laux G, Szecsenyi J, Meyer FJ: Diagnosing Asthma in General Practice with Portable Exhaled Nitric Oxide Measurement - Results of a Prospective Diagnostic Study: FENO ≤ 16 ppb better than FENO ≤ 12 ppb to rule out mild and moderate to severe asthma. Respiratory Research 2009, 10:64.
This component of the 17 year assessment of the 1989 Isle of Wight birth cohort was funded by the British Medical Association. Sparks funded the exhaled nitric oxide study. We would like to acknowledge the help of all the staff at The David Hide Asthma and Allergy Research Centre in undertaking the 17 year assessment of 1989 Isle of Wight birth cohort. Aerocrine kindly provided the exhaled nitric oxide consumables for the cohort assessment but they had no input into the study design or analysis of the data presented in this manuscript. We would also like to acknowledge the help of the children's respiratory teams at Southampton, Portsmouth and The Isle of Wight and the Wellcome Trust Clinical Research Facility staff at Southampton in assessing participants in the exhaled nitric oxide study.
The authors declare that they have no competing interests.
AS: design, acquisition of data, analysis and interpretation, manuscript writing; BC: acquisition of data and critical revision of manuscript; JG: acquisition of data and critical revision of manuscript; KP: acquisition of data, analysis and critical revision of manuscript; KD: acquisition of data and critical revision of manuscript; AR: acquisition of data and critical revision of manuscript; RK: interpretation of data and critical revision of manuscript; SHA: interpretation of data and critical revision of manuscript; GR: conception anddesign, analysis and interpretation, critical revision and final approval. All authors have read and approved the final manuscript.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Selby, A., Clayton, B., Grundy, J. et al. Are exhaled nitric oxide measurements using the portable NIOX MINO repeatable?. Respir Res 11, 43 (2010). https://doi.org/10.1186/1465-9921-11-43
- Nitric Oxide
- Birth Cohort
- Airway Inflammation
- Skin Prick Testing