- Letter to the Editor
- Open Access
- Published:
Electronic applications for the CFQ-R scoring
Respiratory Research volume 18, Article number: 108 (2017)
Abstract
Patient reported outcomes (PROs) have become widely accepted outcome measures in cystic fibrosis (CF) and other respiratory diseases. The Cystic Fibrosis-Questionnaire-Revised (CFQ-R) is the best validated and most widely used PRO for CF. Data collection can be time-intensive, and electronic platforms would greatly facilitate the feasibility, utility and accuracy of administration of the CFQ-R. Given that the CFQ-R is utilized in virtually all clinical trials worldwide and is increasingly integrated into clinical practice, we developed a software application that will help users to administer, score and save CFQ-R data for all versions. All codes are open access, which will enable other PRO users to design similar applications for other respiratory diseases, such as primary ciliary dyskinesia and non-CF bronchiectasis.
Background
Patient-reported outcomes (PROs), are defined as systematic assessments of symptoms or daily functioning as reported by the patient, him or herself [1]. They are important endpoints in clinical trials of new medications and can serve as outcome measures in clinical research and to improve clinical care. Both the U.S. Food and Drug Administration (FDA) and European Medicines Agency (EMA) have formally recognized their importance [1, 2] and thus, PROs are increasingly utilized as primary or secondary outcomes in the drug approval process [3]. Numerous studies have also demonstrated the importance of integrating them into clinical practice and research to monitor the health of a population, evaluate quality of care, and aid in communication and clinical decision making [4, 5]. Historically, the mode of administration for PROs has been by hard copy/paper format. This can be a time- and resource intensive process in a clinic setting and therefore, our main objective was to develop an electronic version to reduce the time associated with data entry and scoring, and reduce errors both in the administration (e.g., skipping items) and data entry processes.
Main text
The use of PROs has increased significantly in cystic fibrosis (CF) research and care over the past 20 years [6]. The Cystic Fibrosis Questionnaire-Revised (CFQ-R) is the most commonly used and best validated disease-specific PRO [7,8,9]. The CFQ-R has been validated (i.e. demonstrated reliability, validity, and sensitivity) and has been translated into 38 languages [8], and has been used in clinical trials evaluating medications with differing mechanisms of action (e.g., hypertonic saline, inhaled antibiotics, CFTR correctors-modulators). Importantly, it was developed using the FDA Guidance (2009), including qualitative phases, which elicited patient, parent and provider input. It was designed to systematically measure respiratory and gastrointestinal symptoms, treatment burden, and daily functioning.
Four validated versions of the CFQ-R were adapted for electronic administration in this study: 1) self-report for adolescents and adults, ages 14 years and older (CFQ-R Teen/Adult); 2) self-report for children, ages 12–13; 3) interviewer-administered version for children ages 6 to 11; and 4) parent proxy version for caregivers of children, ages 6 to 13 years.
The code of the application is open source and can be found at https://github.com/CFQR where continuous integration is achieved with Travis CI. The CFQ-R-application is a React web application (HTML, CSS, Javascript) built with ReactJS framework. The CFQ-R application is freely available at https://cfqr.github.io and is made to be run from different environments: It can be used online, downloaded as a desktop application for offline use (Windows, Mac, Linux), and is also available as a mobile application for iOS and Android platforms (from popular application stores).
Besides automatically calculating the scores from the different domains obtained by the CFQ-R, saving time, and avoiding miscalculations, the CFQ-R application has several other functionalities. It can be used to visually represent longitudinal trajectories of CFQ-R scores (Fig. 1), which may be helpful for the clinician. It also allows data export for downstream statistical processing for the researcher. The application can store data in different ways. Data can be stored locally on the tablet or PC used by the user. The user may also wish to connect the device to the Internet to allow automatic backup in a cloud (using the Google service Firebase). The latter function will enable synchronized data capture from multiple devices (e.g. in larger clinical trial). CFQ-R’s in eight languages have currently been included (i.e. Danish, Dutch, English, German, Italian, French, Spanish, and Swedish). Other languages can be added on request.
Cystic fibrosis questionnaire revised (CFQ-R) application output. Output from the CFQ-R application (teen/adult version) showing demographic data and trajectories for 12 domains. The application calculates the score derived from the CFQ-R, on a 0–100 scale with higher scores indicating better health status. Other output forms are also available
As an additional perspective, users of non-CF PROs measures may wish to use codes from this application as a template to make similar tools that can be used for other respiratory diseases, such as primary ciliary dyskinesia and non-CF bronchiectasis. Although a simpler desktop tool for the St. George’s Respiratory Questionnaire was previously developed [10], we are not aware of the existence of similar applications for other respiratory PROs.
This application has some limitations. First, the user should be aware that data collection has to comply with the rules established by local ethics committees. Second, although a meta-analysis of PROs has concluded that there is no bias attributable to paper vs. electronic completion of a large number of PROs [11], we have not studied the user experience for this application of the CFQ-R.
Conclusion
In summary, utilization and integration of PROs into both research and clinical practice is facilitated by the availability of electronic modes of administration. Thus, this electronic application was primarily developed to make both in-clinic use of CFQ-R easier and more efficient, and to facilitate accurate and large-scale data collection with the CFQ-R. An electronic platform enables the clinician to immediately score the CFQ-R and utilize the scores to discuss concerns with patients. Use of an electronic version of the CFQ-R will also enable the generation of high-quality data, e.g. larger amounts of data, consistent data collection, and high response rates. The CFQ-R is used in virtually every clinical trial of new medications and treatments in CF and the electronic platform facilitates this type of data collection across countries and languages.
Abbreviations
- CFQ-R:
-
Cystic fibrosis questionnaire revised
- EMA:
-
European Medicines Agency
- FDA:
-
Food and drug administration
- PRO:
-
Patient reported outcomes
References
- 1.
U.S. Food and Drug Administration. Guidance for industry patientreported outcome measures: Use in medical product development to support labeling claims. 2009. Availible at: http://www.fda.gov/downloads/drugs/guidances/ucm193282.pdf. Accessed 20 Jan 2017.
- 2.
Venkatesan P. New European guidance on patient-reported outcomes. Lancet Oncol. 2016;17:e226.
- 3.
Retsch-Bogart GZ, Quittner AL, Gibson RL, Oermann CM, McCoy KS, Montgomery AB, Cooper PJ. Efficacy and safety of inhaled aztreonam lysine for airway pseudomonas in cystic fibrosis. Chest. 2009;135:1223–32.
- 4.
Black N, Burke L, Forrest CB, Sieberer UH, Ahmed S, Valderas JM, Bartlett SJ, Alonso J. Patient-reported outcomes: pathways to better health, better services, and better societies. Qual Life Res. 2016;25:1103–12.
- 5.
Snyder CF, Aaronson NK, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, Hess R, Miller DM, Reeve DM, Santana M. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life Res. 2012;21:1305–14.
- 6.
Goss CH, Quittner AL. Patient-reported outcomes in cystic fibrosis. Proc Am Thorac Soc. 2007;4:378–86.
- 7.
Quittner AL, Sawicki GS, McMullen A, Rasouliyan L, Pasta DJ, Yegin A, Konstan MW. Psychometric evaluation of the Cystic Fibrosis Questionnaire-Revised in a national sample. Qual Life Res. 2012;21:1267–78.
- 8.
Quittner AL, Buu A, Messer MA, Modi AC, Watrous M. Development and validation of The Cystic Fibrosis Questionnaire in the United States: a health-related quality-of-life measure for cystic fibrosis. Chest. 2005;128:2347–54.
- 9.
Henry B, Aussage P, Grosskopf C, Goehrs JM. Development of the Cystic Fibrosis Questionnaire (CFQ) for assessing quality of life in pediatric and adult patients. Qual Life Res. 2003;12:63–76.
- 10.
Gelpi M, Argentiero J, Jones PW, Ronit A. A Scoring Application for the St. George’s Respiratory Questionnaire. Chest. 2016;150:747–8.
- 11.
Rutherford C, Costa D, Mercieca-Bebber R, Rice H, Gabb L, King M. Mode of administration does not cause bias in patient-reported outcome results: a meta-analysis. Qual Life Res. 2016;25:559–74.
Acknowledgement
None
Funding
This work received funding from the Danish Cystic Fibrosis Foundation.
Availability of data and materials
All source codes are available and can be freely used at https://github.com/CFQR
Authors’ contributions
All authors conceptualized the project. AR, MG, JA designed the software. JA was primarily responsible for programming assisted by AR and MG. AR and ALQ drafted the manuscript. All authors have critically revised and approved the final version.
Competing interests
AR: Travelling grants from Gilead; JA: No conflicts of interests; MG: No conflicts of interests; IHM: No conflicts of interest; SDN: Unrestricted research grants from Novo Nordisk Foundation, Lundbeck Foundation, and Rigshospitalet Research Council. Travelling grants from Gilead, MSD, BMS, and GSK/ViiV. Advisory board activity for Gilead and GSK/ViiV. TP: No conflicts of interest. ALQ: No conflicts of interest.
Consent for publication
Not applicable
Ethics approval
Not applicable
Financial/Nonfinancial disclosures
This work received funding from the Danish Cystic Fibrosis Foundation. AR: Travelling grants from Gilead; JA: No conflicts of interests; MG: No conflicts of interests; IHM: No conflicts of interest; SDN: Unrestricted research grants from Novo Nordisk Foundation, Lundbeck Foundation, and Rigshospitalet Research Council. Travelling grants from Gilead, MSD, BMS, and GSK/ViiV. Advisory board activity for Gilead and GSK/ViiV; TP: No conflicts of interest; ALQ: No conflicts of interest.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Ronit, A., Gelpi, M., Argentiero, J. et al. Electronic applications for the CFQ-R scoring. Respir Res 18, 108 (2017). https://doi.org/10.1186/s12931-017-0592-z
Received:
Accepted:
Published:
Keywords
- Application
- Cystic fibrosis
- Patient reported outcomes
- Software
