Identification of lung cancer with high sensitivity and specificity by blood testing
- Petra Leidinger1_861Email author,
- Andreas Keller2_861Email author,
- Sabrina Heisel1_861,
- Nicole Ludwig1_861,
- Stefanie Rheinheimer1_861,
- Veronika Klein1_861,
- Claudia Andres2_861,
- Andrea Staratschek-Jox3_861,
- Jürgen Wolf4_861,
- Erich Stoelben5_861,
- Bernhard Stephan6_861,
- Ingo Stehle7_861,
- Jürg Hamacher8_861,
- Hanno Huwer9_861,
- Hans-Peter Lenhof2_861Email author and
- Eckart Meese1_861Email author
© The Author(s) 2010
Received: 22 July 2009
Accepted: 10 February 2010
Published: 10 February 2010
Lung cancer is a very frequent and lethal tumor with an identifiable risk population. Cytological analysis and chest X-ray failed to reduce mortality, and CT screenings are still controversially discussed. Recent studies provided first evidence for the potential usefulness of autoantigens as markers for lung cancer.
We used extended panels of arrayed antigens and determined autoantibody signatures of sera from patients with different kinds of lung cancer, different common non-tumor lung pathologies, and controls without any lung disease by a newly developed computer aided image analysis procedure. The resulting signatures were classified using linear kernel Support Vector Machines and 10-fold cross-validation.
The novel approach allowed for discriminating lung cancer patients from controls without any lung disease with a specificity of 97.0%, a sensitivity of 97.9%, and an accuracy of 97.6%. The classification of stage IA/IB tumors and controls yielded a specificity of 97.6%, a sensitivity of 75.9%, and an accuracy of 92.9%. The discrimination of lung cancer patients from patients with non-tumor lung pathologies reached an accuracy of 88.5%.
We were able to separate lung cancer patients from subjects without any lung disease with high accuracy. Furthermore, lung cancer patients could be seprated from patients with other non-tumor lung diseases. These results provide clear evidence that blood-based tests open new avenues for the early diagnosis of lung cancer.
Lung cancer is the leading cause of cancer death worldwide. In 2008, lung cancer is estimated to account for more than 200,000 new cancer cases and 160,000 cancer deaths in the United States . Independent of the histological subtype, the five-year survival rate is among the lowest of all cancers.
Patients with stage IA and IB NSCLC (non small cell lung cancer) show 5-year survival rates between 60 to 80%, and patients with stage IIA and IIB NSCLC between 40 to 50% . The 5-year relative survival rate varies markedly depending on the stage at time of diagnosis, from 49 to 16 to 2% for local, regional, and distant stage disease, respectively . More than two thirds of lung cancer tumors are diagnosed at late stages when the survival rate is low .
As for other cancers, these data suggest that catching lung cancer while it is still small and locally defined significantly increases the chances of a cure . Recent evidence shows that low dose spiral computed tomography (CT) detects lung cancer at smaller sizes and earlier than chest X-ray (CXR) that failed to identify 79% of lung cancers that were smaller than 2 cm . A major drawback of low dose CT is the large number of false positive tests and the diagnosis of indolent tumors which in turn leads to an increased morbidity from unnecessary surgical treatment [6–8].
Molecular testing offers an opportunity for cancer detection before the occurrence of histopathological changes. The immune response to the tumor may recognize altered proteins of the tumor in situ and/or proteins that have been shed by the tumor and are circulating in the bloodstream. Recently, we identified a complex humoral immune response that could be used for the early diagnosis of brain cancer . As of recently, however, only limited data were available on the identification and validation of serum markers for the diagnosis of lung cancer. Single serum markers showed only a low sensitivity and specificity for the identification of lung cancer patients [10–15]. Several studies with smaller panels encompassing few markers including known autoantigens, cancer associated proteins, and serum proteins like GAGE7, p53, HER2, CEA or alpha1-antitrypsin provided first evidence that simultaneous analysis of several antigens have a higher potential for separating patients with lung carcinoma from controls [16–19]. Using a panel of 82 phage peptide clones we were able to separate squamous cell lung carcinoma from control sera with an accuracy of 93%. Low-grade squamous cell lung carcinoma were distinguished from control sera with an accuracy of 92.9% . Here, we extended our analysis by using an increased number of newly identified antigens to analyze not only squamous cell lung carcinoma but also other NSCLC as well as SCLC (small cell lung cancer). Furthermore, as a novelty we implemented and employed an image analysis method for evaluating the seroreactivity of the arrayed antigens.
Our study was to address the following questions: Can immunogenic antigens be used to differentiate lung cancer patients from controls with a very high sensitivity and specificity? Can stage I lung carcinomas be separated from controls without any lung disease with a comparable high sensitivity and specificity? Can lung cancer patients be separated from patients with other non-tumor lung pathologies (NTLP)? The affirmative answers to these questions will lay the basis for a prospective study aimed towards early identification of lung carcinomas.
Clinical parameters of the lung cancer patients
Total number, n (%)
- adenocarcinoma, n (%)
- large cell carcinoma, (%)
- squamous cell carcinoma, n (%)
age mean, years (range)
male, n (%)
female, n (%)
Clinical staging, n (%)
As one control group we combined 80 sera from different volunteers without lung cancer or without other NTLPs (in the following designated as "controls" or "control sera"). Out of these 80 controls we obtained 60 sera from healthy blood donors from the Department of Clinical Haemostaseology and Transfusion Medicine (Saarland University, Homburg) and 20 sera from patients with diseases not affecting the lungs (e.g. slipped disc or myocardial infarction) from the Cologne Smoking Study (CoSmoS). As a second control group we used 26 sera of patients with common non-tumor lung pathologies (NTLP), i.e. 20 patients with COPD/emphysema, and 6 patients with pneumonia. The NTLP sera were obtained from the Department of Pneumology (Saarland University, Homburg), and from the Department of Cardiothoracic Surgery, SHG Clinic Voelklingen/Saar. The control sera as well as the NTLP sera were not matched for age and gender. The mean age of all control and NTLP patients was 46.5 years, ranging from 21 to 74 years. The smoking status of the blood donors was unknown. All blood samples were obtained with patients' informed consent. Serum was isolated from the blood samples and stored as aliquots at -70°C.
Protein macroarray screening
High-density protein arrays consisting of 38,016 E. coli expressed proteins from the hex1 cDNA expression library  were screened with sera from patients with various human diseases including tumors and inflammatory diseases. In total, 1827 peptide clones that were reactive in this primary screening were combined on customized macroarrays and screened with 47 lung cancer sera, 26 NTLP sera, and 80 control sera. Screening was performed as described previously . In brief, macroarrays were washed twice with TBSTT (TBS, 0.05% Tween 20, 0.5% Triton X-100) and 4 times with TBS. After incubation in blocking solution (3% nonfat dry milk powder in TBST (TBS, 0.05% Tween 20)), macroarrays were incubated over night with sera 1:1000 diluted in blocking solution. After the incubation, sera were stored for the second incubation round. Three washing steps with TBST were followed by incubation with stripping solution at 70°C. Macroarrays were washed twice with TBST and 4 times with TBS. Incubation with blocking solution was followed by the second round of serum incubation over night. Macroarrays were washed three times with TBST, and incubated with secondary antibody (rabbit anti-human IgG, IgA, IgM-Cy5 (H+L)) 1:1000 diluted in blocking solution. Macroarrays were washed four times with TBST, twice with TBS and scanned by the GE Healthcare Typhoon 9410 scanner, with 50 μm resolution, and 300 PMT.
Image Analysis of protein macroarrays
We have developed an image analysis pipeline that ensures a standardized evaluation of the macroarrays. In a preprocessing step, the scanned images were adjusted, i.e., slight rotations of the scanned images were corrected and the edges of the image were virtually cut. Then, the array was segmented into regular subgrids that were in turn divided into the so-called spot (target) areas containing exactly one protein spot. By k-means clustering, the pixels belonging to the spot area of a protein were divided into foreground and background pixels. Optionally, the computed spot areas were adjusted, if the spot pixels exceeded the originally calculated target area. For the extraction of the dark protein spots a morphological operator from image processing, the so-called black top hat, utilizing a square structuring element has been applied to the image . Finally, the intensity of each spot was calculated as the mean value of all pixels of the spot in the processed image. For each protein array, the automated analysis provided the intensities of all protein spots. Since each expressed protein was spotted in duplicates on the macroarray, the mean intensity of the two replicates was assigned to each protein. Thus, the image analysis of each macroarray resulted in an autoantibody profile consisting of 1827 integer intensity values ranging from 0 to 255, the standard range of values in a grey scale image.
Statistical evaluation of autoantibody profiles
To minimize inter-array-effects, the measured autoantibody profiles that consist of the intensity values of the 1827 proteins were normalized using quantile normalization.
For the different classification tasks, we used standard linear kernel Support Vector Machines (SVMs)  with cost C of 1 that were evaluated by applying 10-fold cross validation. The classification procedure was repeated 10 times and the median of sensitivity, specificity, and accuracy was calculated. To test the model for overfitting, we further validated our prediction approach by performing so-called permutation tests, i.e., we randomly permuted class labels and performed classifications with the randomized data.
To directly access the "value" of an antigen with respect to its ability to separate two serum groups (1 and 2) from each other, we calculated the area under the Receiver Operator Characteristics curve (AUC) for each antigen A as follows: the normalized intensities of all analyzed sera were used as threshold values. For all thresholds t, we considered sera from group 1 with intensity value above t as true positives (TP), sera from group 1 with intensity value below t as false negatives (FN), sera from group 2 with intensity value below t as true negatives (TN), and sera from group 2 with intensity value above t as false positives (FP). Likewise for all thresholds, specificity (TN/(TN+FP)) and sensitivity (TP/(TP+FN)) were computed. Please note that in some cases the classification has to be inverted. In these cases, sera from group 1 with intensity value below t are considered as 'true positives' (TP). The Receiver Operator Characteristics (ROC) curve shows the sensitivity as function of one minus the specificity. AUC values can range from 0 to 1. An AUC of 0.5 for a spot means that the distribution of intensity values of sera from group 1 and sera from group 2 can not be distinguished. The more the AUC value of an antigen differs from 0.5, the better this antigen is suited to separate between the two serum groups. AUCs of 1 or 0 correspond to a perfect separation. Antigens with AUC values < 0.5 show higher intensity values in sera from group 1 than in sera from group 2. Antigens with AUC values > 0.5 show higher intensity values in sera from group 2 than in sera from group 1 .
To identify a larger number of proteins associated with an autoantibody response we screened high-density protein macroarrays generated from the fetal brain cDNA expression library hex1 encompassing more than 38,000 different peptide clones . This primary screening included sera from patients with various human diseases including tumors and inflammatory diseases. In total, we identified 1827 peptide clones that reacted with serum autoantibodies. We arrayed these peptide clones and screened the resulting biomarker array with sera from 29 NSCLC patients, 18 SCLC patients, 26 patients with common NTLPs, and 80 controls without lung cancer or other lung pathologies. For each array, we calculated the normalized spot intensities and AUC values of all antigens as detailed in Material and Methods.
Based on these autoantibody profiles we studied ten different classification problems. Besides the separation of lung cancer versus controls, we built prediction models for low-grade lung tumors (stage I A/I B) versus controls, lung cancer stage II, III, IV versus controls, lung cancer stage IA/IB versus lung cancer stage II, III, IV, NSCLC versus controls, SCLC versus controls, NSCLC versus SCLC, lung cancer versus NTLP, lung cancer versus COPD/emphysema, and lung cancer versus non-cancer (80 controls and 26 NTLP). To this end, we applied linear kernel SVMs evaluated by 10 repetitions of 10-fold cross validation.
The small standard deviation (0.007) of the classification accuracy demonstrates the stability of classification results. To test the model for overfitting, we carried out 100 permutation tests in a stratified manner that yielded a median accuracy of 54.3%. This can be explained by the differences in the class sizes. Permutation tests with even label distributions lead to an average accuracy of approximately 50%. Additionally, we carried out classification in stage I A/I B lung cancer sera and control sera. This comparison reached a sensitivity of 75.9%, a specificity of 97.6%, and an accuracy of 92.9%.
Summary of the results of the ten different classification tasks.
lung cancer vs controls
lung cancer stage IA/IB vs controls
lung cancer stage II, III, IV vs controls
lung cancer stage IA/IB vs lung cancer stage II, III, IV
NSCLC vs controls
SCLC vs controls
NSCLC vs SCLC
lung cancer vs NTLP
lung cancer vs non-cancer
lung cancer vs COPD/emphysema
There is widespread consensus that detection of cancer at an early stage can be live saving. Lung cancer screening however remains a controversial issue since CXR and sputum cytology screening showed no benefit towards reduced mortality [6, 8]. Low dose CT can detect tumors that are smaller in size and are at an earlier stage in development. However, the high sensitivity of low dose CT screening is balanced by a rather high rate of false positive scans of up to 20% , which ultimately prove benign after unnecessary surgical interventions . In summary, screening of persons asymptomatic for lung cancer is not recommended at present neither by CXR, sputum cytology nor by low dose CT .
Nevertheless, the identification of small lung cancers had lead to renewed interest in more specific markers that may contribute to an early identification of lung cancer. While the immune system is not efficient in destroying lung cancer, it recognizes cancer cells and can be utilized as diagnostic tool: Autoantibodies against cancer-associated antigens can be measured up to 5 years before symptomatic disease , have a long half-life , and can be detected at low costs. Single autoantigens that are immunogenic in lung cancer show a low sensitivity and specificity [10–15]. Combined measures of antibody reactivities to a panel of several arrayed proteins have been used to discriminate sera of lung cancer patients from control sera. These proteins include known tumor associated antigens like p53 and c-myc, known serum proteins like carcinoembryonic antigen and apha1-antitrypsin, and five predictive phage-expressed proteins recognized by serum antibodies [16–19]. There was no overlap between the protein sets used in these studies indicating a large number of immunogenic proteins that still await identification.
Lung carcinoma show complex cellular abnormalities including multiple genetic changes, like DNA sequence alterations, copy number changes, and aberrant methylation [29–32]. Extended antigen panels may most adequately analyze this cellular heterogeneity. The examination of a large antigen panel that reflects the complexity of immunogenic alterations in tumor cells likely contributes to a reliable classification with high accuracy, sensitivity, and specificity. The disadvantage of screening complex cDNA expression libraries with a large number of sera is, however, an inevitable degree of variability due to expression variability of bacterial in vivo expression systems. Nevertheless, in this study we were able to differentiate lung cancer patients from controls with high accuracy. Likewise, we were able to separate lung cancer patients from patients with non-tumor diseases of the lung with high accuracy.
Future studies have to elucidate whether the analysis of subgroups of lung cancer will be possible by smaller antigen panels. Smaller panels will facilitate to use full-length purified proteins for diagnostic purposes at affordable costs. Ideally, such antigen sets will even render the separation of histopathological subgroups like SCLC and NSCLC feasible.
The usefulness of complex antigen patterns for early lung cancer diagnosis awaits further confirmation by prospective studies. The reduction of the lung cancer associated mortality is an independent problem. There is an evident correlation between tumor size and survival time  for lung cancer. However, some lung cancers metastasize while the original tumor is still small. It is supposed that metastasis appears to primarily depend on the tumor genetics and the angiogenesis. In summary, our study shows that the immune system, even though not effective in destroying the tumor, may very well provide highly sensitive and specific markers for lung cancer in its early development.
Autoantibodies are potentially well suited as cancer biomarkers, because only a minimal-invasive intervention is needed for their extraction, they can be easily measured, they are stable in blood, and they have a long half-life. The drawback of single autoantibodies is their low diagnostic sensitivity. Here, we show that the combination of an expanded number of autoantigens for the creation of complex autoantibody profiles allow for the differentiation of lung cancer patients from patients with other common non-tumor lung diseases or healthy blood donors with high accuracy.
List of abbreviations used
non-tumor lung pathology
non-small cell lung cancer
small cell lung cancer
Support Vector Machine
area under the receiver operator characteristics curve
chronic obstructive pulmonary disease
This work was funded in part by "Homburger Forschungsförderungsprogramm (HOMFOR)" and Hedwig-Stalter foundation.
- Jemal A, Siegel R, Ward E, Hao Y, Xu J, Murray T, Thun MJ: Cancer statistics, 2008. CA Cancer J Clin 2008,58(2):71–96.View ArticlePubMedGoogle Scholar
- Scott WJ, Howington J, Feigenberg S, Movsas B, Pisters K: Treatment of non-small cell lung cancer stage I and stage II: ACCP evidence-based clinical practice guidelines (2nd edition). Chest 2007,132(3 Suppl):234S-242S.View ArticlePubMedGoogle Scholar
- Ries L, Eisner M, Kosary C, Hankey B, Miller B, Clegg L, Mariotto A, Feuer E, Edwards B: SEER Cancer Statistics Review, 1975–2002. National Cancer Institute. Bethesda, MD; 2002.Google Scholar
- Henschke CI, Yankelevitz DF: CT screening for lung cancer: update 2007. Oncologist 2008,13(1):65–78.View ArticlePubMedGoogle Scholar
- Sone S, Li F, Yang ZG, Honda T, Maruyama Y, Takashima S, Hasegawa M, Kawakami S, Kubo K, Haniuda M, et al.: Results of three-year mass screening programme for lung cancer using mobile low-dose spiral computed tomography scanner. Br J Cancer 2001,84(1):25–32.View ArticlePubMedPubMed CentralGoogle Scholar
- Artinian V, Kvale PA: Update in screening of lung cancer. Respirology 2005,10(5):558–566.View ArticlePubMedGoogle Scholar
- Marshall E: Medicine. A bruising battle over lung scans. Science 2008,320(5876):600–603.View ArticlePubMedGoogle Scholar
- Reich JM: A critical appraisal of overdiagnosis: estimates of its magnitude and implications for lung cancer screening. Thorax 2008,63(4):377–383.View ArticlePubMedGoogle Scholar
- Comtesse N, Zippel A, Walle S, Monz D, Backes C, Fischer U, Mayer J, Ludwig N, Hildebrandt A, Keller A, et al.: Complex humoral immune response against a benign tumor: frequent antibody response against specific antigens as diagnostic targets. Proc Natl Acad Sci USA 2005,102(27):9601–9606.View ArticlePubMedPubMed CentralGoogle Scholar
- Brichory F, Beer D, Le Naour F, Giordano T, Hanash S: Proteomics-based identification of protein gene product 9.5 as a tumor antigen that induces a humoral immune response in lung cancer. Cancer Res 2001,61(21):7908–7912.PubMedGoogle Scholar
- Brichory FM, Misek DE, Yim AM, Krause MC, Giordano TJ, Beer DG, Hanash SM: An immune response manifested by the common occurrence of annexins I and II autoantibodies and high circulating levels of IL-6 in lung cancer. Proc Natl Acad Sci USA 2001,98(17):9824–9829.View ArticlePubMedPubMed CentralGoogle Scholar
- He P, Naka T, Serada S, Fujimoto M, Tanaka T, Hashimoto S, Shima Y, Yamadori T, Suzuki H, Hirashima T, et al.: Proteomics-based identification of alpha-enolase as a tumor antigen in non-small lung cancer. Cancer Sci 2007,98(8):1234–1240.View ArticlePubMedGoogle Scholar
- Tureci O, Mack U, Luxemburger U, Heinen H, Krummenauer F, Sester M, Sester U, Sybrecht GW, Sahin U: Humoral immune responses of lung cancer patients against tumor antigen NY-ESO-1. Cancer Lett 2006,236(1):64–71.View ArticlePubMedGoogle Scholar
- Yamaguchi K, Patturajan M, Trink B, Usadel H, Koch W, Jen J, Sidransky D: Circulating antibodies to p40(AIS) in the sera of respiratory tract cancer patients. Int J Cancer 2000,89(6):524–528.View ArticlePubMedGoogle Scholar
- Yamamoto A, Shimizu E, Ogura T, Sone S: Detection of auto-antibodies against L-myc oncogene products in sera from lung cancer patients. Int J Cancer 1996,69(4):283–289.View ArticlePubMedGoogle Scholar
- Chapman CJ, Murray A, McElveen JE, Sahin U, Luxemburger U, Tureci O, Wiewrodt R, Barnes AC, Robertson JF: Autoantibodies in lung cancer: possibilities for early detection and subsequent cure. Thorax 2008,63(3):228–233.View ArticlePubMedGoogle Scholar
- Patz EF Jr, Campa MJ, Gottlin EB, Kusmartseva I, Guan XR, Herndon JE: Panel of serum biomarkers for the diagnosis of lung cancer. J Clin Oncol 2007,25(35):5578–5583.View ArticlePubMedGoogle Scholar
- Zhong L, Coe SP, Stromberg AJ, Khattar NH, Jett JR, Hirschowitz EA: Profiling tumor-associated antibodies for early detection of non-small cell lung cancer. J Thorac Oncol 2006,1(6):513–519.View ArticlePubMedGoogle Scholar
- Zhong L, Hidalgo GE, Stromberg AJ, Khattar NH, Jett JR, Hirschowitz EA: Using protein microarray as a diagnostic assay for non-small cell lung cancer. Am J Respir Crit Care Med 2005,172(10):1308–1314.View ArticlePubMedPubMed CentralGoogle Scholar
- Leidinger P, Keller A, Ludwig N, Rheinheimer S, Hamacher J, Huwer H, Stehle I, Lenhof HP, Meese E: Toward an early diagnosis of lung cancer: an autoantibody signature for squamous cell lung carcinoma. Int J Cancer 2008,123(7):1631–1636.View ArticlePubMedGoogle Scholar
- Bussow K, Cahill D, Nietfeld W, Bancroft D, Scherzinger E, Lehrach H, Walter G: A method for global protein expression and antibody screening on high-density filters of an arrayed cDNA library. Nucleic Acids Res 1998,26(21):5007–5008.View ArticlePubMedPubMed CentralGoogle Scholar
- Leidinger P, Keller A, Heisel S, Ludwig N, Rheinheimer S, Klein V, Andres C, Hamacher J, Huwer H, Stephan B, et al.: Novel autoantigens immunogenic in COPD patients. Respir Res 2009, 10:20.View ArticlePubMedPubMed CentralGoogle Scholar
- Soille P: Morphological Image Analysis. Second edition. Springer, Berlin; 2003.Google Scholar
- Vapnik V: The Nature of Statistical Learning Theory. Springer; 2000.
- Hirsch FR, Franklin WA, Gazdar AF, Bunn PA Jr: Early detection of lung cancer: clinical perspectives of recent advances in biology and radiology. Clin Cancer Res 2001,7(1):5–22.PubMedGoogle Scholar
- Cassidy A, Duffy SW, Myles JP, Liloglou T, Field JK: Lung cancer risk prediction: a tool for early detection. Int J Cancer 2007,120(1):1–6.View ArticlePubMedGoogle Scholar
- Humphrey LL, Teutsch S, Johnson M: Lung cancer screening with sputum cytologic examination, chest radiography, and computed tomography: an update for the U.S. Preventive Services Task Force. Ann Intern Med 2004,140(9):740–753.View ArticlePubMedGoogle Scholar
- Lobo ED, Hansen RJ, Balthasar JP: Antibody pharmacokinetics and pharmacodynamics. J Pharm Sci 2004,93(11):2645–2668.View ArticlePubMedGoogle Scholar
- Rauch TA, Zhong X, Wu X, Wang M, Kernstine KH, Wang Z, Riggs AD, Pfeifer GP: High-resolution mapping of DNA hypermethylation and hypomethylation in lung cancer. Proc Natl Acad Sci USA 2008,105(1):252–257.View ArticlePubMedGoogle Scholar
- Weir BA, Woo MS, Getz G, Perner S, Ding L, Beroukhim R, Lin WM, Province MA, Kraja A, Johnson LA, et al.: Characterizing the cancer genome in lung adenocarcinoma. Nature 2007,450(7171):893–898.View ArticlePubMedPubMed CentralGoogle Scholar
- Ogiwara H, Kohno T, Nakanishi H, Nagayama K, Sato M, Yokota J: Unbalanced translocation, a major chromosome alteration causing loss of heterozygosity in human lung cancer. Oncogene 2008,27(35):4788–4797.View ArticlePubMedGoogle Scholar
- Tan D, Deeb G, Wang J, Slocum HK, Winston J, Wiseman S, Beck A, Sait S, Anderson T, Nwogu C, et al.: HER-2/neu protein expression and gene alteration in stage I-IIIA non-small-cell lung cancer: a study of 140 cases using a combination of high throughput tissue microarray, immunohistochemistry, and fluorescent in situ hybridization. Diagn Mol Pathol 2003,12(4):201–211.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.