Background: Fine needle aspiration biopsy (FNAB) is the gold-standard procedure for diagnosing malignant thyroid nodules. Indeterminate cytology is identified in 10% to 40% of cases, and molecular testing may guide management in this setting. Current commercial options are expensive, and are either sensitive or specific. The aim of this study was to utilize next-generation sequencing (NGS) technology to identify informative diversities in the miRNA expression profile of benign versus malignant thyroid nodules.

Methods:Ex vivo FNAB samples were obtained from thyroid specimens of patients who underwent thyroidectomy at a referral center. miRNA levels were determined using NGS and multiplexing technologies. Statistical analyses identified differences between normal and malignant samples and miRNA expression profiles that associate with malignancy were established. The accuracy of the miRNA signature in predicting histologic malignancy was validated using a group of patient specimens with indeterminate cytology results.

Results: A total of 274 samples were obtained from 102 patients undergoing thyroidectomy. Of these samples, 71% were benign and 29% were malignant. Nineteen miRNAs were identified as statistically different between benign and malignant samples and were used to classify 35 additional nodules with indeterminate cytology (validation). The miRNA panel's sensitivity, specificity, negative and positive predictive values, and overall accuracy were 91%, 100%, 87%, 100%, and 94%, respectively.

Conclusions: Using NGS technology, we identified a panel of 19 miRNAs that may be utilized to distinguish benign from malignant thyroid nodules with indeterminate cytology.

Impact: Our panel may classify indeterminate thyroid nodules at higher accuracy than commercially available molecular tests. Cancer Epidemiol Biomarkers Prev; 27(8); 858–63. ©2018 AACR.

This article is featured in Highlights of This Issue, p. 843

Thyroid nodules are very common and may be identified in as many as 50% of the population when neck ultrasound is performed (1). Fortunately, most thyroid nodules are benign, and only about 7% harbor malignancy. Well-differentiated thyroid cancer comprises over 90% of thyroid malignancies and includes papillary thyroid cancer (PTC) and follicular thyroid cancer (FTC). These cancers are the most common endocrine malignancies, with more than 64,000 new cases diagnosed in the United States every year (2). Diagnostic neck ultrasound should be performed in all patients with suspicious thyroid nodules. Thyroid ultrasound evaluates nodule characteristics, and certain sonographic features may raise the suspicion of malignancy. Nevertheless, these features lack accuracy to reliably distinguish benign from malignant nodules, and current guidelines continue to rely on ultrasound-guided fine needle aspiration biopsy (FNAB) as the procedure of choice in the evaluation of thyroid nodules (3).

The unmet clinical need

Although FNAB yields a benign diagnosis in 60% to 70% of the cases and malignant diagnosis in about 5%, indeterminate results are reported in 10% to 40% of the cases. The Bethesda system for reporting thyroid cytopathology provides an estimated cancer risk within each indeterminate category (4). The risk for malignancy ranges between 5% and 15% for follicular lesions of unknown significance (Bethesda category III), 15% and 30% for follicular lesions (Bethesda category IV), and 60% and 75% for suspicious for malignancy (Bethesda category V). Patients with thyroid nodules and indeterminate FNAB result (Bethesda category III or IV) are offered management options that include observation, repeat biopsy, surgery, or molecular testing (3, 4). Available commercial molecular tests are expensive and are either sensitive or specific (5–7). Highly sensitive tests may be used to rule out malignancy and consequently avoid surgery, whereas highly specific tests are used to rule in malignancy and indicate the need for a surgical procedure. At present, there is no ultimate molecular test with both sensitivity and specificity above 90%.

miRNAs are endogenous short (21–23 nucleotides) noncoding RNAs that regulate cell function by silencing genes and hence also play a role in carcinogenesis. The miRNA expression profile changes during the course of the malignant transformation, and previous studies identified its diagnostic utility in differentiating between benign and malignant thyroid nodules (8). These studies were limited to a relatively small number of miRNAs that were investigated, and to date, no study evaluated the entire miRNome. Next-generation RNA sequencing (NGS) techniques enable to comprehensively and efficiently study the expression profile of miRNAs. The aims of this study were: (i) to identify differences in miRNA expression between biopsies taken from the same nodule; (ii) to utilize NGS technology to identify informative diversities in the miRNA expression profile of benign versus malignant thyroid nodules based on needle biopsies taken after surgery; and (iii) to validate the diagnostic role of miRNA in patients with indeterminate nodules.

Patients and biopsies

The study protocol was reviewed and approved by the Independent Ethics Committee, Hadassah-Hebrew University Medical Center (Jerusalem, Israel, Helsinki committee, protocol #HMO-0375). Adult patients who were referred to elective thyroid surgery between January and December 2015 were offered to participate in the study. The investigators obtained written informed consent from patients with a preoperative diagnosis of benign goiter, PTC, or indeterminate cytology. Once the thyroid gland was surgically removed, an ex vivo FNAB was performed as described previously (9). In brief, in patients with thyroid cancer, the nodule was palpated and 2 to 3 passes were performed using a 19-guage needle. In patients with benign thyroid disease, the biopsy was performed from normal appearing thyroid tissue. All preoperative diagnoses were confirmed by standard histopathology. The “validation group” consisted of patients with preoperative indeterminate cytology report (Bethesda III or IV). In these patients, the ultrasound report was carefully reviewed to confirm the exact location of the thyroid nodule that was biopsied before surgery. Ex vivo biopsies were performed from the very same nodule as described above. Samples were coded without identification of the group classification (benign, malignant, validation). Data were collected on each patient including age, gender, indications for surgery, detailed preoperative ultrasound report, preoperative cytology diagnosis, and detailed final histopathology diagnosis. All data were recorded on a Case Report Form designed for this study.

RNA extraction and small RNA cDNA library preparation and sequencing

All cell samples were collected from the aspiration biopsy needle by air injection and irrigation into a collecting tube containing 1 mL of RNAlater (ThermoFisher Scientific). Tubes were stored at 4°C until further processing. Total RNA was extracted with TRIzol, following Polytron homogenization using disposable tips. Concentration was measured with Qubit 2.0 Fluorometer and RNA BR assay reagents (Thermo Fisher Scientific), and RNA was stored at −80°C.

Total RNA was subjected to in-house multiplexed small RNA cDNA library preparation, which entailed ligation of barcoded 3′ adapters to 24 different samples, pooling of samples, ligation of a 5′ adapter, reverse transcription, and PCR, as described previously (10), with modifications allowing multiplexing of several 24-sample libraries on a single HiSeq lane, namely, 48 to 120 small RNA samples per lane (11), using TruSeq-like PCR primers. Libraries were sequenced on an Illumina HiSeq 2500 sequencer, and the information obtained was analyzed by an automated computer pipeline to decode and annotate small RNA reads (12).

Statistical analysis

Statistical procedures on count data were based on the “DESeq2” R/Bioconductor package for analysis of differential expression in RNA sequencing experiments (13), as described previously (14), and complemented by calculations with “edgeR” (15) and “samr” (16). Differential expression analyses were performed upon a matrix of read counts with samples as columns and miRNA as rows, after filtering out low-coverage miRNA (retaining miRNA with at least 3 reads in at least 1/3 of study samples). To overcome the difficulty of multiple testing, the DESeq2 package uses an adjusted P value for which we determined that less than 0.05 would be regarded as significant. The samr package utilizes a Q-value to address multiple testing, which we also determined to be significant if <0.05. Prior to any analysis based on miRNA read counts, we applied the “sva” package (17) to remove batch biases from the data. In addition, prior to analyses other than differential expression, miRNA read counts were transformed using DESeq2′s variance stabilizing transformation, to generate normally distributed data. To describe the extent of technical variability (namely differences between miRNA profiles generated from repeated aspiration biopsies from the same nodule or normal tissue), we calculated correlation distances between samples based on miRNA abundance profiles, and compared the distribution of distances derived from all possible pairwise tests to the distribution of distances from technical repeat pairwise tests, using empirical cumulative distribution function plots and a Mann–Whitney U test. When testing for differential expression, we first aggregated miRNA counts from all technical repetitions of each specimen (separately for tumor and adjacent normal tissue), such that each biological sample was represented once, by the sum of counts of its technical repetitions. In the differential expression models, patient was included as a blocking factor, being that often malignant and benign tissues were obtained from the same specimen. The ability of differentially expressed miRNA to discriminate malignant from benign/normal tissue was evaluated in the discovery set of samples by calculating the c-statistic, equivalent to the area under the ROC curve. To maximize the discrimination ability of miRNA, we devised a score for each sample (“miRNA score”), assembled by summing the standardized levels (z-values) of all significantly upregulated miRNA, and the negative of the z-values of all significantly downregulated miRNA. In the validation set of samples, z-values were calculated by relating to the normal mean and SD values from the discovery set. ROC curve was used to test the discriminatory characteristics of the miRNA score in the validation set. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were calculated at an optimal cutoff point. Plots were generated with “ggplot2.”

Availability of data

miRNA deep sequencing count data for all study samples, along with partial metadata, are available as a spreadsheet file online. Demultiplexed sequencing read files were deposited at NCBI's Gene Expression Omnibus (GEO record GSE116196).

During the study period, 340 biopsies were performed in 137 patients (Table 1). Age (mean ± SD) was 45.7 ± 16.4 years with a 3.9:1 female-to-male ratio. Of the entire sample set, 195 (57.4%) were classified as benign, 79 (23.2%) malignant, and 66 (19.4%) served as the validation group (Fig. 1). miRNAs were profiled using deep sequencing of multiplexed (120 samples/Illumina HiSeq 2500 lane) small RNA cDNA libraries prepared from each sample following total RNA extraction (Supplementary Figs. S1–S3; Supplementary Tables S1–S3). Correlation-based distance measurement between the technical repetitions demonstrated differences in miRNA expression that were smaller in magnitude compared with biological repetitions (Supplementary Fig. S4), thus supporting the soundness of our approach.

Biomarker discovery

A total of 279 miRNAs were detected (with sequencing depths of at least 3 reads in at least 1/3 of study samples). Although the majority of miRNAs did not show a significantly different expression between normal (or benign) and malignant samples, several miRNAs were either over- or underexpressed in malignant samples as compared with normal (Fig. 2A). Nineteen miRNAs, with the highest dysregulation significance, were selected to be included in a diagnostic panel (Table 2). A score derived from the panel of diagnostic miRNAs was most accurate in distinguishing benign from malignant samples (Fig. 2B). Further analyses of the discovery set of samples are provided in Supplementary Figs. S5–S7 and Supplementary Tables S4 and S5. Many of these miRNAs have been previously reported to be dysregulated in thyroid cancer (Supplementary Tables S6 and S7).

Biomarker validation

Of the 35 specimens that were included in the validation group (after merging technical replicates), 22 were identified on final histopathology as malignant and 13 as benign (Supplementary Fig. S8). Of the 22 malignant specimens, 15 (68%) were identified as PTC and 7 (32%) were identified as FTC. Panel miRNA-based diagnostic scores according to histopathology are presented in Fig. 3A. ROC curve analysis showed an AUC of 0.95 and identified a score of 9.27 as the optimal cutoff between benign and malignant samples (Fig. 3B and C). Of the validation cohort, only 2 malignant samples had a score that was lower than 9.27, yielding values for sensitivity, specificity, NPV, PPV, and overall accuracy of 91%, 100%, 87%, 100%, and 94%, respectively (also see Supplementary Figs. S9 and S10).

This study demonstrates that 19 miRNAs can serve as a highly accurate diagnostic tool and differentiate between benign and malignant thyroid nodules. Although several of the miRNAs identified in this study have been described previously (Supplementary Table S6), the strength of this study is the utilization of NGS technique that enabled the evaluation of the complete miRNome. Some of these miRNAs are not specific to thyroid cancer. miR-221/222 and miR-146b are overexpressed in colon, breast, ovarian, hepatic, prostate, and several other malignancies. The mechanisms of these miRNAs in thyroid carcinogenesis are not entirely understood; however, attempts to characterize miRNA–gene regulatory networks in thyroid cancer have been made (18). Specific thyroid target genes include BRAF, RAS, PAX8, P51, PTEN, mTOR, and PPAR among others, and several studies aim to identify the therapeutic role of these miRNA–gene interactions. Other investigators use miRNA expression profile as a prognostic tool to identify tumor aggressiveness as well as a marker for tumor recurrence when isolated in serum samples (19, 20).

Nevertheless, the focus of this translational study is on the diagnostic role of miRNA expression in thyroid nodules. At present, patients with indeterminate thyroid FNAB results are offered to either undergo diagnostic thyroidectomy (total or lobectomy) or molecular testing. Current commercial molecular tests include Afirma, ThyroSeqV2, and Rosetta (5–7). The former two include mRNAs and gene testing, whereas the latter is a 24 miRNA-based assay. The two major disadvantages of the commercial tests are their accuracy and costs. All commercial tests highlight their very high NPV, whereas their PPV is much lower. Thus, these tests are extremely useful as “rule out” tests while their ability to correctly identify cancer is between 50% and 70%. The other limitation of these tests is their cost, ranging between 2,000 and 3,000 USD, a price that many patients cannot afford. Our study implies that these two obstacles can be overcome. Notwithstanding the need for external validation, our overall accuracy is the highest reported to date with a NPV and PPV of 87% and 100%, respectively (Table 3).

Our study has several limitations. Samples were obtained ex vivo, and although we have previously demonstrated that similar results can be obtained from real FNAB samples, a future clinical trial needs to validate the results in patient management. All thyroid malignancies evaluated in the discovery set were PTCs. FTC has a somewhat similar miRNA profile; however, medullary thyroid cancer is a distinctly different malignancy and is not the focus of this study. Several specimens included in the discovery set were taken from patients with benign thyroid pathology—for example, Hashimoto thyroiditis or Graves disease—however, statistical adjustment did not alter the results. Finally, it has been shown that the prevalence of malignancy in indeterminate thyroid FNABs affects the accuracy of molecular testing. Our results need to be validated in other countries as well.

Conclusions

Using NGS technology, we identified a panel of 19 miRNAs that may be utilized to distinguish benign from malignant thyroid nodules with indeterminate cytology at higher accuracy than commercially available molecular tests and lower expected costs. A future multi-center clinical trial is needed to establish its utility in patients with indeterminate FNAB results.

No potential conflicts of interest were disclosed.

Conception and design: H. Mazeh, A. Karas, I. Mizrahi, I.Z. Ben-Dov

Development of methodology: H. Mazeh, T. Deutch, A. Karas, I. Mizrahi, D. Gur-Wahnon

Acquisition of data (provided animals, acquired and managed patients, provided facilities, etc.): A. Karas, K.A. Bogardus, I. Mizrahi

Analysis and interpretation of data (e.g., statistical analysis, biostatistics, computational analysis): H. Mazeh, T. Deutch, A. Karas, I. Mizrahi, I.Z. Ben-Dov

Writing, review, and/or revision of the manuscript: H. Mazeh, T. Deutch, A. Karas, I. Mizrahi, I.Z. Ben-Dov

Administrative, technical, or material support (i.e., reporting or organizing data, constructing databases): T. Deutch, A. Karas, I. Mizrahi

Study supervision: H. Mazeh, T. Deutch, D. Gur-Wahnon, I.Z. Ben-Dov

This study was supported by the Israel Cancer Association (grant no. 20141057). I.Z. Ben-Dov is supported by the I-CORE Program of the Planning and Budgeting Committee and the Israel Science Foundation (grant no. 41/11).

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

1.
Brito
JP
,
Gionfriddo
MR
,
Al Nofal
A
,
Boehmer
KR
,
Leppin
AL
,
Reading
C
, et al
The accuracy of thyroid nodule ultrasound to predict thyroid cancer: systematic review and meta-analysis
.
J Clin Endocrinol Metab
2014
;
99
:
1253
63
.
2.
Siegel
RL
,
Miller
KD
,
Jemal
A
. 
Cancer statistics, 2016
.
CA Cancer J Clin
2016
;
66
:
7
30
.
3.
Haugen
BR
,
Alexander
EK
,
Bible
KC
,
Doherty
GM
,
Mandel
SJ
,
Nikiforov
YE
, et al
2015 American thyroid association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer
.
Thyroid
2016
;
26
:
1
133
.
4.
Cibas
ES
,
Ali
SZ
. 
The 2017 Bethesda system for reporting thyroid cytopathology
.
Thyroid
2017
;
27
:
1341
6
.
5.
Alexander
EK
,
Kennedy
GC
,
Baloch
ZW
,
Cibas
ES
,
Chudova
D
,
Diggans
J
, et al
Preoperative diagnosis of benign thyroid nodules with indeterminate cytology
.
N Engl J Med
2012
;
367
:
705
15
.
6.
Lithwick-Yanai
G
,
Dromi
N
,
Shtabsky
A
,
Morgenstern
S
,
Strenov
Y
,
Feinmesser
M
, et al
Multicentre validation of a microRNA-based assay for diagnosing indeterminate thyroid nodules utilising fine needle aspirate smears
.
J Clin Pathol
2017
;
70
:
500
7
.
7.
Nikiforov
YE
,
Carty
SE
,
Chiosea
SI
,
Coyne
C
,
Duvvuri
U
,
Ferris
RL
, et al
Highly accurate diagnosis of cancer in thyroid nodules with follicular neoplasm/suspicious for a follicular neoplasm cytology by ThyroSeq v2 next-generation sequencing assay
.
Cancer
2014
;
120
:
3627
34
.
8.
Mazeh
H
. 
MicroRNA as a diagnostic tool in fine-needle aspiration biopsy of thyroid nodules
.
Oncologist
2012
;
17
:
1032
8
.
9.
Mazeh
H
,
Mizrahi
I
,
Halle
D
,
Ilyayev
N
,
Stojadinovic
A
,
Trink
B
, et al
Development of a microRNA-based molecular assay for the detection of papillary thyroid carcinoma in aspiration biopsy samples
.
Thyroid
2011
;
21
:
111
8
.
10.
Williams
Z
,
Ben-Dov
IZ
,
Elias
R
,
Mihailovic
A
,
Brown
M
,
Rosenwaks
Z
, et al
Comprehensive profiling of circulating microRNA via small RNA sequencing of cDNA libraries reveals biomarker potential and limitations
.
Proc Natl Acad Sci USA
2013
;
110
:
4255
60
.
11.
Vaknin-Dembinsky
A
,
Charbit
H
,
Brill
L
,
Abramsky
O
,
Gur-Wahnon
D
,
Ben-Dov
IZ
, et al
Circulating microRNAs as biomarkers for rituximab therapy, in neuromyelitis optica (NMO)
.
J Neuroinflammation
2016
;
13
:
179
.
12.
Farazi
TA
,
Brown
M
,
Morozov
P
,
Ten Hoeve
JJ
,
Ben-Dov
IZ
,
Hovestadt
V
, et al
Bioinformatic analysis of barcoded cDNA libraries for small RNA profiling by next-generation sequencing
.
Methods
2012
;
58
:
171
87
.
13.
Love
MI
,
Huber
W
,
Anders
S
. 
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
.
Genome Biol
2014
;
15
:
550
.
14.
Ben-Dov
IZ
,
Whalen
VM
,
Goilav
B
,
Max
KE
,
Tuschl
T
. 
Cell and microvesicle urine microRNA deep sequencing profiles from healthy individuals: observations with potential impact on biomarker studies
.
PLoS One
2016
;
11
:
e0147249
.
15.
McCarthy
DJ
,
Chen
Y
,
Smyth
GK
. 
Differential expression analysis of multifactor RNA-Seq experiments with respect to biological variation
.
Nucleic Acids Res
2012
;
40
:
4288
97
.
16.
Li
J
,
Tibshirani
R
. 
Finding consistent patterns: a nonparametric approach for identifying differential expression in RNA-Seq data
.
Stat Methods Med Res
2013
;
22
:
519
36
.
17.
Johnson
WE
,
Li
C
,
Rabinovic
A
. 
Adjusting batch effects in microarray expression data using empirical Bayes methods
.
Biostatistics
2007
;
8
:
118
27
.
18.
Riesco-Eizaguirre
G
,
Wert-Lamas
L
,
Perales-Paton
J
,
Sastre-Perona
A
,
Fernandez
LP
,
Santisteban
P
. 
The miR-146b-3p/PAX8/NIS regulatory circuit modulates the differentiation phenotype and function of thyroid cells during carcinogenesis
.
Cancer Res
2015
;
75
:
4119
30
.
19.
Mahmoudian-Sani
MR
,
Mehri-Ghahfarrokhi
A
,
Asadi-Samani
M
,
Mobini
GR
. 
Serum miRNAs as biomarkers for the diagnosis and prognosis of thyroid cancer: a comprehensive review of the literature
.
Eur Thyroid J
2017
;
6
:
171
7
.
20.
Pishkari
S
,
Paryan
M
,
Hashemi
M
,
Baldini
E
,
Mohammadi-Yeganeh
S
. 
The role of microRNAs in different types of thyroid carcinoma: a comprehensive analysis to find new miRNA supplementary therapies
.
J Endocrinol Invest
2018
;
41
:
269
83
.