Background:

Human papillomavirus (HPV) vaccine effectiveness (VE) evaluations provide important information for vaccination programs. We established a linkage between statewide central registries in Michigan to estimate HPV VE against in situ and invasive cervical lesions (CIN3+).

Methods:

We linked females in Michigan's immunization and cancer registries using birth records to establish a cohort of 773,193 women with known vaccination history, of whom 3,838 were diagnosed with CIN3+. Residential address histories from a stratified random sample were used to establish a subcohort of 1,374 women without CIN3+ and 2,900 with CIN3+ among continuous Michigan residents. VE and 95% confidence intervals (CI) were estimated using cohort and case–cohort methods for up-to-date (UTD) vaccination and incomplete vaccination with 1 and 2 doses, and stratified by age at vaccination.

Results:

Both analytic approaches demonstrated lower CIN3+ risk with UTD and non-UTD vaccination vs. no vaccination. The cohort analysis yielded VE estimates of 66% (95% CI, 60%–71%) for UTD, 33% (95% CI, 18%–46%) for 2 doses-not UTD, and 40% (95% CI, 27%–50%) for 1 dose. The case–cohort analysis yielded VE estimates of 72% (95% CI, 64%–79%) for UTD, 39% (95% CI, 10%–58%) for 2 doses-not UTD, and 48% (95% CI, 25%–63%) for 1 dose. VE was higher for vaccination at age <20 than ≥20 years.

Conclusions:

The statewide registry linkage found significant VE against CIN3+ with incomplete HPV vaccination, and an even higher VE with UTD vaccination.

Impact:

Future VE evaluations by number of doses for women vaccinated at younger ages may further clarify dose-related effectiveness.

More than 200 human papillomavirus (HPV) types have been identified; approximately 40 are sexually transmitted, and 12 (HPV16/18/31/33/35/39/45/51/52/56/58/59) have been classified as human carcinogens (1, 2). Together, HPV16 and 18 cause 70% of HPV-attributable cancers worldwide (3). Compared with other types, HPV16 is more likely to persist and progress to cervical precancer and invasive cervical cancer and does so more quickly (4).

The advent of HPV vaccination has created the opportunity to reduce the incidence of HPV types that cause cervical neoplasia. HPV vaccines were licensed based on clinical trials, which demonstrated high efficacy for prevention of vaccine-type (i.e., associated with HPV16 or 18) cervical precancer among women who did not have evidence of infection at the time of vaccination (5). These vaccines, originally evaluated, licensed, and recommended as a 3-dose schedule (0, 1–2, and 6 months), have been introduced into national vaccination programs in nearly 100 countries (6). In the United States, routine vaccination of girls ages 11 to 12 years, with catch-up vaccination through age 26, was first recommended in 2006 (7). Three vaccines have been licensed; all target HPV16/18. Recommendations have changed over time as new vaccines were licensed and indications approved (7). Noninferiority immunogenicity studies provided data accepted for licensure of 2-dose schedules in persons who start the series before age 15 years (8–11). More recently, there has been interest in single-dose vaccination (12).

Studies conducted to evaluate vaccine effectiveness (VE) in real-world programs have generally shown lower effectiveness with <3 doses than with 3 doses, although methodologic challenges have been noted (13). Previously, a pilot study investigated the feasibility of linking Michigan's statewide cancer and immunization registries, with a goal of creating a framework for monitoring vaccine impact and effectiveness (14). The inclusion of adults in the immunization registry and of in situ lesions in the cancer registry, continuously since the HPV vaccination program began in the United States, presents a unique opportunity for a record linkage VE study. Here, we use the registry linkage to evaluate HPV VE against in situ and invasive cervical cancers, including by number of vaccine doses and by age at vaccination. Additionally, we compare results of a case–cohort study design, which included verification of continuous residency to ensure complete vaccination history and cervical cancer status, to a less labor-intensive record linkage cohort study without continuous residency determination.

Data sources and linkages

We established a cohort of women born in Michigan, 1980–1995, by linking records from multiple statewide data systems using methods piloted in 2009 (14); this study was approved by the Michigan Department of Health and Human Services (MDHHS) Institutional Review Board.

Females born in Michigan were identified from the Michigan Live Birth Registry (hereafter, “birth records”). The Michigan Care Improvement Registry is Michigan's immunization information system; in 2006, this transitioned from a childhood immunization registry to a lifespan registry including children and adults. The Michigan Cancer Surveillance Program is the state's cancer registry. In addition to invasive cervical cancers, diagnoses of certain cervical precancers have been reported continuously since prior to the 2006 licensure of HPV vaccines, in contrast to most U.S. state cancer registries. For this study, invasive cervical cancers and in situ cervical lesions including histologically confirmed cervical intraepithelial neoplasia grade 3 (CIN3), and adenocarcinoma in situ (AIS) comprised cases of CIN3 or worse (CIN3+). Terminology used by pathologists has evolved during the study period, including adoption of the two-tier Lower Anogenital Squamous Terminology in 2012 (15); efforts were made to report similar cases to cancer registries over time. CIN3+ includes high-grade squamous intraepithelial lesions and lesions diagnosed as CIN2 or CIN2–3 with positive p16.

Females in the immunization registry and women with CIN3+ in the cancer registry were each linked to birth records, establishing a linkage between CIN3+ and HPV vaccination history. The immunization registry and birth records were linked using probabilistic and deterministic methods that considered patient names, birth dates, parent names, and cities of residence, as previously described (14). Methods used for linkage varied over the study period, and percentage linked between the birth and immunization registries increased from 47% for the 1980 birth cohort to 83% for the 2004 birth cohort (Supplementary Fig. S1). Next, to link cancer registry CIN3+ cases to birth records, probabilistic methods using name and date of birth were used. Subsequently, CIN3+ cases were limited to those diagnosed 2009–2016 to include only women who could have been vaccinated ≥24 months before CIN3+ diagnosis. The cohort data set includes birth year and race (as described below), HPV vaccination doses and dates from the immunization registry, and CIN3+ diagnoses and dates from the cancer registry.

Continuous residency determination and creation of subcohort

From the full cohort of Michigan-born women in the immunization registry, we selected a subcohort of women who had resided in Michigan continuously to limit bias that would result if vaccinations or CIN3+ diagnoses occurred while residing elsewhere. Determining residential history for the entire cohort was cost-prohibitive, so a stratified random sampling strategy was initially planned to estimate vaccination history by birth year group (1980–1984, 1985–1989, 1990–1995), with a 5% margin of error for each proportion. It was important to consider different time periods because vaccine eligibility varied by birth year (i.e., by age in 2006 when HPV vaccine was initially recommended) and to reflect the erosion of continuous residency over time. The sampling fractions per thousand women were 4.1, 2.6, and 2.2 for 1980–1984, 1985–1989, and 1990–1991, respectively. Lexis Nexis Accurint was used to obtain address history information, as described in the feasibility study (14), of the sampled subcohort and all linked CIN3+ cases. Information on name at birth, name as recorded in the immunization registry (if available), and name at CIN3+ diagnosis was obtained to determine address history for the woman, her mother, and the father as listed on the linked birth certificate. If an address within any such history included a non-Michigan address, the woman's residence was classified as noncontinuous.

Analysis variables

All HPV vaccine doses [quadrivalent (CVX code 62); bivalent (CVX code 118); nonavalent (CVX code 165); and HPV, unspecified (CVX code 137)] administered and reported to the immunization registry by May 26, 2017, were considered for inclusion. These doses were assessed for validity following Advisory Committee on Immunization Practices guidance (10, 16, 17). Invalid doses and vaccines doses administered <24 months before (i) a cervical lesion diagnosis or (ii) December 31, 2016, if not diagnosed, were excluded. A status of unvaccinated had zero valid doses reported, up-to-date (UTD) had either 3 valid doses or 2 valid doses where dose 1 was administered before the 15th birthday and dose 2 was administered ≥5 months—4 days after dose 1, not UTD had either 1 valid dose or 2 valid doses that did not meet UTD criteria.

Data on race were obtained from birth records and were classified as white, black, and other. Race was derived from the bridged single race of the reported race(s) for the named parents using bridging methodology from National Center for Health Statistics (18). Hispanic ethnicity in the birth record is classified separately, and the Hispanic population in Michigan was deemed too low for a statistically informative analysis.

Statistical analysis

The distributions of birth year group, vaccination status in 2016, and race were analyzed for the full cohort, all noncases and CIN3+ cases; and for continuous residents, the subcohort noncases, and CIN3+ cases. The distributions of birth year group and race were analyzed by vaccination status for the samples used in the cohort and case–cohort analyses. Chi-square tests were used to evaluate statistical differences in proportions.

We performed a VE analysis using the full cohort with all CIN3+, regardless of continuous residency determination. The relative risk of CIN3+ by vaccination status was calculated using log-binomial regression adjusted for race and continuous birth year. VE, calculated as (1 − aRR) × 100, was estimated for ≥1 dose of HPV vaccine and by number of doses (1-dose, 2-dose, not UTD; and UTD). VE was also estimated for ≥1 dose stratified by birth year group and by age at vaccination (<20, ≥20 years).

We compared the cohort analysis with a case–cohort design, using the continuously resident subcohort and continuously resident CIN3+ cases (19). Subcohort members were weighted using the inverse of the stratum-specific sampling fractions, and subcohort cases were analyzed as cases, which had a weight of 1. Because subcohort sampling fractions were low and only 9 (0.65%) subcohort members developed CIN3+, survival analysis methods using time-varying weights were considered unnecessary (20). Using cases versus subcohort noncases as the dependent variable, we used logistic regression to estimate the odds ratio (OR) by vaccination status, and to estimate adjusted OR (aOR) adjusted for race and continuous birth year. Variances were calculated using methods appropriate for weighted analyses. The resulting aOR approximates the adjusted risk ratio (aRR), defined as the ratio of the cumulative incidence in the exposed by the cumulative incidence in the unexposed. VE was estimated as (1 − aOR) × 100. The exposures and covariates evaluated in the cohort analysis were repeated.

All analyses were performed using SAS 9.4.

Cohort, subcohort, and CIN3+ cases

Among 1,926,433 women with immunization registry records born during 1980–2004, 1,312,116 (68%) were linked to birth records (Fig. 1). After excluding 538,923 women whose birth year was not in 1980–1995, a cohort of 773,193 women remained. For the subcohort, 2,110 records were selected from the cohort. Of these, 1,383 (66%) were continuous residents and formed the study subcohort.

Figure 1.

Flow diagram illustrating linkages among Michigan registries to create cohort and subcohort samples for VE analyses. aStratified random sample included 12 CIN3+ cases. Of these, 3 were not confirmed as continuous Michigan residents. The remaining 9 were continuous Michigan residents and were a part of the subcohort sample; these were included in the CIN3+ group for analyses. See text for details. Note: CIN3+ includes cervical precancers equivalent to cervical intraepithelial neoplasia grade 3 and AIS, as well as invasive cervical carcinomas. The following morphologic codes were included: 8010, 8070, 8077, 8140, 8000, 8041, 8071, 8072, 8076, 8384, and 8560.

Figure 1.

Flow diagram illustrating linkages among Michigan registries to create cohort and subcohort samples for VE analyses. aStratified random sample included 12 CIN3+ cases. Of these, 3 were not confirmed as continuous Michigan residents. The remaining 9 were continuous Michigan residents and were a part of the subcohort sample; these were included in the CIN3+ group for analyses. See text for details. Note: CIN3+ includes cervical precancers equivalent to cervical intraepithelial neoplasia grade 3 and AIS, as well as invasive cervical carcinomas. The following morphologic codes were included: 8010, 8070, 8077, 8140, 8000, 8041, 8071, 8072, 8076, 8384, and 8560.

Close modal

Of the 14,428 CIN3+ cases diagnosed during 1995–2016 and reported to the cancer registry among women born in 1980–1995, 11,036 (76%) were linked to a birth record; of these, 7,010 (64%) were also linked with the immunization registry (Fig. 1). After excluding 3,172 CIN3+ cases diagnosed before 2009, 3,838 CIN3+ cases diagnosed during 2009–2016 among cohort women remained. By histologic type, these included 3,549 (92.5%) squamous cell neoplasias, 133 (3.5%) adenocarcinomas (invasive or in situ), 132 (3.4%) carcinomas (invasive or in situ) not otherwise specified, and 24 (0.6%) other specified carcinomas. Overall, 3,750 (97.7%) were precancers and 88 (2.3%) were invasive cancers.

Of the 3,838 CIN3+ cases arising from the cohort, 2,900 (76%) occurred among continuous Michigan residents; these included cases among 9 women who were sampled into the subcohort. The subcohort included 1,383 continuous Michigan residents (1,374 noncases and 9 cases). Therefore, the case–cohort analysis included 2,900 cases and 1,374 noncases.

Descriptive analysis

Characteristics of the cohort and case–cohort analytic populations are shown in Table 1. The cohort was not evenly distributed among birth years; about 1 in 5 cohort women were born in 1980–1984, whereas nearly half were born in 1990–1995. By race, most women (78.7%) were white, 19.6% were black, and 1.7% were other race. The majority (72.4%) of the cohort was unvaccinated, and 17.6% were UTD on vaccination; of these, most (97%) had 3 doses and 3% had 2 doses initiated prior to 15th birthday with appropriate spacing. A total of 10% of the cohort had initiated vaccination but were not UTD, including 4.4% with 2 doses and 5.6% with 1 dose (Table 1). Among 213,404 women who initiated vaccination, most (80.2%) did so before age 20 years. However, no women born 1980–1984 initiated vaccination before age 20, whereas 38.8% of vaccinated women born 1985–1989 and 94.2% of those born 1990–1995 did. The median ages at vaccination also differed by birth year group: 25 years [range, 22–27, interquartile range (IQR) 24–26] for women born 1980–1984, 20 (range, 17–28; IQR 19–23) for women born 1985–1989, and 16 (range, 11–25; IQR 14–17) for women born 1990–1995. By number of doses, the median age at vaccination for UTD was 16 (range, 11–27; IQR 14–18), for 2 doses-not UTD was 18 (range, 11–28; IQR 16–20), and for 1 dose was 18 (range, 11–27; IQR 17–21). By cohort, the median age at vaccination initiation was lower for UTD than 1-dose or 2-dose not UTD groups for the 1990–1995 cohort [15 (range, 11–24; IQR 14–17) vs. 17 (range, 11–25; IQR 16–18) years] and the 1985–1989 cohort [20 (range, 19–23; IQR 17–27) vs. 21 (range, 17–28; IQR 19–23) years].

Table 1.

Characteristics of study populations overall and by case status for the full cohort and case–cohort analysis of continuous residents, Michigan, 2009–2016.

Full cohortCohort analysisCase–cohort analysis (continuous residents)
TotalNoncasesCasesNoncasesCases
CharacteristicsN (%)n (%)n (%)Pan (%)n (%)Pa
Total 773,193 769,355 3,838  1,374 2,900  
Birth year group 
 Born 1980–1984 159,586 (20.6) 158,340 (20.6) 1,246 (32.5) <0.01 394 (28.7) 983 (33.9) <0.01 
 Born 1985–1989 248,424 (32.1) 246,473 (32.0) 1,951 (50.8)  418 (30.4) 1,465 (50.5)  
 Born 1990–1995 365,183 (47.2) 364,542 (47.4) 641 (16.7)  562 (40.9) 452 (15.6)  
Race 
 Black 151,290 (19.6) 150,645 (19.6) 645 (16.8) <0.01 257 (18.7) 482 (16.6) 0.15 
 White 608,324 (78.7) 605,288 (78.7) 3,136 (81.7)  1,102 (80.2) 2,379 (82.0)  
 Other 13,479 (1.7) 13,422 (1.7) 57 (1.5)  15 (1.1) 39 (1.3)  
HPV vaccination status in 2016 
 Up-to-date (UTD) 135,758 (17.6) 135,598 (17.6) 160 (4.2) <0.01 252 (18.3) 115 (4.0) <0.01 
 2 doses, not UTD 34,401 (4.4) 34,303 (4.5) 98 (2.6)  58 (4.2) 73 (2.5)  
 1 dose 43,245 (5.6) 43,133 (5.6) 112 (2.9)  69 (5.0) 81 (2.8)  
 Unvaccinated 559,789 (72.4) 556,321 (72.3) 3,468 (90.4)  995 (72.4) 2,631 (90.7)  
Age at initial vaccination (≥1 dose) 
 <20 years old 171,156 (80.2) 170,950 (80.2) 206 (55.7) <0.01 300 (79.2) 144 (52.5) <0.01 
 20+ years old 42,248 (19.8) 42,084 (19.8) 164 (44.3)  79 (20.8) 125 (46.5)  
Full cohortCohort analysisCase–cohort analysis (continuous residents)
TotalNoncasesCasesNoncasesCases
CharacteristicsN (%)n (%)n (%)Pan (%)n (%)Pa
Total 773,193 769,355 3,838  1,374 2,900  
Birth year group 
 Born 1980–1984 159,586 (20.6) 158,340 (20.6) 1,246 (32.5) <0.01 394 (28.7) 983 (33.9) <0.01 
 Born 1985–1989 248,424 (32.1) 246,473 (32.0) 1,951 (50.8)  418 (30.4) 1,465 (50.5)  
 Born 1990–1995 365,183 (47.2) 364,542 (47.4) 641 (16.7)  562 (40.9) 452 (15.6)  
Race 
 Black 151,290 (19.6) 150,645 (19.6) 645 (16.8) <0.01 257 (18.7) 482 (16.6) 0.15 
 White 608,324 (78.7) 605,288 (78.7) 3,136 (81.7)  1,102 (80.2) 2,379 (82.0)  
 Other 13,479 (1.7) 13,422 (1.7) 57 (1.5)  15 (1.1) 39 (1.3)  
HPV vaccination status in 2016 
 Up-to-date (UTD) 135,758 (17.6) 135,598 (17.6) 160 (4.2) <0.01 252 (18.3) 115 (4.0) <0.01 
 2 doses, not UTD 34,401 (4.4) 34,303 (4.5) 98 (2.6)  58 (4.2) 73 (2.5)  
 1 dose 43,245 (5.6) 43,133 (5.6) 112 (2.9)  69 (5.0) 81 (2.8)  
 Unvaccinated 559,789 (72.4) 556,321 (72.3) 3,468 (90.4)  995 (72.4) 2,631 (90.7)  
Age at initial vaccination (≥1 dose) 
 <20 years old 171,156 (80.2) 170,950 (80.2) 206 (55.7) <0.01 300 (79.2) 144 (52.5) <0.01 
 20+ years old 42,248 (19.8) 42,084 (19.8) 164 (44.3)  79 (20.8) 125 (46.5)  

Notes: Cohort includes women born in Michigan during 1980–1995 whose birth record was linked with the immunization registry. Case–cohort analysis includes all CIN3+ arising from the cohort and a stratified random sample of women in the cohort, i.e., the subcohort; the case–cohort analysis was further limited to women who resided in Michigan continuously. See text for details.

aP values from chi-square tests between noncases and cases.

For the cohort, most characteristics evaluated differed between cases and noncases (Table 1). Cases were more likely than noncases to be born in earlier years. The median age at CIN3+ diagnosis differed by birth year group: 29 (range, 24–35, IQR 27–31) years for women born 1980–1984, 24 (range, 19–31; IQR 23–26) years for 1985–1989, and 22 (range, 15–26; IQR 20–23) years for 1990–1995. Cases and noncases also varied by race. A higher proportion of cases than noncases was unvaccinated, and among vaccinated, a higher proportion of cases than noncases initiated vaccination at age ≥20 years. For the case–cohort population, similar associations between characteristics and case status were evident, although the association with race was not statistically significant. The distributions of characteristics were similar between all cases and continuously resident cases, as well as between cohort noncases and subcohort noncases (P > 0.1 for all comparisons).

Vaccination status varied by birth year group and race (Table 2). Among cohort women, only 2.1% of those born in 1980–1984 were UTD, 2.2% initiated vaccination but were not UTD, and 95.8% were unvaccinated; 30.4% of women born 1990–1995 were UTD, 14.6% initiated but were not UTD, and 55% were unvaccinated. By race, women who were white or other races had higher proportions with UTD vaccination, but black women had higher proportions who initiated vaccination but were not UTD. Associations were similar for the case–cohort sample.

Table 2.

HPV vaccination status by birth year group and by race, among cohort sample and case–cohort sample, Michigan, 2009–2016.

Cohort (N = 773,193)Case–cohort, continuous residents (N = 4,274)
UTDa2 Doses not UTD1 Dose not UTDNot vaccinatedUTD2 Doses not UTD1 Dose not UTDNot vaccinated
n (%)n (%)n (%)n (%)Pbn (%)n (%)n (%)n (%)Pb
Birth year group     <0.01     <0.01 
 1980–1984 3,288 (2.1) 1,510 (1.0) 1,956 (1.2) 152,832 (95.8)  23 (1.7) 18 (1.3) 18 (1.3) 1,318 (95.7)  
 1985–1989 21,320 (8.6) 9,218 (3.7) 11,910 (4.8) 205,976 (82.9)  86 (4.6) 51 (2.7) 62 (3.3) 1,684 (89.4)  
 1990–1995 111,150 (30.4) 23,673 (6.5) 29,379 (8.1) 200,981 (55.0)  258 (25.4) 62 (3.3) 70 (6.9) 624 (61.5)  
Race           
 White 110,616 (18.2) 25,793 (4.2) 29,738 (4.9) 442,277 (72.7) <0.01 306 (8.8) 103 (3.0) 108 (3.1) 2,964 (85.2) 0.05 
 Black 22,387 (14.8) 7,946 (5.3) 12,755 (8.4) 108,202 (71.5)  59 (8.0) 26 (3.5) 40 (5.4) 614 (83.1)  
 Other 2,755 (20.4) 662 (4.9) 752 (5.6) 9,310 (69.1)  2 (3.7) 2 (3.7) 2 (3.7) 48 (88.9)  
Cohort (N = 773,193)Case–cohort, continuous residents (N = 4,274)
UTDa2 Doses not UTD1 Dose not UTDNot vaccinatedUTD2 Doses not UTD1 Dose not UTDNot vaccinated
n (%)n (%)n (%)n (%)Pbn (%)n (%)n (%)n (%)Pb
Birth year group     <0.01     <0.01 
 1980–1984 3,288 (2.1) 1,510 (1.0) 1,956 (1.2) 152,832 (95.8)  23 (1.7) 18 (1.3) 18 (1.3) 1,318 (95.7)  
 1985–1989 21,320 (8.6) 9,218 (3.7) 11,910 (4.8) 205,976 (82.9)  86 (4.6) 51 (2.7) 62 (3.3) 1,684 (89.4)  
 1990–1995 111,150 (30.4) 23,673 (6.5) 29,379 (8.1) 200,981 (55.0)  258 (25.4) 62 (3.3) 70 (6.9) 624 (61.5)  
Race           
 White 110,616 (18.2) 25,793 (4.2) 29,738 (4.9) 442,277 (72.7) <0.01 306 (8.8) 103 (3.0) 108 (3.1) 2,964 (85.2) 0.05 
 Black 22,387 (14.8) 7,946 (5.3) 12,755 (8.4) 108,202 (71.5)  59 (8.0) 26 (3.5) 40 (5.4) 614 (83.1)  
 Other 2,755 (20.4) 662 (4.9) 752 (5.6) 9,310 (69.1)  2 (3.7) 2 (3.7) 2 (3.7) 48 (88.9)  

Notes: Cohort analysis includes women born in Michigan during 1980–1995 whose birth record was linked with the immunization registry. Case–cohort analysis includes all CIN3+ arising from the cohort and a stratified random sample of women in the cohort, i.e., the subcohort; the case–cohort analysis was further limited to women who resided in Michigan continuously. See text for details.

aUTD, up-to-date on all recommended HPV vaccine doses based on age at initiation.

bP value from chi-square tests across all categories.

Cohort analysis

Table 3 shows VE results from the cohort analyses. The adjusted relative risk of CIN3+ for vaccination with ≥1 dose was 0.46 (95% CI, 0.41–0.52), corresponding to a VE estimate of 54%. VE was higher for UTD (66%) than not UTD (37%), but significant for both. Among women who were not UTD, VE was significant for 2 doses (33%) and 1 dose (40%). Stratified by birth year group, significant VE was observed for women born 1980–1984 only if UTD (39%). Significant VE was observed for women born 1985–1989 and 1990–1995 for both UTD and not UTD, but VE point estimates were consistently higher for UTD than for not UTD.

Table 3.

Relative risks of CIN3+a by vaccination status, and estimated vaccine effectiveness (VE), Michigan, 2009–2016, cohortb analysis (N = 773,193).

NoncasesNoncases nCases nRelative risk (95% CI)cAdjusted relative riskd (95% CI)VE
Total 769,355 3,838    
Vaccinated ≥1 dose 213,034 370 0.28 (0.25–0.31) 0.46 (0.41–0.52) 54% 
Vaccination status 
 UTDe 135,598 160 0.19 (0.16–0.22) 0.34 (0.29–0.40) 66% 
 Vaccinated, not UTD 77,436 210 0.44 (0.38–0.50) 0.63 (0.55–0.73) 37% 
  2 doses, not UTD 34,303 98 0.46 (0.38–0.56) 0.67 (0.54–0.82) 33% 
  1 dose, not UTD 43,133 112 0.42 (0.35–0.50) 0.60 (0.50–0.73) 40% 
 Not vaccinated 556,321 3,468 1.00 (REF) 1.00 (REF)  
By age (years) at first dose 
 Age at first dose <20 170,950 206 0.19 (0.17–0.22) 0.35 (0.30–0.40) 65% 
 Age at first dose ≥20 42,084 164 0.63 (0.54–0.73) 0.64 (0.55–0.75) 36% 
 Not vaccinated 556,321 3,468 1.00 (REF) 1.00 (REF)  
Stratified by birth year group 
 Born 1980–1984 
  Vaccinated ≥1 dose 
   UTD 3,272 16 0.62 (0.38–1.01) 0.61 (0.37–0.99) 39% 
   1 or 2 doses, not UTD 3,437 29 1.06 (0.74–1.54) 1.04 (0.72–1.51) −4% 
  Not vaccinated 151,631 1,201 1.00 (REF) 1.00 (REF)  
 Born 1985–1989 
  Vaccinated ≥1 dose 
   UTD 21,250 70 0.38 (0.30–0.48) 0.39 (0.31–0.49) 61% 
   1 or 2 doses, not UTD 21,026 102 0.56 (0.46–0.68) 0.58 (0.48–0.71) 42% 
  Not vaccinated 204,197 1,779 1.00 (REF) 1.00 (REF)  
 Born 1990–1995 
  Vaccinated ≥1 dose      
   UTD 111,076 74 0.27 (0.21–0.35) 0.37 (0.29–0.47) 63% 
   1 or 2 doses, not UTD 52,973 79 0.61 (0.48–0.78) 0.65 (0.51–0.83) 35% 
  Not vaccinated 200,493 488 1.00 (REF) 1.00 (REF)  
NoncasesNoncases nCases nRelative risk (95% CI)cAdjusted relative riskd (95% CI)VE
Total 769,355 3,838    
Vaccinated ≥1 dose 213,034 370 0.28 (0.25–0.31) 0.46 (0.41–0.52) 54% 
Vaccination status 
 UTDe 135,598 160 0.19 (0.16–0.22) 0.34 (0.29–0.40) 66% 
 Vaccinated, not UTD 77,436 210 0.44 (0.38–0.50) 0.63 (0.55–0.73) 37% 
  2 doses, not UTD 34,303 98 0.46 (0.38–0.56) 0.67 (0.54–0.82) 33% 
  1 dose, not UTD 43,133 112 0.42 (0.35–0.50) 0.60 (0.50–0.73) 40% 
 Not vaccinated 556,321 3,468 1.00 (REF) 1.00 (REF)  
By age (years) at first dose 
 Age at first dose <20 170,950 206 0.19 (0.17–0.22) 0.35 (0.30–0.40) 65% 
 Age at first dose ≥20 42,084 164 0.63 (0.54–0.73) 0.64 (0.55–0.75) 36% 
 Not vaccinated 556,321 3,468 1.00 (REF) 1.00 (REF)  
Stratified by birth year group 
 Born 1980–1984 
  Vaccinated ≥1 dose 
   UTD 3,272 16 0.62 (0.38–1.01) 0.61 (0.37–0.99) 39% 
   1 or 2 doses, not UTD 3,437 29 1.06 (0.74–1.54) 1.04 (0.72–1.51) −4% 
  Not vaccinated 151,631 1,201 1.00 (REF) 1.00 (REF)  
 Born 1985–1989 
  Vaccinated ≥1 dose 
   UTD 21,250 70 0.38 (0.30–0.48) 0.39 (0.31–0.49) 61% 
   1 or 2 doses, not UTD 21,026 102 0.56 (0.46–0.68) 0.58 (0.48–0.71) 42% 
  Not vaccinated 204,197 1,779 1.00 (REF) 1.00 (REF)  
 Born 1990–1995 
  Vaccinated ≥1 dose      
   UTD 111,076 74 0.27 (0.21–0.35) 0.37 (0.29–0.47) 63% 
   1 or 2 doses, not UTD 52,973 79 0.61 (0.48–0.78) 0.65 (0.51–0.83) 35% 
  Not vaccinated 200,493 488 1.00 (REF) 1.00 (REF)  

aCIN3+ includes cervical intraepithelial neoplasia grade 3, AIS, and invasive carcinoma.

bCohort includes women born in Michigan during 1980–1995, whose birth record was linked with the immunization registry. See text for details.

cRelative risks were estimated using log-binomial regression.

dAdjusted for birth year (as continuous variable), race.

eUp-to-date for all recommended HPV vaccine doses.

Case–cohort analysis

Compared with the cohort analysis, the case–cohort analysis yielded higher VE estimates with wider confidence intervals (Table 4). The aRR of CIN3+ for vaccination with ≥1 dose was 0.39 (95% CI, 0.32–0.48), corresponding to a VE estimate of 61%. VE was higher for UTD (72%) than not UTD (44%), but significant for both. Among women not UTD, VE was significant for 2 doses (39%) and 1 dose (48%). Stratified by birth year group, no significant VE was observed for women born 1980–1984; however, few women in this group were vaccinated. Significant VE was observed for women born 1985–1989 and 1990–1995 for both UTD and not UTD, but VE point estimates were higher for UTD. Results for the cohort and case–cohort analyses were compared graphically, highlighting the lower VE estimates with narrower CIs for the cohort analysis (Fig. 2).

Table 4.

Relative risks of CIN3+a by vaccination status, and estimated vaccine effectiveness (VE), Michigan, 2009–2016, case–cohortb analysis (N = 4,274).

NoncasesCasesRelative riskAdjusted relative riskd
nn(95% CI)c(95% CI)VE
Total 1,374 2,900 –   
Vaccinated ≥1 dose 379 269 0.22 (0.19–0.26) 0.39 (0.32–0.48) 61% 
Vaccination status 
 UTDe 252 115 0.14 (0.11–0.18) 0.28 (0.21–0.36) 72% 
 Vaccinated, not UTD 127 154 0.39 (0.31–0.50) 0.56 (0.43–0.74) 44% 
  2 doses, not UTD 58 73 0.41 (0.29–0.58) 0.61 (0.42–0.90) 39% 
  1 dose, not UTD 69 81 0.38 (0.27–0.53) 0.52 (0.37–0.75) 48% 
 Not vaccinated 995 2,631 1.00 (REF) 1.00 (REF)  
By age (years) at first dose 
 Age at first dose <20 300 144 0.14 (0.12–0.18) 0.27 (0.22–0.35) 73% 
 Age at first dose ≥20 79 125 0.60 (0.44–0.80) 0.59 (0.44–0.79) 41% 
 Not vaccinated 995 2,631 1.00 (REF) 1.00 (REF)  
Stratified by birth year group 
 Born 1980–1984 
  Vaccinated ≥1 dose 22 37    
   UTD 10 13 0.51 (0.22–1.18) 0.50 (0.22–1.17) 50% 
   1 or 2 doses, not UTD 12 24 0.79 (0.39–1.56) 0.77 (0.38–1.57) 23% 
  Not vaccinated 372 946 1.00 (REF) 1.00 (REF)  
 Born 1985–1989 
  Vaccinated ≥1 dose 77 122    
   UTD 38 48 0.32 (0.21–0.50) 0.34 (0.21–0.52) 66% 
   1 or 2 doses, not UTD 39 74 0.48 (0.32–0.72) 0.50 (0.33–0.75) 50% 
  Not vaccinated 341 1,343 1.00 (REF) 1.00 (REF)  
 Born 1990–1995 
  Vaccinated ≥1 dose 
   UTD 204 54 0.22 (0.16–0.31) 0.29 (0.20–0.42) 71% 
   1 or 2 doses, not UTD 76 56 0.61 (0.42–0.89) 0.63 (0.40–0.97) 37% 
  Not vaccinated 282 342 1.00 (REF) 1.00 (REF)  
NoncasesCasesRelative riskAdjusted relative riskd
nn(95% CI)c(95% CI)VE
Total 1,374 2,900 –   
Vaccinated ≥1 dose 379 269 0.22 (0.19–0.26) 0.39 (0.32–0.48) 61% 
Vaccination status 
 UTDe 252 115 0.14 (0.11–0.18) 0.28 (0.21–0.36) 72% 
 Vaccinated, not UTD 127 154 0.39 (0.31–0.50) 0.56 (0.43–0.74) 44% 
  2 doses, not UTD 58 73 0.41 (0.29–0.58) 0.61 (0.42–0.90) 39% 
  1 dose, not UTD 69 81 0.38 (0.27–0.53) 0.52 (0.37–0.75) 48% 
 Not vaccinated 995 2,631 1.00 (REF) 1.00 (REF)  
By age (years) at first dose 
 Age at first dose <20 300 144 0.14 (0.12–0.18) 0.27 (0.22–0.35) 73% 
 Age at first dose ≥20 79 125 0.60 (0.44–0.80) 0.59 (0.44–0.79) 41% 
 Not vaccinated 995 2,631 1.00 (REF) 1.00 (REF)  
Stratified by birth year group 
 Born 1980–1984 
  Vaccinated ≥1 dose 22 37    
   UTD 10 13 0.51 (0.22–1.18) 0.50 (0.22–1.17) 50% 
   1 or 2 doses, not UTD 12 24 0.79 (0.39–1.56) 0.77 (0.38–1.57) 23% 
  Not vaccinated 372 946 1.00 (REF) 1.00 (REF)  
 Born 1985–1989 
  Vaccinated ≥1 dose 77 122    
   UTD 38 48 0.32 (0.21–0.50) 0.34 (0.21–0.52) 66% 
   1 or 2 doses, not UTD 39 74 0.48 (0.32–0.72) 0.50 (0.33–0.75) 50% 
  Not vaccinated 341 1,343 1.00 (REF) 1.00 (REF)  
 Born 1990–1995 
  Vaccinated ≥1 dose 
   UTD 204 54 0.22 (0.16–0.31) 0.29 (0.20–0.42) 71% 
   1 or 2 doses, not UTD 76 56 0.61 (0.42–0.89) 0.63 (0.40–0.97) 37% 
  Not vaccinated 282 342 1.00 (REF) 1.00 (REF)  

aCIN3+ includes cervical intraepithelial neoplasia grade 3, AIS, and invasive cervical carcinoma.

bCase–cohort analysis includes all CIN3+ arising from the cohort and a stratified random sample of women in the cohort, i.e., the subcohort; the case–cohort analysis was further limited to women who resided in Michigan continuously.

cRelative risks were estimated using odds ratios from logistic regression.

dAdjusted for birth year (as continuous variable), race.

eUp-to-date for all recommended HPV vaccine doses.

Figure 2.

VE estimates obtained by cohort and case–cohort analyses, depending on vaccination status and age at first dose, Michigan, 2009–2016. UTD, up-to-date for all recommended HPV vaccine doses based on age at initiation and timing between doses. Notes: Cohort analysis includes women born in Michigan during 1980–1995 whose birth record was linked with the immunization registry. Case–cohort analysis includes all CIN3+ arising from the cohort and a stratified random sample of women in the cohort, i.e., the subcohort; the case–cohort analysis was further limited to women who resided in Michigan continuously. See text for details.

Figure 2.

VE estimates obtained by cohort and case–cohort analyses, depending on vaccination status and age at first dose, Michigan, 2009–2016. UTD, up-to-date for all recommended HPV vaccine doses based on age at initiation and timing between doses. Notes: Cohort analysis includes women born in Michigan during 1980–1995 whose birth record was linked with the immunization registry. Case–cohort analysis includes all CIN3+ arising from the cohort and a stratified random sample of women in the cohort, i.e., the subcohort; the case–cohort analysis was further limited to women who resided in Michigan continuously. See text for details.

Close modal

In this analysis of linked statewide registries in Michigan, we found significant effectiveness of HPV vaccination against CIN3+, the outcome most proximal to invasive cervical cancer. To our knowledge, this is the first U.S. study to report significant VE against CIN3+ after 1 or 2 doses and only the second worldwide to do so (21–26). The two analytic designs used in this report concurred on the direction and statistical significance of findings, although the magnitude and precision differed.

We found that both incomplete vaccination with 1 and 2 doses and UTD vaccination with 2 or 3 doses of HPV vaccine were effective against CIN3+, although effectiveness was lower for those who did not complete the recommended series. A handful of prior studies have included evaluation of VE against the highest grades of precancer (21–26); only one found significant protection against CIN3/AIS with <3 doses (26). That study was conducted in Denmark using a data linkage cohort design, included 5,258 CIN3+ (303 vaccinated), and focused on women who initiated vaccination at age ≤16 years. The study found similar VE for 1, 2, and 3 doses (62%–63%). No other prior studies have reported significant VE against CIN3+ with <3 doses; the other studies that have evaluated this outcome were smaller, and predominantly included women who were vaccinated at older ages as part of catch-up vaccination programs, as our study did (21–25).

Most prior VE studies have included the lower-grade CIN2 lesions, which are more numerous than CIN3/AIS and diagnosed at younger ages, on average (21–23, 26–32). Some recent studies reported similar effectiveness by number of doses against CIN2+ (26, 27, 30, 32). The accumulating body of literature underlines the importance of age at vaccination; studies that have focused on or stratified analyses to include women vaccinated at younger ages have found higher VE and/or more similar VE by number of doses (26, 30–32, 33), whereas other studies that included predominately catch-up vaccinees have found greater differences and little to no effectiveness with <3 doses (21–23, 25, 29, 34). Although our study did find higher VE among women vaccinated at younger versus older ages (<20 vs. ≥20 years), we were unable to perform an age-restricted analysis. In addition, ideally, we would have evaluated VE with a younger age at vaccination cutpoint such as ≤16 years, but too few women were vaccinated in this age range to perform a robust analysis. An unexpected finding was similar VE estimates for women in the 1985–1989 and 1990–1994 cohorts, which had different median ages at vaccination (20 vs. 16 years). We note that ≥1 dose HPV vaccination coverage increased between the 1985–1989 and 1990–1995 cohorts, from 17% to 45%. Herd effects could occur with higher coverage; whether this may have affected VE estimates for the 1990–1995 cohort is unknown.

The overall VE estimates from this study (61% using case–cohort methodology and 54% using cohort analysis) were similar to those observed in Verdoodt and colleagues (26), and plausible but high, given the prevalence of HPV16/18 in CIN3/AIS lesions observed in U.S. women in the prevaccine or early vaccine eras (range, 57%–63%; refs. 35–38). The observed VE was even higher in some of our analyses, especially in women who were UTD for all recommended doses, whose age at first dose was <20 years, or who were UTD and born in 1990–1995. Characteristics of the study population associated with higher prevalence of HPV16/18 among CIN3+ cases might explain these higher VE estimates; these include younger age, high proportion of white non-Hispanic women, and inclusion of AIS and invasive cancers (35, 38–40).

The design of this study, using linked statewide registries, is unique for the United States thus far, and more typical of studies conducted in countries that have robust national data with linkable personal identifiers. We found a similar pattern of results in both the cohort analysis and the analysis of continuous Michigan residents. Evaluating continuous residency for the entire cohort would have been cost-prohibitive; the case–cohort design is one strategy for improving exposure ascertainment using fewer resources while retaining the clear time order and reduced information biases of a cohort study. The cohort design yielded more precise VE estimates (i.e., narrower CIs), because the sample size was larger; the lower VE estimates with this method could result from misclassification of exposures and outcomes, since women with noncontinuous Michigan residence could have been vaccinated or diagnosed with CIN3+ in another state. The results of the cohort analysis were closer to null, but the inferences were similar to the more laborious case–cohort approach, in which continuous residency determination strengthened our confidence in vaccination history and CIN3+ status. Similar registry linkage studies may be feasible in other U.S. states. Determination of continuous residency on a subcohort would be preferred for limiting misclassification; however, in states with levels of outmigration similar to or less than Michigan, naïve cohort linkage approaches without using case–cohort methodology might provide useful information, particularly if misclassification bias can be quantified.

Studies including cervical precancers diagnosed during the HPV vaccination era should be interpreted in the context of cervical precancer screening and management recommendations. From 2009 to 2012, several medical organizations changed recommendations to start screening at age 21 years (41–43) rather than at 3 years after onset of sexual activity or age 21 years, whichever was earlier (44). In addition, in 2012, there were recommendations from all major medical organizations to extend the screening intervals from every year to every 3 years, if using cytology alone, or 3 to 5 years, if using cytology + HPV co-tests for women aged ≥30 years. Revised management guidelines were less aggressive for following women aged 21 to 24 years with low-grade cytology results (45). Because cervical precancers are only detected by screening, studies of population impact of the HPV vaccination program on precancers typically use screened women as the denominator when calculating incidence rates to avoid attributing declines due to less frequent screening to the vaccination program. The influence of changes in screening on VE estimates, on the other hand, is less clear. Some studies have shown that HPV vaccination and participation in cervical cancer screening are positively associated (46, 47); therefore, unvaccinated women may have fewer opportunities to be diagnosed with precancers, which could make vaccines appear less effective. Some VE studies have restricted analyses to screened women, or evaluated screening rates among vaccinated and unvaccinated women, to reduce or evaluate potential ascertainment biases; our study did not have access to screening data. We assume all precancers included in this study were screen-detected, but it is possible that differential adherence to screening guidelines by vaccination status introduced some biases.

Additional limitations should also be considered. Our study, like most previous post-licensure effectiveness studies, was conducted in the setting of a national 3-dose recommendation. As such, girls who received <3 doses were often different from those completing the schedule, which could bias results toward lower VE with <3 doses if girls who received less than a 3-dose schedule had a higher risk of infection at the time of vaccination due to age at vaccination (as shown in our data) or risk during follow-up (13). The statewide data systems included no data on sexual behavior such as number of partners or age at sexual debut; therefore, we could not evaluate this potential bias. We found that the unvaccinated group disproportionately represented the earlier birth cohorts, who also had higher CIN3+ incidence due to higher attained age during the study period. Although we controlled for birth year in analyses that included the birth year groups combined, residual confounding could remain. Because earlier and later cohorts differed strongly in their CIN3+ risk and likelihood of vaccination at the recommended ages, we conducted cohort-stratified analyses; in the two more recent cohorts, there was also significant VE among women not UTD. Another limitation is that there were too few UTD 2-dose vaccinees to evaluate the current 2-dose recommendation directly (9 in subcohort), so these were included in the UTD group, which mainly comprised 3-dose vaccinees. Although the immunization registry has incorporated adult vaccine doses since 2006, immunization data may be incomplete. Inputting doses for people ages ≥20 years was optional; some women who received doses in their 20s could have been misclassified as unvaccinated, and doses received at younger ages could also be missing. Additionally, the linkage was not 100% complete and varied by birth year. Systematic differences between linked and unlinked women could have biased results in either direction and could not be determined. Finally, although our study sample included some women with invasive cervical cancer, there were too few to analyze separately; we cannot conclude significant VE against invasive cancer from this study, as was recently shown in Sweden (48).

In conclusion, we report HPV VE against CIN3+ using state cancer and immunization registries in Michigan. Vaccination at younger ages or being part of a more recent cohort that was vaccinated at younger ages increased this protective effect. Maximum protection was associated with UTD vaccination. Future evaluations by number of doses for women vaccinated at younger ages, including at ages 11 to 12 years as recommended, may further clarify dose-related effectiveness.

M. You reports grants from CDC Immunization Grant and National Program of Cancer Registries during the conduct of the study. R. Potter reports grants from Centers for Disease Control and Prevention during the conduct of the study. No disclosures were reported by the other authors.

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

J.W. Gargano: Investigation, visualization, methodology, writing–original draft, writing–review and editing. M. You: Software, formal analysis, validation, investigation, visualization, methodology, writing–review and editing. R. Potter: Conceptualization, resources, software, validation, investigation, writing–original draft, project administration, writing–review and editing. G. Alverson: Resources, data curation, supervision, funding acquisition, investigation, writing–review and editing. R. Swanson: Resources, data curation, supervision, funding acquisition, writing–review and editing. M. Saraiya: Resources, supervision, writing–original draft, project administration, writing–review and editing. L.E. Markowitz: Conceptualization, supervision, methodology, writing–review and editing. G. Copeland: Conceptualization, resources, supervision, funding acquisition, investigation, writing–original draft, project administration, writing–review and editing.

The authors thank Jean Shapiro and Paran Pordell, Division of Cancer Prevention and Control, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention, for leadership of the CIN 3 project, which coordinates data collection on cervical precancers in Michigan and selected other states and territories. This study was supported by immunization grant funds under section 317 of the Public Health Service Act (42 USC Sect. 247b), Reference Number H23IP000854-01, to M. You, and National Program of Cancer Registries grant awards 5U58DP000812 and 1U58DP003921, to M. You.

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

1.
Doorbar
J
,
Quint
W
,
Banks
L
,
Bravo
IG
,
Stoler
M
,
Broker
TR
, et al
The biology and life-cycle of human papillomaviruses
.
Vaccine
2012
;
30
:
F55
70
.
2.
IARC
. 
Human papillomaviruses
.
IARC Monograph Eval Carcinog Risks Hum
2007
;
90
:
1
636
.
3.
de Sanjosé
S
,
Brotons
M
,
Pavón
MA
. 
The natural history of human papillomavirus infection
.
Best Pract Res Clin Obstet Gynaecol
2018
;
47
:
2
13
.
4.
Khan
MJ
,
Castle
PE
,
Lorincz
AT
,
Wacholder
S
,
Sherman
M
,
Scott
DR
, et al
The elevated 10-year risk of cervical precancer and cancer in women with human papillomavirus (HPV) type 16 or 18 and the possible utility of type-specific HPV testing in clinical practice
.
J Natl Cancer Inst
2005
;
97
:
1072
9
.
5.
Schiller
JT
,
Castellsague
X
,
Garland
SM
. 
A review of clinical trials of human papillomavirus prophylactic vaccines
.
Vaccine
2012
;
30
:
F123
38
.
6.
World Health Organization
. 
Immunization, vaccines and biologicals (IVB) update: vaccines in National Immunization Programme Update
. 
2019
[cited 2020 Nov 15]. Available from
: https://www.who.int/docs/default-source/documents/immunization/data/vaccine-intro-status.pdf?sfvrsn=bb2857ec_2.
7.
Markowitz
LE
,
Gee
J
,
Chesson
H
,
Stokley
S
. 
Ten years of human papillomavirus vaccination in the United States
.
Acad Pediatr
2018
;
18
:
S3
s10
.
8.
Dobson
SRM
,
McNeil
S
,
Dionne
M
,
Dawar
M
,
Ogilvie
G
,
Krajden
M
, et al
Immunogenicity of 2 doses of HPV vaccine in younger adolescents vs 3 doses in young women: a randomized clinical trial
.
JAMA
2013
;
309
:
1793
802
.
9.
Iversen
O-E
,
Miranda
MJ
,
Ulied
A
,
Soerdal
T
,
Lazarus
E
,
Chokephaibulkit
K
, et al
Immunogenicity of the 9-valent HPV vaccine using 2-dose regimens in girls and boys vs a 3-dose regimen in women
.
JAMA
2016
;
316
:
2411
21
.
10.
Meites
E
,
Kempe
A
,
Markowitz
LE
. 
Use of a 2-dose schedule for human papillomavirus vaccination - updated recommendations of the advisory committee on immunization practices
.
MMWR Morb Mortal Wkly Rep
2016
;
65
:
1405
8
.
11.
WHO
. 
Human papillomavirus vaccines: WHO position paper, October 2014
.
Wkly Epidemiol Rec
2014
;
43
:
465
92
.
12.
Stanley
M
,
Dull
P
. 
HPV single-dose vaccination: impact potential, evidence base and further evaluation
.
Vaccine
2018
;
36
:
4759
60
.
13.
Markowitz
LE
,
Drolet
M
,
Perez
N
,
Jit
M
,
Brisson
M
. 
Human papillomavirus vaccine effectiveness by number of doses: systematic review of data from national immunization programs
.
Vaccine
2018
;
36
:
4806
15
.
14.
Potter
RC
,
Flagg
EW
,
Datta
SD
,
Saraiya
M
,
Copeland
G
. 
Monitoring the impact of human papillomavirus vaccines on high-grade pre-invasive cervical lesions: designing a framework of linked immunization information system and cancer registry data in Michigan
.
Vaccine
2015
;
33
:
1400
5
.
15.
Darragh
TM
,
Colgan
TJ
,
Cox
JT
,
Heller
DS
,
Henry
MR
,
Luff
RD
, et al
The lower anogenital squamous terminology standardization project for HPV-associated lesions: background and consensus recommendations from the College of American Pathologists and the American Society for Colposcopy and Cervical Pathology
.
J Low Genit Tract Dis
2012
;
16
:
205
42
.
16.
Markowitz
LE
,
Dunne
EF
,
Saraiya
M
,
Chesson
HW
,
Curtis
CR
,
Gee
J
, et al
Human papillomavirus vaccination: recommendations of the advisory committee on immunization practices (ACIP)
.
MMWR Recomm Rep
2014
;
63
:
1
30
.
17.
Petrosky
E
,
Bocchini
JA
 Jr
,
Hariri
S
,
Chesson
H
,
Curtis
CR
,
Saraiya
M
, et al
Use of 9-valent human papillomavirus (HPV) vaccine: updated HPV vaccination recommendations of the advisory committee on immunization practices
.
MMWR Morb Mortal Wkly Rep
2015
;
64
:
300
4
.
18.
Ingram
DD
,
Parker
JD
,
Schenker
N
,
Weed
JA
,
Hamilton
B
,
Arias
E
, et al
United States Census 2000 population with bridged race categories
.
Vital Health Stat
2003
;
2
:
1
55
.
19.
Sharp
SJ
,
Poulaliou
M
,
Thompson
SG
,
White
IR
,
Wood
AM
. 
A review of published analyses of case–cohort studies and recommendations for future reporting
.
PLoS One
2014
;
9
:
e101176
.
20.
Barlow
WE
,
Ichikawa
L
,
Rosner
D
,
Izumi
S
. 
Analysis of case–cohort designs
.
J Clin Epidemiol
1999
;
52
:
1165
72
.
21.
Gertig
DM
,
Brotherton
JM
,
Budd
AC
,
Drennan
K
,
Chappell
G
,
Saville
AM
. 
Impact of a population-based HPV vaccination program on cervical abnormalities: a data linkage study
.
BMC Med
2013
;
11
:
227
.
22.
Palmer
T
,
Wallace
L
,
Pollock
KG
,
Cuschieri
K
,
Robertson
C
,
Kavanagh
K
, et al
Prevalence of cervical disease at age 20 after immunisation with bivalent HPV vaccine at age 12–13 in Scotland: retrospective population study
.
BMJ
2019
;
365
:
l1161
.
23.
Pollock
KGJ
,
Kavanagh
K
,
Potts
A
,
Love
J
,
Cuschieri
K
,
Cubie
H
, et al
Reduction of low- and high-grade cervical abnormalities associated with high uptake of the HPV bivalent vaccine in Scotland
.
Br J Cancer
2014
;
111
:
1824
30
.
24.
Shiko
Y
,
Konno
R
,
Konishi
H
,
Sauvaget
C
,
Ohashi
Y
,
Kakizoe
T
. 
Effectiveness of HPV vaccination against the development of high-grade cervical lesions in young Japanese women
.
BMC Infect Dis
2020
;
20
:
808
.
25.
Silverberg
MJ
,
Leyden
WA
,
Lam
JO
,
Gregorich
SE
,
Huchko
MJ
,
Kulasingam
S
, et al
Effectiveness of catch-up human papillomavirus vaccination on incident cervical neoplasia in a US health-care setting: a population-based case-control study
.
Lancet Child Adolesc Health
2018
;
2
:
707
14
.
26.
Verdoodt
F
,
Dehlendorff
C
,
Kjaera
SK
. 
Dose-related effectiveness of quadrivalent human papillomavirus vaccine against cervical intraepithelial neoplasia: a Danish nationwide cohort study.
Clin Infect Dis
2020
;
70
:
608
14
.
27.
Brotherton
JM
,
Budd
A
,
Rompotis
C
,
Bartlett
N
,
Malloy
MJ
,
Andersen
RL
, et al
Is one dose of human papillomavirus vaccine as effective as three?: a national cohort analysis
.
Papillomavirus Res
2019
;
8
:
100177
.
28.
Brotherton
JML
,
Malloy
M
,
Budd
AC
,
Saville
M
,
Drennan
KT
,
Gertig
DM
. 
Effectiveness of less than three doses of quadrivalent human papillomavirus vaccine against cervical intraepithelial neoplasia when administered using a standard dose spacing schedule: observational cohort of young women in Australia
.
Papillomavirus Res
2015
;
1
:
59
73
.
29.
Crowe
E
,
Pandeya
N
,
Brotherton
JML
,
Dobson
AJ
,
Kisely
S
,
Lambert
SB
, et al
Effectiveness of quadrivalent human papillomavirus vaccine for the prevention of cervical abnormalities: case-control study nested within a population based screening programme in Australia
.
BMJ
2014
;
348
:
g1458
.
30.
Dehlendorff
C
,
Sparén
P
,
Baldur-Felskov
B
,
Herweijer
E
,
Arnheim-Dahlström
L
,
Ploner
A
, et al
Effectiveness of varying number of doses and timing between doses of quadrivalent HPV vaccine against severe cervical lesions
.
Vaccine
2018
;
36
:
6373
8
.
31.
Johnson Jones
ML
,
Gargano
JW
,
Powell
M
,
Park
IU
,
Niccolai
LM
,
Bennett
NM
, et al
Effectiveness of 1, 2, and 3 doses of human papillomavirus vaccine against high-grade cervical lesions positive for human papillomavirus 16 or 18
.
Am J Epidemiol
2020
;
189
:
265
76
.
32.
Rodriguez
AM
,
Zeybek
B
,
Vaughn
M
,
Westra
J
,
Kaul
S
,
Montealegre
JR
, et al
Comparison of the long-term impact and clinical outcomes of fewer doses and standard doses of human papillomavirus vaccine in the United States: a database study
.
Cancer
2020
;
126
:
1656
67
.
33.
Brotherton
JM
,
Hawkes
D
,
Sultana
F
,
Malloy
MJ
,
Machalek
DA
,
Smith
MA
, et al
Age-specific HPV prevalence among 116,052 women in Australia's renewed cervical screening program: a new tool for monitoring vaccine impact
.
Vaccine
2019
;
37
:
412
6
.
34.
Brotherton
JM
,
Gertig
DM
,
May
C
,
Chappell
G
,
Saville
M
. 
HPV vaccine impact in Australian women: ready for an HPV-based screening program
.
Med J Aust
2016
;
204
:
184
.
35.
Hariri
S
,
Unger
ER
,
Schafer
S
,
Niccolai
LM
,
Park
IU
,
Bloch
KC
, et al
HPV type attribution in high-grade cervical lesions: assessing the potential benefits of vaccines in a population-based evaluation in the United States
.
Cancer Epidemiol Biomarkers Prev
2015
;
24
:
393
9
.
36.
Hopenhayn
C
,
Christian
WJ
,
Watson
M
,
Unger
ER
,
Lynch
CF
,
Peters
ES
, et al
Prevalence of human papillomavirus types in invasive cervical cancers from 7 US cancer registries before vaccine introduction
.
J Low Genit Tract Dis
2014
;
18
:
182
9
.
37.
Joste
NE
,
Ronnett
BM
,
Hunt
WC
,
Pearse
A
,
Langsfeld
E
,
Leete
T
, et al
Human papillomavirus genotype-specific prevalence across the continuum of cervical neoplasia and cancer
.
Cancer Epidemiol Biomarkers Prev
2015
;
24
:
230
40
.
38.
Cleveland
AA
,
Gargano
JW
,
Park
IU
,
Griffin
MR
,
Niccolai
LM
,
Powell
M
, et al
Cervical adenocarcinoma in situ: human papillomavirus types and incidence trends in five states, 2008–2015
.
Int J Cancer
2020
;
146
:
810
8
.
39.
McClung
NM
,
Lewis
RM
,
Gargano
JW
,
Querec
T
,
Unger
ER
,
Markowitz
LE
. 
Declines in vaccine-type human papillomavirus prevalence in females across racial/ethnic groups: data from a national survey
.
J Adolesc Health
2019
;
65
:
715
22
.
40.
Saraiya
M
,
Unger
ER
,
Thompson
TD
,
Lynch
CF
,
Hernandez
BY
,
Lyu
CW
, et al
US assessment of HPV types in cancers: implications for current and 9-valent HPV vaccines
.
J Natl Cancer Inst
2015
;
107
:
djv086
.
41.
ACOG practice bulletin No. 109: cervical cytology screening
.
Obstet Gynecol
2009
;
114
:
1409
20
.
42.
Moyer
VA
. 
Screening for cervical cancer: U.S. Preventive Services Task Force recommendation statement
.
Ann Intern Med
2012
;
156
:
880
91
.
43.
Saslow
D
,
Solomon
D
,
Lawson
HW
,
Killackey
M
,
Kulasingam
SL
,
Cain
J
, et al
American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer
.
Am J Clin Pathol
2012
;
137
:
516
42
.
44.
Yabroff
KR
,
Saraiya
M
,
Meissner
HI
,
Haggstrom
DA
,
Wideroff
L
,
Yuan
G
, et al
Specialty differences in primary care physician reports of papanicolaou test screening practices: a national survey, 2006 to 2007
.
Ann Intern Med
2009
;
151
:
602
11
.
45.
Massad
LS
,
Einstein
MH
,
Huh
WK
,
Katki
HA
,
Kinney
WK
,
Schiffman
M
, et al
2012 updated consensus guidelines for the management of abnormal cervical cancer screening tests and cancer precursors
.
J Low Genit Tract Dis
2013
;
17
:
S1
s27
.
46.
Herweijer
E
,
Feldman
AL
,
Ploner
A
,
Arnheim-Dahlström
L
,
Uhnoo
I
,
Netterlid
E
, et al
The participation of HPV-vaccinated women in a national cervical screening program: population-based cohort study
.
PLoS One
2015
;
10
:
e0134185
.
47.
Kliewer
EV
,
Mahmud
SM
,
Demers
AA
,
Lambert
P
. 
Human papillomavirus vaccination and Pap testing profile in Manitoba, Canada
.
Vaccine
2013
;
32
:
33
8
.
48.
Lei
J
,
Ploner
A
,
Elfström
KM
,
Wang
J
,
Roth
A
,
Fang
F
, et al
HPV vaccination and the risk of invasive cervical cancer
.
N Engl J Med
2020
;
383
:
1340
8
.