Reducing colorectal cancer mortality by promoting screening has been a national goal for two decades. The NCI's Population-Based Research Optimizing Screening through Personalized Regimens (PROSPR) consortium is the first federal initiative to foster coordinated, transdisciplinary research evaluating the entire cancer screening process in community settings. PROSPR is creating a central data repository to facilitate research evaluating the breast, cervical, and colorectal cancer screening process across different patient populations, provider types, and delivery systems. Data are being collected and organized at the multiple levels in which individuals are nested (e.g., healthcare systems, facilities, providers, and patients). Here, we describe a conceptual model of the colorectal cancer screening process guiding data collection and highlight critical research questions that will be addressed through pooled data. We also describe the three research centers focused on colorectal cancer screening with respect to study populations, practice settings, and screening policies. PROSPR comprehensively elucidates the complex screening process through observational study, and has potential to improve care delivery beyond the healthcare systems studied. Findings will inform intervention designs and policies to optimize colorectal cancer screening delivery and advance the Institute of Medicine's goals of effective, efficient, coordinated, timely, and safe health care with respect to evidence-based cancer screening. Cancer Epidemiol Biomarkers Prev; 23(7); 1147–58. ©2014 AACR.

In the United States, colorectal cancer is the second leading cause of cancer deaths despite availability of screening tests that could greatly reduce both colorectal cancer incidence and mortality (1–3). Guidelines recommend three screening strategies: guaiac-based fecal occult blood testing (gFOBT) or fecal immunochemical testing (FIT) every year, flexible sigmoidoscopy every 5 years with gFOBT/FIT every 3 years, or colonoscopy every 10 years (4–6). Most intervention research has focused on one-time participation in guideline-recommended colorectal cancer screening (7, 8). However, the colorectal cancer screening process is complex and involves delivery of several steps of care beyond one-time screening, including diagnostic evaluation following an abnormal test result, treatment of detected lesions, surveillance after abnormal results or—for those with normal results—repeat screening at guideline-appropriate intervals. Completion of the colorectal cancer screening process requires coordination of care and transfer of responsibilities among healthcare teams (physicians, nurses, and staff) in primary care, gastroenterology, and oncology (9). For screening to achieve greater impact on colorectal cancer incidence and mortality, teams and delivery systems must implement efficient, effective interventions that address the full colorectal cancer screening process (10, 11).

There are gaps in our knowledge about effective delivery of colorectal cancer screening including the best ways to measure breakdowns in the screening process and the impact of implementing evidence-based interventions on screening outcomes in community settings (7, 12). Given the complexity of the colorectal cancer screening process, more research is needed on the multiple factors acting at the patient-, provider-, and system levels that dynamically influence optimal screening test use. This knowledge will inform future interventions and policies to improve colorectal cancer screening in real-world settings.

To address these gaps, the NCI established in 2011 the Population-Based Research Optimizing Screening through Personalized Regimens (PROSPR) consortium. PROSPR's overall aim is to promote multisite, coordinated, transdisciplinary research that evaluates and improves breast, cervical, and colorectal cancer screening in community settings (13). A key PROSPR goal is to create a central data repository on the entire cancer screening process. Recognizing the numerous factors influencing delivery, PROSPR is collecting and organizing data at the multiple levels in which individuals are nested (e.g., healthcare systems, facilities, providers, and patients) for a large, geographically and demographically diverse patient cohort. Common data elements, measured at the patient-, provider-, facility-, and system level, include information on tests and procedures ordered and performed, cancer outcomes, and characteristics empirically associated with the screening process (e.g., patient sociodemographics and healthcare coverage, provider specialty and patient volume, facility and systems policies and incentives to promote screening). Before annual data submission, investigators refine operational definitions and expand the list of required elements to broaden comprehensiveness and robustness of the dataset. Data pooled across participating sites (described below) will facilitate research comparing screening performance across different patient populations, provider types, and delivery systems.

The PROSPR consortium has established seven research centers and one statistical coordinating center. Three research centers are focused on studying and improving the colorectal cancer screening process—Group Health Research Institute (Group Health), Kaiser Foundation Research Institute [Kaiser Permanente Northern California (KPNC) and Kaiser Permanente Southern California (KPSC)], and the Parkland Health & Hospital System/University of Texas-Southwestern Medical Center (Parkland-UTSW).

Here, we (i) describe the conceptual model depicting the colorectal cancer screening process that is guiding data collection; (ii) highlight colorectal cancer–specific research questions that will be addressed using pooled data and some of the methodologic challenges to these analyses; and (iii) provide an overview of the research centers with respect to study populations, settings, and policies, procedures, and programs to facilitate completion of the colorectal cancer screening process.

Each colorectal cancer research center has two principal aims. The first aim is to execute three research projects around a central theme that addresses key factors affecting the colorectal cancer screening process. Group Health, an integrated healthcare system located in Seattle, is assessing the effectiveness of different colorectal cancer screening strategies and identifying low-risk groups for whom a less-intensive screening approach might be appropriate. KPNC/KPSC is examining screening delivery among its enrollees, with the aim of optimizing FIT and colonoscopy screening strategies. Parkland-UTSW is evaluating screening delivery within an integrated safety-net system, including use of personalized approaches and whether these approaches improve outcomes in a low-income, uninsured population.

The second aim is to contribute data to the central repository and collaborate on analyses both specific to colorectal cancer and across cancer types: breast, cervical, and colorectal. Research using pooled data requires establishing a common conceptual and methodologic model (e.g., similar operational definitions), so that data can be validly integrated for comparative studies of the screening process.

Our colorectal cancer screening process model (Fig. 1) expands on the general continuum of cancer care developed by Taplin and colleagues (10, 11, 14–17). The model illustrates challenges specific to delivering colorectal cancer screening, including the multiple test modalities involved, the many activities that require coordination between primary and specialty care teams, and the need to identify patients with symptoms who enter the process at the diagnostic step. This model is intended to represent the screening process for patients at average colorectal cancer risk because it allows for completion of the process with any of the three guideline-recommended screening modalities. Patients at elevated colorectal cancer risk due to personal history (e.g., adenoma) and/or family history (e.g., first-degree relative diagnosed with colorectal cancer) should follow surveillance guidelines recommending colonoscopy at more frequent intervals and/or an earlier starting age (18, 19).

Figure 1.

PROSPR colorectal cancer screening process model.

Figure 1.

PROSPR colorectal cancer screening process model.

Close modal

We used Taplin and Zapka's typology for classifying aspects of the colorectal cancer screening process (9). Figure 1 highlights in gray the four types of care that are critical to accomplishing key goals of the colorectal cancer screening process—risk assessment, detection, diagnostic evaluation, and treatment. Steps, represented by boxes, are medical encounters or actions required of patients, providers, or clinical staff. Steps with dashed borders depict interfaces where information and/or responsibility must be transferred among different healthcare teams (e.g., primary care and specialist) to progress to the next step. Transitions are sets of multiple steps and interfaces necessary to move from one type to the next (e.g., detection to diagnosis).

Our model depicts all steps that may occur during one screening episode. The process can begin in three ways: (i) a provider recommends screening to a patient during a clinical encounter; (ii) the healthcare organization systematically invites eligible patients to screen; or (iii) a patient requests screening (Fig. 1, Transition #1). Which screening test modality is used depends on patient and provider preferences, resources of the patient, and policies of the organization. If results are normal, the process for this episode ends and guideline-based recommendations for repeat screening are communicated to the patient and relevant providers. Patients are referred for diagnostic colonoscopy if the screening process began with other tests (e.g., gFOBT, FIT, sigmoidoscopy, or CT colonography) with abnormal findings. Symptomatic patients (e.g., iron deficiency anemia, gastrointestinal bleeding) enter the process at referral for diagnostic colonoscopy (Fig. 1, Transition #2). Because colonoscopy can be performed for screening or diagnostic purposes, defining and documenting the exam's indication is particularly important, yet challenging (20–24). Also, critically important is reporting of colonoscopy results, to help providers and organizations identify patients at elevated risk who may require a more frequent screening or surveillance regimen. There are several interfaces within each type of care and during care transitions that require coordination between primary care and specialty providers; these interfaces may be particularly vulnerable to breakdown (10, 15). Unless cancer is detected or surveillance is recommended at the end of the screening episode, the process begins again and the patient re-enters the model based on guidelines and patient and provider preferences. PROSPR is uniquely positioned to address questions raised by our conceptual model.

Pooled PROSPR data offer unique opportunities to assess the colorectal cancer screening process in diverse, community settings. PROSPR colorectal cancer investigators intend to examine a wide range of clinical and policy-relevant research questions addressing:

  • What are the best strategies to promote appropriate use of colorectal cancer screening and follow-up, in terms of patient preference, patient adherence, local healthcare systems, and specific populations (25)? For example, Holden and colleagues (7) found strong evidence that elimination of structural barriers, one-on-one interactions, patient reminders, and system-level interventions improved screening rates; however, what is the impact of deploying these evidence-based strategies in real-world settings? What contextual factors hamper their effectiveness (e.g., characteristics of the patient population, providers, and/or facilities)?

  • What steps in the screening process (Fig. 1) are vulnerable to failure (26, 27)? What types of patients are at particular risk for failures (8, 28) and what are the factors at the provider-, facility-, and system levels that contribute to failures (11, 15, 29–33)?

  • What are the performance characteristics (sensitivity, specificity, positive predictive value) of colorectal cancer screening tests conducted in the diverse health systems represented in PROSPR (34, 35)?

  • To what extent do underuse, misuse, and overuse of colorectal cancer screening occur (7)? For example, how often are FITs given to patients who had a recent colonoscopy (less than 10 years) with normal results? How often do physicians recommend an FIT to patients who are in colonoscopy surveillance program due to prior adenomas? What strategies ameliorate misuse and overuse patterns (7)?

  • How does colorectal cancer risk change following screening (36, 37)? Can a risk-based management strategy be used for screening and surveillance (38, 39)?

  • What is the comparative effectiveness (i.e., balance of benefits and harms) of FIT versus colonoscopy screening regimens in the diverse health systems and patient populations represented in PROSPR, and the generalizability of these organized screening approaches to resource-limited settings (40–42)?

Findings will inform policy and clinical recommendations issued by experts, as well as design and implementation of population-based screening programs such as those supported by the Centers for Disease Control and Prevention (43).

To generate pooled data, colorectal cancer PROSPR investigators are establishing operational definitions for a wide array of common data elements characterizing the colorectal cancer screening process (e.g., benefits and harms of screening, colonoscopy indication) and are harnessing relevant clinical information systems, including the electronic medical record (EMR) and local clinical and administrative databases. Research centers submit data on an annual basis, and each year the required list of common data elements is reviewed, refined, and expanded to ensure the comprehensiveness and robustness of the pooled dataset. Research centers are linking screening process data with cancer outcomes available from regional and local cancer registries and considering linkages with pertinent contextual data to derive measures of community-level health status, resources, and utilization (e.g., U.S. Census, Health Resources and Services Administration's Area Resource File; refs. 44–46).

Although pooled PROSPR data provide a unique opportunity to address important questions about colorectal cancer screening, they also pose several challenges for analysis. Accounting for potential confounders and heterogeneity across systems are two key challenges. Screening rates and performance characteristics are likely to vary across research centers due to differences in preferred test modality, approaches to facilitate screening, and characteristics of the screen-eligible patient populations. To minimize bias, investigators are using methods to account for confounding when combining information across the research centers. For example, instrumental variable analysis (47, 48) or propensity score adjustment (49, 50) are approaches used to minimize selection bias (51, 52). Also, system-level variability can be addressed using multilevel modeling (53). Another challenge is accurate measurement of patient-level risk factors for prediction of short- and long-term outcomes, because risk factor information may change at any step in the screening process. Accuracy of information affect whether risk prediction algorithms can be used to develop personalized screening regimens and improve population-level screening outcomes. We are also assessing patient comorbidity to examine competing risks. Although conducting comparative effectiveness analyses of different colorectal cancer screening strategies with PROSPR's observational data is complex, validity can be greatly improved by carefully formulating research questions, implementing appropriate study designs, and applying sophisticated statistical methods.

The three colorectal cancer research centers are uniquely positioned to answer the key research questions described above. The research centers are comprised of four U.S. integrated healthcare systems covering four geographic regions. Integrated systems have been recognized as ideal settings for assessing the entire screening process in contrast to loosely affiliated or unaffiliated primary care practices that refer to specialty providers. This is because integrated systems can systematically track data at multiple levels through a comprehensive EMR(54, 55) and care is delivered through a single, coordinated organization of primary and specialty practices (56–59).

Group Health is a mixed-model, nonprofit, health plan serving nearly 625,000 members in Washington State. The Kaiser Permanente Research Center is comprised of two healthcare systems delivering care to about 7 million members in Northern (KPNC) and Southern (KPSC) California. Parkland-UTSW is the sole safety-net provider for under-insured and uninsured Dallas County residents living at ≤200% of federal poverty level; approximately 64,000 adults each year use Parkland's 11 primary care clinics. These four systems have a combined population of over 7.7 million people from which a pooled, dynamic colorectal cancer cohort has been derived.

Identification of the PROSPR colorectal cancer cohort

We have developed cohort definitions and eligibility criteria to facilitate pooling of the screening process data (Table 1). The Group Health and Kaiser Permanente cohorts consist of health plan members ages 50 to 89 years on or after January 1, 2010 with new cohort members added as they become eligible for colorectal cancer screening (i.e., enters cohort on 50th birthday). For the Kaiser Permanente cohort, one year of prior membership is also required for cohort inclusion. Membership eligibility criteria were used to provide new enrolled Kaiser Permanente patients with a sufficient period of time for providers to document colorectal cancer screening history, determine screening eligibility, and offer screening services. For Parkland-UTSW, Dallas County residents ages 50 to 64 years with a visit at one of Parkland's 11 primary care clinics on or after January 1, 2010, are included into the cohort on the date of their visit. These latter eligibility criteria were applied for two reasons: (i) access to colorectal cancer screening services at Parkland is limited to patients seen in primary care (as opposed to those seen only in the emergency department or at a specialty clinic); and (ii) Parkland is obligated to care for all uninsured Dallas County residents but residents who become Medicare-eligible at age 65 may opt to receive care outside the Parkland system. All research centers excluded patients diagnosed with colorectal cancer or with a partial or total colectomy before cohort entry date.

Table 1.

Cohort definitions and eligibility criteria for PROSPR colorectal cancer research centers, by healthcare system

 Group Health KPNC KPSC Parkland-UTSW 
Cohort membership and entry date Individuals enrolled in the health plan on or after January 1, 2010 Dallas County residents with a Parkland primary care provider visit on or after January 1, 2010 
Inclusion criteria: 
Age at cohort entry 50–89 years 50–64 years 
Length of association with system None Continuous enrollment in the health plan for 1 year before cohort entry date with no more than 90-day gap in coverage None 
Exclusion criteria: 
 Diagnosed with colorectal cancer or underwent a partial/total colectomy before cohort entry date 
Newly eligible membership criteria: 
Age Newly eligible for colorectal cancer screening based on birth date (i.e., enters cohort on 50th birthday) 
 Group Health KPNC KPSC Parkland-UTSW 
Cohort membership and entry date Individuals enrolled in the health plan on or after January 1, 2010 Dallas County residents with a Parkland primary care provider visit on or after January 1, 2010 
Inclusion criteria: 
Age at cohort entry 50–89 years 50–64 years 
Length of association with system None Continuous enrollment in the health plan for 1 year before cohort entry date with no more than 90-day gap in coverage None 
Exclusion criteria: 
 Diagnosed with colorectal cancer or underwent a partial/total colectomy before cohort entry date 
Newly eligible membership criteria: 
Age Newly eligible for colorectal cancer screening based on birth date (i.e., enters cohort on 50th birthday) 

PROSPR colorectal cancer cohort characteristics by healthcare system

Table 2 describes sociodemographic characteristics and screening process outcomes of cohort members who entered in 2010 for each of the four systems. Age distributions of screen-eligible patients at Group Health, KPNC, and KPSC are very similar, with approximately 75% of patients in the fifth and sixth decade of life and 25% in the seventh and eighth decades. Because of the restricted age range of the Parkland-UTSW cohort, almost 72% of the patients are in their 50s'. More than half of the patients are female, with the highest proportion of females at Parkland-UTSW (64%). There is substantial racial and ethnic variation across the systems. Group Health members are predominantly White (72.1%) and, although the proportions are lower at KPNC (58.4%) and KPSC (45.7%), non-Hispanic Whites still comprise the majority. Nearly a quarter of the KPSC cohort is Hispanic, compared with 11.6% at KPNC and 3.3% at GH. Only 18.4% of Parkland-UTSW patients are White; most are either non-Hispanic Black (38.9%) or Hispanic (36.1%). Of the four systems, KPNC has the highest proportion of Asians and Pacific Islanders (14.0%).

Table 2.

Cohort demographics and colorectal cancer screening process outcomes of the PROSPR colorectal cancer research centers during the first year of cohort enrollment, by healthcare system, 2010

Group healthKPNCKPSCParkland-UTSW
VariablesN (%)N (%)N (%)N (%)
Total age-eligible population N = 156,540 N = 1,028,609 N = 1,050,208 N = 29,307 
Age (10-year age groups) 
 50–59 67,433 (43.1%) 464,782 (45.2%) 481,182 (45.8%) 20,980 (71.6%) 
 60–69a 52,418 (33.5%) 322,043 (31.3%) 325,193 (31.0%) 8,327 (28.4%) 
 70–79 22,437 (14.3%) 166,138 (16.2%) 170,418 (16.2%) — 
 80–89 14,252 (9.1%) 75,656 (7.4%) 73,415 (7.00%) — 
Sex % (male) 70,123 (44.8%) 472,461 (45.9%) 491,993 (46.8%) 10,542 (36.0%) 
Race/ethnicity 
 Non-Hispanic White 112,844 (72.1%) 601,195 (58.4%) 480,137 (45.7%) 5,386 (18.4%) 
 Non-Hispanic Black 5,109 (3.3%) 67,393 (6.6%) 102,905 (9.8%) 11,390 (38.9%) 
 Hispanic 5,226 (3.3%) 119,584 (11.6%) 249,043 (23.7%) 10,594 (36.1%) 
 Asian/Pacific Islander 10,451 (6.7%) 143,943 (14.0%) 97,969 (9.3%) 1,733 (5.9%) 
 Native American/Alaskan Native 1,022 (0.6%) 4,776 (0.5%) 1,972 (0.2%) 81 (0.3%) 
 Other/multiracial 1,873 (1.2%) 40,268 (3.9%) 21,340 (2.0%) 
 Unknown 20,035 (12.8%) 51,460 (5.0%) 96,842 (9.2%) 123 (0.4%) 
Rural–urban continuum measure 
 Metropolitan 148,959 (95.1%) 972,670 (94.6%) 1,034,089 (98.5%) 29,307 (100.0%) 
 Micropolitan 3,722 (2.4%) 26,083 (2.5%) 8,643 (0.8%) — 
 Low density 1,805 (1.2%) 8,851 (0.9%) 1,723 (0.2%) — 
 Unknown 2054 (1.3%) 21,015 (2.0%) 5,753 (0.5%) — 
Health insurance 
 Medicareb 57,882 (37.0%) 456,005 (44.3%) 340,582 (32.4%) 2,717 (9.2%) 
 Medicaid 3,941 (2.5%) 3,716 (0.4%) 9,725 (0.9%) 2,145 (7.3%) 
 Commercial/private 94,717 (60.5%) 564,931 (54.9%) 699,085 (66.6%) 1,814 (6.2%) 
 Other — 3,783 (0.4%) 743 (<0.1%) 82 (0.3%) 
 Uninsured — 184 (<0.1%) 73 (<0.1%) 20,038 (68.4%) 
 Unknown — — — 2,511 (8.6%) 
Tests and results in 2010 
 Number of FIT performed 510 311,535 282,448 7,580 
 Number of gFOBT performed 23,436 2,034 5,097 912 
 Number of sigmoidoscopies performed 1,372 24,561 16,116 41 
 Number of colonoscopies performedc 13,197 46,554 81,452 2,433 
 Number of abnormal FIT/gFOBT 1,180 13,968 15,893 404 
 Number of colorectal cancers diagnosed 225 948 1,111 84 
Group healthKPNCKPSCParkland-UTSW
VariablesN (%)N (%)N (%)N (%)
Total age-eligible population N = 156,540 N = 1,028,609 N = 1,050,208 N = 29,307 
Age (10-year age groups) 
 50–59 67,433 (43.1%) 464,782 (45.2%) 481,182 (45.8%) 20,980 (71.6%) 
 60–69a 52,418 (33.5%) 322,043 (31.3%) 325,193 (31.0%) 8,327 (28.4%) 
 70–79 22,437 (14.3%) 166,138 (16.2%) 170,418 (16.2%) — 
 80–89 14,252 (9.1%) 75,656 (7.4%) 73,415 (7.00%) — 
Sex % (male) 70,123 (44.8%) 472,461 (45.9%) 491,993 (46.8%) 10,542 (36.0%) 
Race/ethnicity 
 Non-Hispanic White 112,844 (72.1%) 601,195 (58.4%) 480,137 (45.7%) 5,386 (18.4%) 
 Non-Hispanic Black 5,109 (3.3%) 67,393 (6.6%) 102,905 (9.8%) 11,390 (38.9%) 
 Hispanic 5,226 (3.3%) 119,584 (11.6%) 249,043 (23.7%) 10,594 (36.1%) 
 Asian/Pacific Islander 10,451 (6.7%) 143,943 (14.0%) 97,969 (9.3%) 1,733 (5.9%) 
 Native American/Alaskan Native 1,022 (0.6%) 4,776 (0.5%) 1,972 (0.2%) 81 (0.3%) 
 Other/multiracial 1,873 (1.2%) 40,268 (3.9%) 21,340 (2.0%) 
 Unknown 20,035 (12.8%) 51,460 (5.0%) 96,842 (9.2%) 123 (0.4%) 
Rural–urban continuum measure 
 Metropolitan 148,959 (95.1%) 972,670 (94.6%) 1,034,089 (98.5%) 29,307 (100.0%) 
 Micropolitan 3,722 (2.4%) 26,083 (2.5%) 8,643 (0.8%) — 
 Low density 1,805 (1.2%) 8,851 (0.9%) 1,723 (0.2%) — 
 Unknown 2054 (1.3%) 21,015 (2.0%) 5,753 (0.5%) — 
Health insurance 
 Medicareb 57,882 (37.0%) 456,005 (44.3%) 340,582 (32.4%) 2,717 (9.2%) 
 Medicaid 3,941 (2.5%) 3,716 (0.4%) 9,725 (0.9%) 2,145 (7.3%) 
 Commercial/private 94,717 (60.5%) 564,931 (54.9%) 699,085 (66.6%) 1,814 (6.2%) 
 Other — 3,783 (0.4%) 743 (<0.1%) 82 (0.3%) 
 Uninsured — 184 (<0.1%) 73 (<0.1%) 20,038 (68.4%) 
 Unknown — — — 2,511 (8.6%) 
Tests and results in 2010 
 Number of FIT performed 510 311,535 282,448 7,580 
 Number of gFOBT performed 23,436 2,034 5,097 912 
 Number of sigmoidoscopies performed 1,372 24,561 16,116 41 
 Number of colonoscopies performedc 13,197 46,554 81,452 2,433 
 Number of abnormal FIT/gFOBT 1,180 13,968 15,893 404 
 Number of colorectal cancers diagnosed 225 948 1,111 84 

aAge group for Parkland-UTSW cohort consists of 60- to 64-year-olds because of cohort eligibility criteria. At Group Health, KPNC, and KPSC, the percentage of the cohort ages 60 to 64 years is 20.9%, 18.5%, and 18.3%, respectively.

bIndividuals dual eligible for Medicare and Medicaid were grouped into the Medicaid category.

cTotal includes both screening and diagnostic colonoscopies.

Almost all patients across the four systems live in metropolitan areas (60, 61). Group Health, KPNC, and KPSC are very similar in insurance coverage distribution—most patients are privately insured (54.9%–66.6%) or have Medicare (32.4%–44.3%), and very small proportion have Medicaid or are dual-eligible for Medicare and Medicaid. In contrast, 68.4% of Parkland-UTSW patients are uninsured; their medical care costs are covered by Dallas County's medical assistance program financed by property taxes. About 9% of Parkland-UTSW patients have Medicare coverage; 7% are covered by Medicaid. Overall, significant heterogeneity of the pooled cohort with respect to race/ethnicity, age, and insurance coverage is evident.

FIT comprised the vast majority of stool-based tests performed in 2010 at KPNC, KPSC, and Parkland-UTSW. In contrast, Group Health used gFOBT during 2010 and transitioned to FIT in late 2011. More than 30,000 abnormal stool tests required diagnostic evaluation within the four systems during 2010. Across the four systems, colonoscopy was the most common endoscopy procedure. We are currently cross-validating methods to define indication as none of the systems' EMR has a discrete field for identifying reason for colonoscopy; this effort will enable definition of a screening episode and identification of misuse and overuse patterns. In 2010, more than 2,300 colorectal cancer cases were identified by the systems.

Provider, facility, and clinical information system characteristics by healthcare system

Table 3 describes the four systems' healthcare delivery resources. There is substantial range in number of primary care physicians who care for adult patients (total > 3,700) and number of endoscopy providers (total > 250). Group Health and Parkland-UTSW use mid-level providers such as nurse practitioners and physician assistants in primary care. KPSC and Parkland-UTSW are teaching institutions that employ gastroenterology fellows; therefore, attending physicians and fellows perform endoscopy procedures. To meet increasing capacity needs over a wide geographic area, Group Health contracts with outside endoscopy providers to perform some colonoscopies; the contracted providers use various clinical information systems for storing data and are not all universally linked to Group Health members' EMR.

Table 3.

Provider, facility, and clinical information system characteristics of the colorectal cancer PROSPR research centers, by healthcare system, December 2012

Variables Group Health KPNC KPSC Parkland-UTSW 
Number of primary care providersa Physicians: 349 Physicians: 1,700 Physicians: 1,646b Physicians: 83 
 Midlevel: 138   Midlevel: 12 
Number of endoscopy providersa Physicians: 14 Physicians: 122 Physicians: 115a Physicians: 18 
    Fellows: 22 
Number of endoscopy facilitiesc Group Health: 2 ASC: 1 ASC: 2 ASC: 1 
 Contracted: 300 MOB: 15 MOB: 1 Hospital: 1 
  Hospital: 3 Hospital: 14  
Number of hospitals Contracted: 40 19 13 
Type of FOBT/FIT kit Polymedco OC FIT-CHEKd 1 sample test Beckman Coulter Hemoccult ICT FIT 
    3 sample test 
EMR system EPIC EPIC EPIC EPIC 
Pathology system Progeny Cerner CoPath Plus Cerner Millennium 
Pathology processing (centralized vs. local) FOBT/FIT: centralizedGroup Health SIG/COL: centralizedContracted SIG/COL: local to each facility FIT: centralizedSIG/COL: local to each medical center FIT: local to each primary care clinicSIG/COL: centralized 
Variables Group Health KPNC KPSC Parkland-UTSW 
Number of primary care providersa Physicians: 349 Physicians: 1,700 Physicians: 1,646b Physicians: 83 
 Midlevel: 138   Midlevel: 12 
Number of endoscopy providersa Physicians: 14 Physicians: 122 Physicians: 115a Physicians: 18 
    Fellows: 22 
Number of endoscopy facilitiesc Group Health: 2 ASC: 1 ASC: 2 ASC: 1 
 Contracted: 300 MOB: 15 MOB: 1 Hospital: 1 
  Hospital: 3 Hospital: 14  
Number of hospitals Contracted: 40 19 13 
Type of FOBT/FIT kit Polymedco OC FIT-CHEKd 1 sample test Beckman Coulter Hemoccult ICT FIT 
    3 sample test 
EMR system EPIC EPIC EPIC EPIC 
Pathology system Progeny Cerner CoPath Plus Cerner Millennium 
Pathology processing (centralized vs. local) FOBT/FIT: centralizedGroup Health SIG/COL: centralizedContracted SIG/COL: local to each facility FIT: centralizedSIG/COL: local to each medical center FIT: local to each primary care clinicSIG/COL: centralized 

Abbreviations: COL, colonoscopy; SIG, flexible sigmoidoscopy.

aPhysician numbers include family practitioners and internists who care for adults; obstetrician-gynecologists were not included. Contracted providers (e.g., not employed by the healthcare system) are not included in these numbers.

bKPSC physician numbers do not include per diem physicians and residents.

cThree types of facilities perform endoscopy procedures: ambulatory surgery centers (ASC), medical office buildings (MOB), hospital; facilities may be owned by healthcare system or be a contracted provider.

dDifferent automated systems are used to process OC FIT-CHEK test (OC-Auto Micro 80 or OC-Sensor Diana).

Endoscopy procedures are performed in three distinct facility types—ambulatory surgical centers, medical offices, and hospitals. These types are subject to different regulatory requirements (62, 63). These facilities may be owned and managed by the healthcare system or may have a formal contract with the system to provide services. The nature of the relationship may affect interfaces (i.e., transfer of clinical information and responsibility) between primary care and endoscopy providers and increase difficulty of extracting endoscopy results because scanned reports are stored as images and require more resources to extract than text information stored in the EMR. We are also cross-validating natural language processing and algorithm-based methods to systematically extract text data from endoscopy reports given the wide variation in how results are documented.

All four healthcare systems use a common and comprehensive EPIC platform-based EMR. The EPIC EMR can provide information on electronic orders, referrals, scheduling, test results, treatment, and billing for both inpatient and outpatient care. KPNC, KPSC, and Parkland-UTSW have a Cerner-based clinical information system for reporting pathology results; Group Health uses Progeny. Group Health, KPNC, and KPSC carry out centralized processing of stool-based tests. In contrast, each of the 11 Parkland-UTSW primary care clinics process FITs at local on-site laboratories. Pathology processing for endoscopy specimens is centralized for Parkland-UTSW and Group Health–performed procedures; for KPNC and KPSC and some contracted providers for Group Health, pathology processing is local to each endoscopy facility. The heterogeneous nature of the three colorectal cancer research centers not only contributes to the robust nature of the data collected in the PROSPR consortium but will also make findings from PROSPR studies more generalizable across populations and delivery settings.

Policies, procedures, and programs to facilitate the colorectal cancer screening process

All colorectal cancer research centers have clinic- and system-level policies procedures, and programs targeted toward asymptomatic, average-risk individuals to facilitate completion of screening process steps, transitions between types of care, and interfaces among providers (Table 4; refs. 9, 15, 16).

Table 4.

Policies and procedures for colorectal cancer screening recruitment and follow-up in PROSPR research centers, by healthcare system, December 2012

Variables Group Health KPNC KPSC Parkland-UTSW 
Target population with respect to screening eligibility Average-risk members ages 50 to 75 years Primary care patients ages 50+ 
Screening strategy (test modality and interval) Organized program with FIT as preferred modality and follow-up with diagnostic COL if FIT is abnormal. COL every 10 years or SIG every 5 yearsa is available based on patient/provider preference Organized program with FIT as primary outreach modality and follow-up with diagnostic COL if FIT is abnormal. COL every 10 years or SIG every 5 yearsa is also available based on patient/provider preference Offered as part of usual care during clinic visits; test modality based on patient/provider preference 
Method to identify eligible patients Electronic tool/clinical information system and EMRb Provider recognize with assistance of EMR health maintenance module 
Invitation method Mailed letter. Timing depends on site and is based on birth date or anniversary of prior screening. Verbal invite by provider 
FOBT/FIT distribution method Patient pick up at clinic, pharmacy, or laboratory. Patients may ask PCP team to mail a kit. Kits mailed with invitation letter.Kits also available at clinic and laboratory. During clinic visit 
SIG/COL referral system Patient self-refer or provider order via EMRc Provider order or consult request via EMR 
Reminder system and timing System notifies PCP team to call patient after 1 month System delivers automated call after 3 weeks and mails a letter after 6 weeks. If still nonadherent, system notifies PCP team to call patient and send secure e-mail. System or PCP team calls after 30 days None 
Method of notifying patients about FIT result Normal FIT: letter sent (unless opted-out) and posted on patient-facing secure website Normal FIT: postcard sent and posted on patient-facing secure website Normal FIT: posted on patient-facing secure website Normal FIT: letter sent. 
 Abnormal FIT: nurse calls Abnormal FIT: physician calls and posted on patient-facing secure website Abnormal FIT: nurse calls Abnormal FIT: nurse calls. 
Method of notifying patients about colonoscopy result Normal COL (e.g., no pathology specimen): same-day posting on patient-facing secure website Normal COL (e.g., no pathology specimen): verbal communication after procedure. Normal COL (e.g., no pathology specimen): verbal communication after procedure. Normal COL (e.g., no pathology specimen): verbal communication after procedure. 
 Abnormal COL: letter sent if benign pathology; provider calls if follow-up is needed. Abnormal COL: secure email or call if benign pathology; provider calls if malignant. Abnormal COL: provider calls if benign or malignant pathology Abnormal COL: letter sent if benign pathology; provider calls if malignant. 
Provider test result notification EMR in-basket 
Tracking adherence to follow-up of abnormal test resultsc Safety-net program where system notifies PCP team until a COL is completed for patients with no follow-up within 4 months of an abnormal result. System- and practice-level tracking and follow-up. Weekly report notifies PCP team about patients who have not been referred or have not completed their COL. System- and practice-level tracking and follow-up. Endoscopy facility contacts patient to book COL with a scheduling goal of <30 days. No system-level program to monitor adherence to follow-up. PCP teams at each clinic may choose to implement a program. 
Role of primary care in the screening process PCP team serves as “back-up” to system-level organized program.EMR tool enables PCP to identify nonadherent patients and offer FIT.PCP team supports delivery of screening reminders and referrals for diagnostic evaluation.PCP team receives reports on screening process outcomes to improve care delivery. PCP team has primary responsibility for facilitating the screening process. PCP receives reports on screening rates to improve care delivery. 
Variables Group Health KPNC KPSC Parkland-UTSW 
Target population with respect to screening eligibility Average-risk members ages 50 to 75 years Primary care patients ages 50+ 
Screening strategy (test modality and interval) Organized program with FIT as preferred modality and follow-up with diagnostic COL if FIT is abnormal. COL every 10 years or SIG every 5 yearsa is available based on patient/provider preference Organized program with FIT as primary outreach modality and follow-up with diagnostic COL if FIT is abnormal. COL every 10 years or SIG every 5 yearsa is also available based on patient/provider preference Offered as part of usual care during clinic visits; test modality based on patient/provider preference 
Method to identify eligible patients Electronic tool/clinical information system and EMRb Provider recognize with assistance of EMR health maintenance module 
Invitation method Mailed letter. Timing depends on site and is based on birth date or anniversary of prior screening. Verbal invite by provider 
FOBT/FIT distribution method Patient pick up at clinic, pharmacy, or laboratory. Patients may ask PCP team to mail a kit. Kits mailed with invitation letter.Kits also available at clinic and laboratory. During clinic visit 
SIG/COL referral system Patient self-refer or provider order via EMRc Provider order or consult request via EMR 
Reminder system and timing System notifies PCP team to call patient after 1 month System delivers automated call after 3 weeks and mails a letter after 6 weeks. If still nonadherent, system notifies PCP team to call patient and send secure e-mail. System or PCP team calls after 30 days None 
Method of notifying patients about FIT result Normal FIT: letter sent (unless opted-out) and posted on patient-facing secure website Normal FIT: postcard sent and posted on patient-facing secure website Normal FIT: posted on patient-facing secure website Normal FIT: letter sent. 
 Abnormal FIT: nurse calls Abnormal FIT: physician calls and posted on patient-facing secure website Abnormal FIT: nurse calls Abnormal FIT: nurse calls. 
Method of notifying patients about colonoscopy result Normal COL (e.g., no pathology specimen): same-day posting on patient-facing secure website Normal COL (e.g., no pathology specimen): verbal communication after procedure. Normal COL (e.g., no pathology specimen): verbal communication after procedure. Normal COL (e.g., no pathology specimen): verbal communication after procedure. 
 Abnormal COL: letter sent if benign pathology; provider calls if follow-up is needed. Abnormal COL: secure email or call if benign pathology; provider calls if malignant. Abnormal COL: provider calls if benign or malignant pathology Abnormal COL: letter sent if benign pathology; provider calls if malignant. 
Provider test result notification EMR in-basket 
Tracking adherence to follow-up of abnormal test resultsc Safety-net program where system notifies PCP team until a COL is completed for patients with no follow-up within 4 months of an abnormal result. System- and practice-level tracking and follow-up. Weekly report notifies PCP team about patients who have not been referred or have not completed their COL. System- and practice-level tracking and follow-up. Endoscopy facility contacts patient to book COL with a scheduling goal of <30 days. No system-level program to monitor adherence to follow-up. PCP teams at each clinic may choose to implement a program. 
Role of primary care in the screening process PCP team serves as “back-up” to system-level organized program.EMR tool enables PCP to identify nonadherent patients and offer FIT.PCP team supports delivery of screening reminders and referrals for diagnostic evaluation.PCP team receives reports on screening process outcomes to improve care delivery. PCP team has primary responsibility for facilitating the screening process. PCP receives reports on screening rates to improve care delivery. 

Abbreviations: COL, colonoscopy; SIG, flexible sigmoidoscopy; PCP, primary care provider.

aSigmoidoscopy strategy varies across systems—Group Health recommends FIT every 3 years with SIG; at KPNC and KPSC, SIG can be offered with or without FIT.

bElectronic tool to generate patient lists for outreach varies across systems—Group Health has a data warehouse that uses patient birth dates and past screening history; KPNC also uses administrative data; KPSC has a stand-alone population care management electronic tool.

cWhether a provider employed by Group Health or a contractor performs COL depends on patients' location.

To initiate the screening process, Group Health, KPNC, and KPSC have organized programs that systematically invite all average-risk members ages 50 to 75 years to participate in colorectal cancer screening. Electronic clinical information systems identify and generate lists of eligible patients. Invitation letters are mailed and timing of delivery may be based on birth month or anniversary of prior screening. Stool blood testing is the preferred screening modality, but endoscopy is also available as an option based on patient/provider preference. At KPNC and KPSC, the FIT kit is mailed with the invitation letter; if endoscopy is chosen, a primary care provider must place an order or request a consult. At Group Health, patients can self-refer for colonoscopy. Response to invitations is monitored, and either a reminder is sent to nonadherent individuals or a patient's primary care team is notified. Timing and delivery mode of reminders varies across the systems. We are currently working to obtain data from these clinical information systems and expand our common data elements to identify moderators of program effectiveness.

At Parkland-UTSW, screening is available to all primary care patients 50 years of age or older opportunistically during in-person clinic visits. The screening modality offered is based on provider and patient preferences.

Across all four systems, screening results are reported to primary care providers via EMR in-basket. The systems have at least three methods for notifying patients about results (e.g., information is posted in a secure website, letter is mailed, or a provider calls), and delivery mode depends on the test modality and findings. Group Health, KPNC, and KPSC also have system- and practice-level strategies to encourage patients with abnormal test results to complete diagnostic evaluation. Finally, all four systems generate population-level reports based on data stored in their clinical information systems to monitor adherence to colorectal cancer screening guidelines.

Collaboration among the PROSPR colorectal cancer research centers will advance knowledge about the screening process by providing detailed, longitudinal, multilevel, population-based data about steps, transitions, and interfaces along the colorectal cancer screening process. Background information about the cohort, integrated healthcare systems, and colorectal cancer–specific policies and procedures illustrates that PROSPR is poised to comprehensively compare and systematically evaluate the colorectal cancer screening process in diverse metropolitan community settings.

There are a few limitations to acknowledge. Our main data source for the pooled dataset is the EMR. Because each system's EMR differs in its documentation of colorectal cancer screening process, we have simplified some of our common data elements. We refine operational definitions each year and expand the list of required elements to broaden the comprehensiveness and robustness of the pooled dataset. Also, the EMR does not systematically record patients' and providers' beliefs, intentions, or motivation for colorectal cancer screening; thus, we will not have information about those important variables. There are two limitations that affect generalizability of PROSPR colorectal cancer pooled dataset. We will have little data from patients living in rural areas. Data are from integrated systems, and their ability to coordinate services along the screening process may differ substantially from other practice models. Therefore, we encourage researchers with access to rural populations and different practice settings to use our conceptual model to collect similar data addressing research questions detailed above. PROSPR colorectal cancer investigators are interested in collaborating to broaden our collective understanding of colorectal cancer screening delivery. In accordance with the NIH's data sharing policy, we are currently creating a web portal to receive proposals from researchers interested in collaborating with PROSPR investigators and use the pooled data.

Analysis of patient-, provider-, practice-, and system-level factors that influence screening process outcomes is critical to inform the design and evaluation of multilevel interventions and policies to optimize delivery of colorectal cancer screening in healthcare systems serving diverse populations. The ultimate goal of the PROSPR consortium is to optimize screening delivery so that it is consistent with the Institute of Medicine's goals of effective, efficient, coordinated, timely, and safe health care (64).

S. Gupta has received commercial research support from Polymedco. No potential conflicts of interest were disclosed by the other authors.

Conception and design: J.A. Tiro, A. Kamineni, T.R. Levin, Y. Zheng, J.S. Schottinger, C.M. Rutter, C.S. Skinner, C.A. Doubeni, C. Klabunde

Development of methodology: J.A. Tiro, T.R. Levin, C.S. Skinner, C.A. Doubeni, E.A. Halm, C. Klabunde

Acquisition of data (provided animals, acquired and managed patients, provided facilities, etc.): J.A. Tiro, T.R. Levin, J.S. Schottinger, D.A. Corley, C.A. Doubeni

Analysis and interpretation of data (e.g., statistical analysis, biostatistics, computational analysis): J.A. Tiro, A. Kamineni, T.R. Levin, D.A. Corley, J. Chubak, E.A. Halm, C. Klabunde

Writing, review, and/or revision of the manuscript: J.A. Tiro, A. Kamineni, T.R. Levin, Y. Zheng, J.S. Schottinger, C.M. Rutter, D.A. Corley, C.S. Skinner, J. Chubak, C.A. Doubeni, E.A. Halm, S. Gupta, K.J. Wernli, C. Klabunde

Administrative, technical, or material support (i.e., reporting or organizing data, constructing databases): D.A. Corley, C.A. Doubeni

Study supervision: J.A. Tiro, C.S. Skinner, C. Klabunde

The authors thank Dr. Ann Geiger, Dr. Virginia Quinn, Dr. Nirupa Ghai, Dr. Christopher Jensen, Dr. Noel Santini, Katharine McCallister, Winifred Apraku, Adam Loewen, Arvind Ramaprasan, and Susan Carol Bradford for their assistance.

This research was funded by the NCI. J.A. Tiro, C.S. Skinner, E.A. Halm, and S. Gupta were supported by grant 5U54CA163308. A. Kamineni, C.M. Rutter, J. Chubak, and K.J. Wernli were supported by 5U54CA163261. T.R. Levin, J.S. Schottinger, D.A. Corley, and C.A. Doubeni were supported by 5U54CA163262. Y. Zheng was supported by 5U01CA163304.

1.
American Cancer Society
. 
Cancer facts & figures 2013
.
Atlanta, GA
:
American Cancer Society
; 
2013
.
2.
Shapiro
JA
,
Klabunde
CN
,
Thompson
TD
,
Nadel
MR
,
Seeff
LC
,
White
A
. 
Patterns of colorectal cancer test use, including CT colonography, in the 2010 National Health Interview Survey
.
Cancer Epidemiol Biomarkers Prev
2012
;
21
:
895
904
.
3.
Klabunde
CN
,
Cronin
KA
,
Breen
N
,
Waldron
WR
,
Ambs
AH
,
Nadel
MR
. 
Trends in colorectal cancer test use among vulnerable populations in the United States
.
Cancer Epidemiol Biomarkers Prev
2011
;
20
:
1611
21
.
4.
U.S. Preventive Services Task Force
. 
Screening for colorectal cancer: U.S. Preventive Services Task Force recommendation statement
.
Ann Intern Med
2008
;
149
:
627
38
.
5.
Levin
B
,
Lieberman
DA
,
McFarland
B
,
Andrews
KS
,
Brooks
D
,
Bond
J
, et al
Screening and surveillance for the early detection of colorectal cancer and adenomatous polyps, 2008: a joint guideline from the American Cancer Society, the US Multi-Society Task Force on Colorectal Cancer, and the American College of Radiology
.
Gastroenterology
2008
;
134
:
1570
95
.
6.
McFarland
EG
,
Levin
B
,
Lieberman
DA
,
Pickhardt
PJ
,
Johnson
CD
,
Glick
SN
, et al
Revised colorectal screening guidelines: joint effort of the American Cancer Society, U.S. Multisociety Task Force on Colorectal Cancer, and American College of Radiology
.
Radiology
2008
;
248
:
717
20
.
7.
Holden
DJ
,
Jonas
DE
,
Porterfield
DS
,
Reuland
D
,
Harris
R
. 
Systematic review: enhancing the use and quality of colorectal cancer screening
.
Ann Intern Med
2010
;
152
:
668
76
.
8.
Naylor
K
,
Ward
J
,
Polite
BN
. 
Interventions to improve care related to colorectal cancer among racial and ethnic minorities: a systematic review
.
J Gen Intern Med
2012
;
27
:
1033
46
.
9.
Taplin
SH
,
Rodgers
AB
. 
Toward improving the quality of cancer care: addressing the interfaces of primary and oncology-related subspecialty care
.
J Natl Cancer Inst Monogr
2010
;
2010
:
3
10
.
10.
Taplin
SH
,
Clauser
S
,
Rodgers
AB
,
Breslau
E
,
Rayson
D
. 
Interfaces across the cancer continuum offer opportunities to improve the process of care
.
J Natl Cancer Inst Monogr
2010
;
2010
:
104
10
.
11.
Taplin
SH
,
Anhang
PR
,
Edwards
HM
,
Foster
MK
,
Breslau
ES
,
Chollette
V
, et al
Introduction: understanding and influencing multilevel factors across the cancer care continuum
.
J Natl Cancer Inst Monogr
2012
;
2012
:
2
10
.
12.
Yano
EM
,
Green
LW
,
Glanz
K
,
Ayanian
JZ
,
Mittman
BS
,
Chollette
V
, et al
Implementation and spread of interventions into the multilevel context of routine practice and policy: implications for the cancer care continuum
.
JNCI Monographs
2012
;
2012
:
86
99
.
13.
Population-based Research Optimizing Screening through Personalized Regimens (PROSPR; RFA-CA-11-003) [Internet]
.
Bethesda, MD:
National Cancer Institute
;
[updated 2011 Oct 27; cited 2013 Jun 1]. Available from
: http://appliedresearch.cancer.gov/networks/prospr.
14.
Zapka
JG
,
Taplin
SH
,
Solberg
LI
,
Manos
MM
. 
A framework for improving the quality of cancer care: the case of breast and cervical cancer screening
.
Cancer Epidemiol Biomarkers Prev
2003
;
12
:
4
13
.
15.
Anhang
PR
,
Zapka
J
,
Edwards
H
,
Taplin
SH
. 
Organizational factors and the cancer screening process
.
J Natl Cancer Inst Monogr
2010
;
2010
:
38
57
.
16.
Zapka
J
,
Taplin
SH
,
Price
RA
,
Cranos
C
,
Yabroff
R
. 
Factors in quality care–the case of follow-up to abnormal cancer screening tests–problems in the steps and interfaces of care
.
J Natl Cancer Inst Monogr
2010
;
2010
:
58
71
.
17.
Nekhlyudov
L
,
Latosinsky
S
. 
The interface of primary and oncology specialty care: from symptoms to diagnosis
.
J Natl Cancer Inst Monogr
2010
;
2010
:
11
7
.
18.
Lieberman
DA
,
Rex
DK
,
Winawer
SJ
,
Giardiello
FM
,
Johnson
DA
,
Levin
TR
. 
Guidelines for colonoscopy surveillance after screening and polypectomy: a consensus update by the US Multi-Society Task Force on Colorectal Cancer
.
Gastroenterology
2012
;
143
:
844
57
.
19.
Lindor
NM
,
Petersen
GM
,
Hadley
DW
,
Kinney
AY
,
Miesfeldt
S
,
Lu
KH
, et al
Recommendations for the care of individuals with an inherited predisposition to Lynch syndrome: a systematic review
.
JAMA
2006
;
296
:
1507
17
.
20.
Sewitch
MJ
,
Jiang
M
,
Joseph
L
,
Hilsden
RJ
,
Bitton
A
. 
Developing model-based algorithms to identify screening colonoscopies using administrative health databases
.
BMC Med Inform Decis Mak
2013
;
13
:
45
.
21.
Sewitch
MJ
,
Stein
D
,
Joseph
L
,
Bitton
A
,
Hilsden
RJ
,
Rabeneck
L
, et al
Comparing patient and endoscopist perceptions of the colonoscopy indication
.
Can J Gastroenterol
2010
;
24
:
656
60
.
22.
Fisher
DA
,
Grubber
JM
,
Castor
JM
,
Coffman
CJ
. 
Ascertainment of colonoscopy indication using administrative data
.
Dig Dis Sci
2010
;
55
:
1721
5
.
23.
Weiss
NS
. 
Application of the case-control method in the evaluation of screening
.
Epidemiol Rev
1994
;
16
:
102
8
.
24.
Weiss
NS
. 
Analysis of case-control studies of the efficacy of screening for cancer: how should we deal with tests done in persons with symptoms?
Am J Epidemiol
1998
;
147
:
1099
102
.
25.
Church
TR
. 
Screening for colorectal cancer–which strategy is the best?
J Natl Cancer Inst
2011
;
103
:
1282
3
.
26.
Taplin
SH
,
Ichikawa
L
,
Yood
MU
,
Manos
MM
,
Geiger
AM
,
Weinmann
S
, et al
Reason for late-stage breast cancer: absence of screening or detection, or breakdown in follow-up?
J Natl Cancer Inst
2004
;
96
:
1518
27
.
27.
Leyden
WA
,
Manos
MM
,
Geiger
AM
,
Weinmann
S
,
Mouchawar
J
,
Bischoff
K
, et al
Cervical cancer in women with comprehensive health care access: attributable factors in the screening process
.
J Natl Cancer Inst
2005
;
97
:
675
83
.
28.
Fiscella
K
,
Humiston
S
,
Hendren
S
,
Winters
P
,
Jean-Pierre
P
,
Idris
A
, et al
Eliminating disparities in cancer screening and follow-up of abnormal results: what will it take?
J Health Care Poor Underserved
2011
;
22
:
83
100
.
29.
Zapka
J
. 
Innovative provider- and health system-directed approaches to improving colorectal cancer screening delivery
.
Med Care
2008
;
46
:
S62
7
.
30.
Zapka
J
,
Taplin
SH
,
Ganz
P
,
Grunfeld
E
,
Sterba
K
. 
Multilevel factors affecting quality: examples from the cancer care continuum
.
J Natl Cancer Inst Monogr
2012
;
2012
:
11
9
.
31.
Zapka
JM
,
Klabunde
CN
,
Arora
NK
,
Yuan
G
,
Smith
JL
,
Kobrin
SC
. 
Physicians' colorectal cancer screening discussion and recommendation patterns
.
Cancer Epidemiol Biomarkers Prev
2011
;
20
:
509
21
.
32.
Klabunde
CN
,
Lanier
D
,
Breslau
ES
,
Zapka
JG
,
Fletcher
RH
,
Ransohoff
DF
, et al
Improving colorectal cancer screening in primary care practice: innovative strategies and future directions
.
J Gen Intern Med
2007
;
22
:
1195
205
.
33.
Arroyave
AM
,
Penaranda
EK
,
Lewis
CL
. 
Organizational change: a way to increase colon, breast and cervical cancer screening in primary care practices
.
J Community Health
2011
;
36
:
281
8
.
34.
Haug
U
,
Brenner
H
. 
A simulation model for colorectal cancer screening: potential of stool tests with various performance characteristics compared with screening colonoscopy
.
Cancer Epidemiol Biomarkers Prev
2005
;
14
:
422
8
.
35.
Haug
U
,
Brenner
H
. 
New stool tests for colorectal cancer screening: a systematic review focusing on performance characteristics and practicalness
.
Int J Cancer
2005
;
117
:
169
76
.
36.
Edwards
BK
,
Ward
E
,
Kohler
BA
,
Eheman
C
,
Zauber
AG
,
Anderson
RN
, et al
Annual report to the nation on the status of cancer, 1975–2006, featuring colorectal cancer trends and impact of interventions (risk factors, screening, and treatment) to reduce future rates
.
Cancer
2010
;
116
:
544
73
.
37.
Zauber
AG
,
Lansdorp-Vogelaar
I
. 
Changes in risk factors and increases in screening contribute to the decline in colorectal cancer mortality, 1975 to 2000
.
Gastroenterology
2010
;
139
:
698
.
38.
van Ballegooijen
M
,
Boer
R
,
Zauber
AG
. 
Simulation of colorectal cancer screening: what we do and do not know and does it matter?
Best Pract Res Clin Gastroenterol
2010
;
24
:
427
37
.
39.
Zauber
AG
,
Lansdorp-Vogelaar
I
,
Knudsen
AB
,
Wilschut
J
,
van
BM
,
Kuntz
KM
. 
Evaluating test strategies for colorectal cancer screening: a decision analysis for the U.S. Preventive Services Task Force
.
Ann Intern Med
2008
;
149
:
659
69
.
40.
Levin
TR
,
Jamieson
L
,
Burley
DA
,
Reyes
J
,
Oehrli
M
,
Caldwell
C
. 
Organized colorectal cancer screening in integrated health care systems
.
Epidemiol Rev
2011
;
33
:
101
10
.
41.
Green
BB
,
Wang
CY
,
Anderson
ML
,
Chubak
J
,
Meenan
RT
,
Vernon
SW
, et al
An automated intervention with stepped increases in support to increase uptake of colorectal cancer screening: a randomized trial
.
Ann Intern Med
2013
;
158
:
301
11
.
42.
Gupta
S
,
Halm
EA
,
Rockey
DC
,
Hammons
M
,
Koch
M
,
Carter
E
, et al
Comparative effectiveness of fecal immunochemical test outreach, colonoscopy outreach, and usual care for boosting colorectal cancer screening among the underserved: a randomized clinical trial
.
JAMA Intern Med
2013
;
173
:
1725
32
.
43.
Colorectal Cancer Control Program [Internet]
.
Atlanta, GA:
Centers for Disease Control and Prevention (CDC)
;
[updated 2013 Nov 5; cited 2014 Feb 28]. Available from
: http://www.cdc.gov/cancer/crccp/.
44.
State and County QuickFacts [Internet]
.
Washington, DC:
U.S. Census Bureau
;
[updated 2009 Feb 20; cited 2014 Feb 28]. Available from
: http://quickfacts.census.gov/qfd/states/48000.html.
45.
Area Resource File (ARF): National County-level Health Resource Information Database [Internet]
.
Fairfax, VA:
Health Resources and Services Administration
;
[updated 2013 Jan 1; cited 2013 Oct 7]. Available from
: http://arf.hrsa.gov/.
46.
Health Professional Shortage Areas (HPSA) [Internet]
.
Rockville, MD
:
U.S. Department of Health and Human Services
;
[updated 2011 May 9; cited 2014 Feb 28]. Available from
: http://hpsafind.hrsa.gov/.
47.
Newhouse
JP
,
McClellan
M
. 
Econometrics in outcomes research: the use of instrumental variables
.
Annu Rev Public Health
1998
;
19
:
17
34
.
48.
Martens
EP
,
Pestman
WR
,
de
BA
,
Belitser
SV
,
Klungel
OH
. 
Instrumental variables: application and limitations
.
Epidemiology
2006
;
17
:
260
7
.
49.
Rosenbaum
PR
,
Rubin
DB
. 
The central role of the propensity score in observational studies for causal effects
.
Biometrika
1983
;
70
:
55
.
50.
Austin
PC
. 
An introduction to propensity score methods for reducing the effects of confounding in observational studies
.
Multivariate Behav Res
2011
;
46
:
399
424
.
51.
McIntosh
MW
. 
Instrumental variables when evaluating screening trials: estimating the benefit of detecting cancer by screening
.
Stat Med
1999
;
18
:
2775
94
.
52.
Jacob
BJ
,
Sutradhar
R
,
Moineddin
R
,
Baxter
NN
,
Urbach
DR
. 
Methodological approaches to population based research of screening procedures in the presence of selection bias and exposure measurement error: colonoscopy and colorectal cancer outcomes in Ontario
.
BMC Med Res Methodol
2013
;
13
:
59
.
53.
Kreft
I
,
De Leeuw
J
. 
Introducing multilevel modeling
.
Los Angeles, CA
:
Sage Publications
; 
1998
.
54.
Nekhlyudov
L
,
Greene
SM
,
Chubak
J
,
Rabin
B
,
Tuzzio
L
,
Rolnick
S
, et al
Cancer research network: using integrated healthcare delivery systems as platforms for cancer survivorship research
.
J Cancer Surviv
2013
;
7
:
55
62
.
55.
Steinwachs
D
,
Allen
JD
,
Barlow
WE
,
Duncan
RP
,
Egede
LE
,
Friedman
LS
, et al
National Institutes of Health state-of-the-science conference statement: enhancing use and quality of colorectal cancer screening
.
Ann Intern Med
2010
;
152
:
663
7
.
56.
Anderson
RJ
,
Amarasingham
R
,
Pickens
SS
. 
The quest for quality: perspectives from the safety net
.
Front Health Serv Manage
2007
;
23
:
15
28
.
57.
Pickens
S
,
Boumbulian
P
,
Anderson
RJ
,
Ross
S
,
Phillips
S
. 
Community-oriented primary care in action: a Dallas story
.
Am J Public Health
2002
;
92
:
1728
32
.
58.
Katz
MH
,
Brigham
TM
. 
Transforming a traditional safety net into a coordinated care system: lessons from healthy San Francisco
.
Health Aff
2011
;
30
:
237
45
.
59.
Ku
L
,
Regenstein
M
,
Shin
P
,
Mead
H
,
Levy
A
,
Buchanan
K
, et al
Coordinating and integrating care for safety net patients: lessons from six communities
.
Washington, D.C.
:
George Washington University
; 
2012
.
60.
Rural-Urban Community Area Codes (RUCAs) [Internet]
.
Seattle, WA
:
WWAMI Rural Health Research Center
;
[updated 2013 Jan 1; cited 2013 Oct 7]. Available from
: http://depts.washington.edu/uwruca/index.php.
61.
Rural-Urban Community Area Codes [Internet]
.
Washington, DC
:
US Department of Agriculture, Economic Research Service
;
[updated 2013 Jul 8; cited 2013 Oct 7]. Available from
: http://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes.aspx.
62.
Report to Congress: Medicare Ambulatory Surgical Center Value-Based Purchasing Implementation Plan [Internet]
.
Baltimore, MD
:
U.S. Department of Health and Human Services
;
[updated 2013 Apr 11; cited 2013 Oct 7]. Available from
: http://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/ASCPayment/Downloads/C_ASC_RTC-2011.pdf.
63.
Conditions for Coverage & Conditions of Participations [Internet]
.
Baltimore, MD
:
Centers for Medicare & Medicaid Services (CMS)
;
[updated 2013 May 11; cited 2013 Oct 7]. Available from
: http://www.cms.gov/Regulations-and-Guidance/Legislation/CFCsAndCoPs/index.html.
64.
Institute of Medicine
. 
Crossing the quality chasm: a new health system for the 21st century
.
Washington, D.C.
:
National Academy Press
; 
2001
.