Purpose: Cytotoxic T lymphocyte associated antigen (CTLA-4) blockade is being explored in numerous clinical trials as an immune-based therapy for different malignancies. Our group conducted the first preoperative clinical trial with the anti–CTLA-4 antibody ipilimumab in 12 patients with localized urothelial carcinoma of the bladder.

Experimental Design: Six patients were treated with 3 mg/kg/dose of anti–CTLA-4 and six patients were treated with 10 mg/kg/dose of antibody. Primary end points of the study were safety and immune monitoring.

Results: Most drug-related adverse events consisted of grade 1/2 toxicities. All patients had measurable immunologic pharmacodynamic effects, consisting of an increased frequency of CD4+ICOShi T cells in tumor tissues and the systemic circulation. To determine if CD4+ICOShi T cells could be a correlative marker for clinical outcome after treatment with anti–CTLA-4, a cohort of metastatic melanoma patients was studied retrospectively for frequency of CD4+ICOShi T cells and survival. Data from this small cohort of patients indicated that an increased frequency of CD4+ICOShi T cells, sustained over a period of 12 weeks of therapy, correlates with increased likelihood of clinical benefit consisting of overall survival.

Conclusions: Our trial shows that anti–CTLA-4 therapy has a tolerable safety profile in the presurgical setting and that a preoperative model can be used to obtain biological data on human immune responses, which can efficiently guide the monitoring of patients treated in the metastatic disease setting. Clin Cancer Res; 16(10); 2861–71. ©2010 AACR.

This article is featured in Highlights of This Issue, p. 2697

Translational Relevance

Antitumor responses, including durable complete regression of disease, have been observed in ∼10% of patients who receive anti–cytotoxic T lymphocyte associated antigen (CTLA-4) therapy. Why some patients respond to therapy whereas others do not remains unknown. Most clinical trials of CTLA-4 blockade have been conducted in the metastatic disease setting, which allows for correlation of treatment with clinic outcomes but not for detailed immunologic studies on tumor-infiltrating lymphocytes to evaluate how the antibody impacts human immune responses. To overcome this challenge we conducted the first preoperative trial with anti–CTLA-4. Our trial focused on safety as well as on identifying immunologic changes within the systemic circulation that correlated with those found in tumor tissues. We present data showing the safety of the presurgical trial and identification of a blood-based biomarker that reflects changes within tumor tissues, thus making it useful for immune monitoring in the metastatic disease setting, where access to tumor tissues is limited.

Cytotoxic T lymphocyte associated antigen (CTLA-4) plays a critical role in the regulation of T-cell activation (14). Blockade of CTLA-4 has led to enhanced T-cell activation in animal models (5, 6), and mechanistic studies have shown that animals treated with anti–CTLA-4 have an increased ratio of effector to regulatory T cells, which correlates with tumor regression (7). Moreover, the concept of CTLA-4 blockade, termed checkpoint blockade, has been used in the clinical setting and has shown promise in the induction of antitumor responses in patients with melanoma, prostate cancer, and lymphoma (815).

Prior clinical trials with anti–CTLA-4 therapy enrolled patients with metastatic disease, who rarely undergo surgical biopsies or procedures; therefore, there were limitations in accessing sufficient tumor tissues for phenotypic and functional immunologic studies. Laboratory studies from these prior trials focused primarily on assessing immune responses in peripheral blood; however, these studies have not led to the identification of immunologic markers that clearly correlate with clinical outcome. To circumvent these issues, we designed a clinical trial using anti–CTLA-4 in the preoperative setting so that we might obtain tumor tissues for immunologic studies and attempt to identify biomarkers in peripheral blood that might correlate with those in tumor tissues. The primary aim of our study was to establish the safety and feasibility of using anti–CTLA-4 in the preoperative setting.

Prior clinical trials reported adverse events associated with anti–CTLA-4 therapy consisting of tissue-specific inflammatory conditions termed immune-related adverse events (irAE), which have included dermatitis, hepatitis, colitis, pancreatitis, hypophysitis, inflammatory myopathy, and uveitis (1619). In our presurgical study, we found that anti–CTLA-4 had a tolerable safety profile without an increase in perioperative complications after a short course of antibody. We observed grade 1/2 rash and diarrhea as the most common drug-related side effects.

The overall purpose of our research effort was to examine the immunologic profile in peripheral blood and corresponding tumor tissues of treated patients to identify clinically useful biomarkers. We found that CTLA-4 blockade led to an increased frequency of CD4+ICOShi T cells in tumor tissues that could be correlated with an increased frequency of these cells in the peripheral blood.

Inducible costimulator (ICOS), a T cell–specific molecule that is a close homologue of CD28 and CTLA-4, has been predominantly thought of as a marker of T-cell activation associated with follicular helper T cells (2022). However, we previously showed that CD4+ICOShi T cells from peripheral blood samples (18) and tumor tissues (23) contained a population of cells that could produce IFN-γ and recognize the NY-ESO-1 tumor antigen. We now report that increases in CD4+ICOShi T cells were more pronounced after treatment with 10 mg/kg/dose of antibody, with concomitant increases in CD8+ICOShi T cells, which were not observed after treatment with 3 mg/kg/dose of antibody.

To determine if CD4+ICOShi T cells could be a correlative marker for clinical outcome after treatment with anti–CTLA-4, a cohort of metastatic melanoma patients was studied retrospectively for frequency of CD4+ICOShi T cells and survival. Data from this small cohort of patients indicated that an increased and sustained frequency of CD4+ICOShi T cells correlated with improved overall survival.

Bladder cancer patients

Patients with localized (T1-T2, N0, M0) urothelial carcinoma who were candidates for radical cystectomy were consented on a M.D. Anderson Cancer Center Institutional Review Board (IRB)-approved protocol (2006-0080) to receive two doses of anti–CTLA-4 antibody (ipilimumab) prior to undergoing surgery. Six patients completed analyses for safety at the 3 mg/kg/dose before six additional patients were enrolled to receive 10 mg/kg/dose. Surgery was scheduled on or about week 7 of the protocol. Healthy donor blood and additional tissue samples from untreated patients with localized urothelial carcinoma of the bladder were obtained for comparison as per an IRB-approved laboratory protocol (2005-0027).

Metastatic melanoma patients

Eligible patients had a diagnosis of unresectable stage III or metastatic/recurrent stage IV melanoma and had experienced progressive disease or intolerance to at least one prior systemic therapy. All pathology was confirmed at the Memorial Sloan-Kettering Cancer Center (MSKCC). Patients were ≥18 years of age, had normal hematologic and organ function, and an Eastern Cooperative Oncology Group status of 0 or 1. Exclusion criteria included any other prior invasive malignancy, autoimmune disease or active infection, or pregnant or lactating women. All patients signed an informed consent approved by the MSKCC IRB. Additional blood draws were obtained for investigational purposes after patients gave further informed consent. Healthy donors also provided blood samples after signing an informed consent form.

At baseline, patients underwent a complete history and physical examination, laboratory evaluation, and radiographic imaging appropriate for tumor evaluation. The same imaging modality was used for initial screening and posttherapy evaluation. Initial clinical responses were evaluated at week 12 and onward, and were adjudicated using modified WHO criteria.

Collection, preparation, and cryopreservation of peripheral blood mononuclear cells

Whole blood from patients was collected in Vacutainer or cell preparation tubes (CPT) containing sodium heparin (BD Vacutainer). Peripheral blood mononuclear cells (PBMC) were isolated from whole blood by centrifuging the CPT tubes at 800 g for 25 minutes. The plasma was collected and stored frozen at −80°C for subsequent cytokine detection experiments. The interface cells were harvested and washed twice with PBS with 10% FCS at 500 g and 450 g for 10 minutes, respectively. PBMCs were then resuspended in complete RPMI 1640 with 10% autologous plasma or pooled human serum and 10% DMSO.

ICOS and FOXP3 phenotype staining

One million PBMCs were washed with 2 mL FACS buffer (PBS containing 1% bovine serum albumin and 0.05 mmol/L EDTA). The cells were resuspended in 50 μL FACS buffer and stained with 0.375 μL ICOS-biotin antibody (eBioscience) for 20 minutes at 4°C before washing again with 2 mL FACS buffer. The following antibodies were then added for 30 minutes at room temperature: 0.3 μL strepavidin-phycoerythrin-Cy7 (eBioscience), 3 μL CD3-Pacific Blue (eBioscience), 1 μL CD4-ECD (Beckman Coulter Inc.), and 3 μL CD25-APC-Cy (BD Bioscience). After rewashing with FACS buffer, the cells were fixed and permeabilized with 250 μL 1 × fixation/permeabilization solution (eBioscience) for 30 minutes at 4°C before being washed with 2 mL 1 × permeabilization buffer (eBioscience). Five microliters of FOXP3-APC antibody (eBioscience) were then added for 60 minutes at 4°C before a final washing with 1 × permeabilization buffer. The cells were then resuspended in 400 μL FACS buffer and acquired on a CyAn ADP flow cytometer with Summit software (DakoCytomation California Inc.). Analysis was done using FlowJo software (version 8.1, TreeStar, Inc.). Isotype controls included the appropriate biotin or fluorochrome conjugated mouse IgG1a or IgG2a (Dako).

Immunohistochemistry

Tissue was obtained from untreated urothelial carcinoma specimens, as well as from patient specimens after treatment with either 3 mg/kg of ipilimumab or 10 mg/kg of ipilimumab. After standard fixation, paraffin-embedded samples were stained with H&E, as well as with antibodies for CD3 (Dako), CD4 (Novocastra, Leica Microsystems), CD8 (Labvision), granzyme B (Cell Sciences), CD20 (Dako), and CD56 (Invitrogen).

Fluorescence in situ hybridization

Fluorescence in situ hybridization (FISH) of cells recovered from voided urine/urinary tract washings was done using the Vysis UroVysion Kit, 4-color probe mixture of DNA sequences from specific regions of chromosomes 3 (D3Z1), 7 (D7Z1), 17 (D17Z1), and 9p21 (p16). A positive result is defined as the detection of four or more cells with greater than two signals (polysomy) for at least two probes for chromosomes 3, 7, 17, or 9p21, and/or 12 cells with no signal for chromosome 9. The UroVysion Kit is designed and has been cleared by the Food and Drug Administration to detect aneuploidy for chromosomes 3, 7, and 17, and loss of 9p21 locus in transitional cell carcinoma urine specimens.

Statistical analyses

Comparisons between groups were made using Wilcoxon's rank test. Survival was analyzed by the Kaplan-Meier method. Correlation was analyzed using Spearman's rank test.

Study population characteristics

The study population consisted of 12 patients (10 males and 2 females) with localized urothelial carcinoma of the bladder who provided informed consent to participate in an IRB-approved clinical trial in which the anti–CTLA-4 antibody ipilimumab was administered in the preoperative setting. All patients were candidates for radical cystectomy as treatment for their disease. Table 1 details the demographics and patient characteristics. Patients had pT1-T2 urothelial carcinoma, high grade, as observed on initial biopsies (Supplementary Table S1). Pretherapy and posttherapy blood samples as well as surgical samples were obtained as per protocol (Supplementary Fig. S1).

Table 1.

Clinical characteristics of patients with localized urothelial carcinoma who received anti–CTLA-4

PatientSexAge (y)Prior therapyAdjuvant therapyDrug-related irAEsSurgery delay (wk)Follow-up (mo)Status
66 BCG None Rash, Gr 1; Diarrhea, Gr 1 None 33.37 NED Alive 
75 None Cis, Gem, Ifos chemo None 5.1 (due to cardiac eval) 32.67 NED Alive 
71 BCG None Amylase and lipase increased, Gr 2 None 28.83 NED Alive 
Uveitis, Gr 2; diarrhea, Gr 1ischemic papillitis, Gr 3; 
60 None MVAC chemo Rash, Gr 1 None 27.3 NED Alive 
55 None None Rash, Gr 1; Pruritis, Gr 1 None 24.9 NED Alive 
75 BCG None Rash, Gr 2; Pruritis, Gr 2 None 23.1 NED Alive 
76 None None Rash, Gr 1 None 7.7 NED Deceased 
Testicular swelling/Epididymitis, Gr 2 
69 None None Rash, Gr 1 4.0 (due to irAE) 17.5 NED Alive 
Transaminitis, Gr 3 
Diarrhea, Gr 2 
63 None None Diarrhea, Gr 2 None 17.03 NED Alive 
10 68 None None Diarrhea, Gr 3 (received only one dose of antibody) 10.3 (due to irAE and cardiac and GI eval) 12.23 NED Alive 
11 71 BCG Ifos-Adria-Gem chemo Rash, Gr 1; Pruritis, Gr 1; Elavated AST, Gr 1;Diarrhea, Gr 3 N/A* 9.27 Metastatic disease Alive 
12 66 None Gem-Cis chemo Diarrhea, Gr 2 None 8.33 Metastatic disease Alive 
PatientSexAge (y)Prior therapyAdjuvant therapyDrug-related irAEsSurgery delay (wk)Follow-up (mo)Status
66 BCG None Rash, Gr 1; Diarrhea, Gr 1 None 33.37 NED Alive 
75 None Cis, Gem, Ifos chemo None 5.1 (due to cardiac eval) 32.67 NED Alive 
71 BCG None Amylase and lipase increased, Gr 2 None 28.83 NED Alive 
Uveitis, Gr 2; diarrhea, Gr 1ischemic papillitis, Gr 3; 
60 None MVAC chemo Rash, Gr 1 None 27.3 NED Alive 
55 None None Rash, Gr 1; Pruritis, Gr 1 None 24.9 NED Alive 
75 BCG None Rash, Gr 2; Pruritis, Gr 2 None 23.1 NED Alive 
76 None None Rash, Gr 1 None 7.7 NED Deceased 
Testicular swelling/Epididymitis, Gr 2 
69 None None Rash, Gr 1 4.0 (due to irAE) 17.5 NED Alive 
Transaminitis, Gr 3 
Diarrhea, Gr 2 
63 None None Diarrhea, Gr 2 None 17.03 NED Alive 
10 68 None None Diarrhea, Gr 3 (received only one dose of antibody) 10.3 (due to irAE and cardiac and GI eval) 12.23 NED Alive 
11 71 BCG Ifos-Adria-Gem chemo Rash, Gr 1; Pruritis, Gr 1; Elavated AST, Gr 1;Diarrhea, Gr 3 N/A* 9.27 Metastatic disease Alive 
12 66 None Gem-Cis chemo Diarrhea, Gr 2 None 8.33 Metastatic disease Alive 

Abbreviations: UC, urothelial carcinoma; Dx, disease; BCG, bacillus Calmette-Guerin given as intravesical therapy; Cis, cisplatin; Gem, gemcitabine; Ifos, ifosfamide; MVAC, methotrexate, vinblastine, adriamycin, cisplatin; Adria, adriamycin; NED, no evidence of disease; irAE, immune-related adverse event; GI, gastrointestinal; Gr, grade.

* Surgery cancelled.

Surgical delays

The initial cohort of six patients received 3 mg/kg/dose of ipilimumab for two doses, with a 3-week interval between doses, and were scheduled for surgery 4 weeks after the last dose of antibody. In this cohort, one patient had a delay in surgery due to preoperative cardiac workup, but there were no significant surgical delays due to irAEs in the 3 mg/kg/dose cohort (Table 1).

A second cohort of six patients received 10 mg/kg/dose of antibody for one (n = 1) or two doses (n = 5) prior to surgery. Surgical delays occurred in two cases as a result of development of irAEs. One patient (patient 8; Table 1) had a 4-week delay due to grade 2 diarrhea that occurred after the second dose of antibody and subsequently resolved with steroid therapy. Another patient (patient 10; Table 1) had a 10-week delay due to multiple factors, including grade 3 diarrhea after the first dose of antibody, which subsequently resolved with steroid therapy, as well as preoperative cardiac and gastrointestinal workup that were necessary due to multiple prior abdominal surgeries. A third patient (patient 11; Table 1) in the 10 mg/kg/dose cohort had an initial delay in surgical planning due to grade 3 diarrhea, which resolved with steroid therapy, but this patient did not undergo surgery due to enlarging pulmonary nodules on computed tomographic (CT) scans with subsequent biopsy indicating metastatic disease.

Safety profile and adverse events

Grade 1/2 adverse events at 3 mg/kg dosing consisted of four cases of rash, two episode of diarrhea, one episode of uveitis, and one episode of increased amylase and lipase, suggestive of pancreatitis but without clinical symptoms (Table 1). The four cases of rash occurred in four separate patients and resolved with symptomatic treatment consisting of diphenhydramine and topical hydrocortisone. An episodes of diarrhea, increased amylase/lipase, and uveitis all occurred in the same patient (patient 3; Table 1). Patient 3 was also the only patient to develop a grade 3 irAE after treatment with two doses of antibody at 3 mg/kg/dose. This patient developed a grade 3 irAE consisting of ischemic papillopathy and optic neuritis, which resulted in a loss of vision and required treatment with high dose i.v. steroids, as well as brief courses of infliximab and mycophenolate mofetil for immune suppression (19). The patient's visual acuity subsequently returned to 20/20 on the right and 20/25 on the left. Of note, this patient's irAE was associated with a high pretherapy level of the Th2 cytokine interleukin-10, which decreased after treatment with anti–CTLA-4 (19).

Grade 1/2 drug-related adverse events at the 10 mg/kg dosing consisted of three cases of rash, one episode of testicular swelling/orchitis, and three cases of diarrhea. Grade 3 drug-related adverse events at the 10 mg/kg dose level consisted of two episodes of diarrhea and one case of elevated transaminases without clinical symptoms. These events were deemed to be irAEs and were treated with i.v. and/or oral steroids.

One patient (patient 10; Table 1) developed grade 3 diarrhea after the first dose of ipilimumab and, as per protocol, did not receive a second dose of antibody. After treatment with i.v. and oral systemic steroids, the patient's diarrhea resolved. The patient eventually proceeded to surgery after a 10-week delay, due to multiple factors, including the occurrence of grade 3 diarrhea. The final pathology after surgery revealed no evidence of disease within the specimen. The patient remains without any evidence of disease on postoperative CT scans.

Another patient (patient 11; Table 1) had grade 3 diarrhea that lasted approximately 9 weeks after receiving the second dose of antibody. His diarrhea also resolved after treatment with i.v. and oral systemic steroids; however, the patient's surgery was aborted due to the presence of metastatic disease. This patient was noted to have subcentimeter pulmonary nodules on baseline CT scans, which prompted repeat imaging studies one month later, prior to the patient enrolling in the anti–CTLA-4 study. Repeat CT scans indicated stable number and size of pulmonary nodules, which were thought to be benign, and the patient was deemed eligible for the preoperative clinical trial protocol with anti–CTLA-4. Unfortunately, on repeat CTs that were completed after the administration of two doses of anti–CTLA-4 at 10 mg/kg/dose as per protocol, the patient was found to have enlarging pulmonary nodules consistent with metastatic disease.

One other patient (patient 12) was found to have metastatic disease. The patient completed both doses of anti–CTLA-4 therapy at 10 mg/kg/dose and proceeded to surgery (Table 1). The patient's surgical pathology revealed urothelial carcinoma with sarcomatoid and micropapillary components. Pathology also revealed metastatic disease within lymph nodes removed at the time of surgery (Supplementary Table S1). Postoperative follow-up CT scans indicated new metastatic disease in the lungs, and the patient was started on systemic chemotherapy.

Postoperative complications that occurred on study, but were not thought to be attributable to anti–CTLA-4, included wound dehiscence as well as enterocutaneous fistula in one patient who had multiple prior abdominal surgeries (patient 10) and urinary tract infections in five patients. One patient, who completed the clinical trial and who was without any evidence of disease on postoperative CT scans, subsequently died due to causes that were not related to malignancy or anti–CTLA-4. Drug-related grade 4 adverse events or death did not occur as a result of CTLA-4 blockade in this clinical trial. In total, all 12 patients received at least one dose of antibody, with 11 of 12 patients receiving both doses of antibody; 11 patients completed surgery, 4 patients did not have any evidence of disease noted on the surgical pathology sample, and 10 patients remained disease free during the follow-up period after surgery.

Surgical pathology and urine cytology

Surgical pathology was evaluated from transurethral resections obtained prior to anti–CTLA-4 and in radical cystectomy specimens obtained after treatment with anti–CTLA-4. Eight patients were found to have a lower stage of disease on their surgical specimen obtained after anti–CTLA-4 administration as compared with transurethral resection specimens obtained prior to anti–CTLA-4. Because transurethral resection of disease may have accounted for this downstaging effect, we also assessed urine samples for malignant cells by cytology and chromosomal abnormalities associated with urothelial carcinoma by FISH (Supplementary Table S1). Urine cytology and FISH analyses of urine samples from treated patients were done after transurethral resections but prior to anti–CTLA-4 (baseline sample) and after antibody treatment (posttherapy sample), without any other intervention between the baseline and posttherapy analyses. We found that four patients showed a change from a positive urine cytology and/or FISH analysis to negative urine cytology and/or FISH analysis after treatment with anti–CTLA-4 (Supplementary Table S1). These data suggest that treatment with anti–CTLA-4 antibody leads to a therapeutic effect in the setting of urothelial carcinoma, which will need to be explored in future clinical studies.

Increased ICOS expression is detected on CD4 and CD8 T cells after treatment with 10 mg/kg/dose of anti–CTLA-4 antibody

We previously analyzed tumor tissues and peripheral blood of patients treated with anti–CTLA-4 at 3 mg/kg/dose for immunologic changes that might correlate with administration of anti–CTLA-4 antibody. Markers such as CD4, CD8, HLA-DR, CD69, and CD45RO and CD45RA were monitored, but showed no consistent change in tumor tissues after treatment. However, a homolog of CD28 and CTLA-4 known as ICOS was found to have increased expression on CD4 T cells within tumor tissues after treatment with anti–CTLA-4 antibody. These cells were shown to contain a population of effector T cells that recognized the tumor-associated antigen NY-ESO-1. Peripheral blood samples from patients treated with 3 mg/kg/dose of antibody also showed a 2- to 7-fold increase in CD4+ICOShi T cells (18). CD4+ICOShi T cells from posttherapy peripheral blood samples were shown to produce higher levels of IFN-γ than did CD4+ICOSlow T cells or T cells from pretherapy blood samples (18). In addition, CD4+ICOShi T cells from posttherapy blood samples were capable of recognizing the NY-ESO-1 tumor antigen expressed on the tumors samples of three patients (18).The increased frequency of CD4+ICOShi T cells, which consisted of a population of effector T cells, was provocative as an immunologic marker that could be used for immune monitoring of patients treated with anti–CTLA4 therapy.

At 10 mg/kg/dose of antibody, CD4+ICOShi T cells were similarly increased in tumor tissues; in addition, CD8+ICOShi T cells were detectable in tumor tissues (Fig. 1A), which were not detected in tumor samples from untreated patients or patients treated with 3 mg/kg/dose of antibody. Figure 1B shows that the frequencies of CD4+ICOShi and CD8+ICOShi T cells were significantly higher in tumor tissues (P = 0.004 and P = 0.002, respectively) after treatment with anti–CTLA-4 (n = 5) as compared with untreated tumor tissues (n = 10). Furthermore, 2 of 5 tumor samples showed increased infiltrating cells into blood vessels after patients received treatment with 10 mg/kg/dose of anti–CTLA-4 antibody as compared with 0 of 11 tumor samples obtained prior to therapy and 0 of 6 patients who received treatment with 3 mg/kg/dose of antibody (Fig. 2, top). The infiltrating cells were positive for CD3, CD8, CD4, and granzyme, but were predominantly negative for CD20 and CD56 staining (Fig. 2, bottom).

Fig. 1.

Increased frequency of CD4+ICOShi and CD8+ICOShi T cells in tumor tissues after treatment with 10 mg/kg/dose of anti–CTLA-4. A, representative patient samples showing that CD4+ICOShi (top) and CD8+ICOShi (bottom) T cells were increased in frequency in tumor tissues after treatment with 10 mg/kg/dose of anti–CTLA-4 as compared with untreated tumor tissues. B, compilation of data showing statistically significant increased frequencies of CD4+ICOShi and CD8+ICOShi T cells in tumor tissues from anti–CTLA-4 treated patients (n = 5) as compared with tumor tissues obtained from untreated patients (n = 10).

Fig. 1.

Increased frequency of CD4+ICOShi and CD8+ICOShi T cells in tumor tissues after treatment with 10 mg/kg/dose of anti–CTLA-4. A, representative patient samples showing that CD4+ICOShi (top) and CD8+ICOShi (bottom) T cells were increased in frequency in tumor tissues after treatment with 10 mg/kg/dose of anti–CTLA-4 as compared with untreated tumor tissues. B, compilation of data showing statistically significant increased frequencies of CD4+ICOShi and CD8+ICOShi T cells in tumor tissues from anti–CTLA-4 treated patients (n = 5) as compared with tumor tissues obtained from untreated patients (n = 10).

Close modal
Fig. 2.

Perivascular infiltration of cells into tumor tissues after treatment with 10 mg/kg/dose of anti–CTLA-4. Representative pictures showing an absence of perivascular infiltration of cells in untreated tumor tissues (0 of 11) and tumor tissues obtained from patients treated with 3 mg/kg/dose of anti–CTLA-4 (0 of 6) as compared with the presence of perivascular infiltration noted in tumor tissues obtained from patients treated with anti–CTLA-4 at 10 mg/kg/dose (2 of 5; top). Immunohistochemistry revealed that the infiltrating cells were positive for CD3, CD8, CD4, and granzyme, but were predominantly negative for CD20 and CD56 (bottom).

Fig. 2.

Perivascular infiltration of cells into tumor tissues after treatment with 10 mg/kg/dose of anti–CTLA-4. Representative pictures showing an absence of perivascular infiltration of cells in untreated tumor tissues (0 of 11) and tumor tissues obtained from patients treated with 3 mg/kg/dose of anti–CTLA-4 (0 of 6) as compared with the presence of perivascular infiltration noted in tumor tissues obtained from patients treated with anti–CTLA-4 at 10 mg/kg/dose (2 of 5; top). Immunohistochemistry revealed that the infiltrating cells were positive for CD3, CD8, CD4, and granzyme, but were predominantly negative for CD20 and CD56 (bottom).

Close modal

Within peripheral blood samples, we observed an approximately 5- to 10-fold increase in CD4+ICOShi T cells (Fig. 3A, top), which was approximately 2-fold higher than that seen with the 3 mg/kg/dose of antibody (18). Samples from patient 9 (Table 1) showed an increase in CD4+ICOShi T cells from 3% at baseline to 10% at week 3 (after dose 1) and 40% at week 7 (after dose 2). Similarly, at 10 mg/kg/dose of antibody we observed an increase in the frequency of CD8+ICOShi T cells within the systemic circulation (Fig. 3A, bottom), which was not detectable after patients received treatment with 3 mg/kg/dose of antibody. The data for all six patients treated with anti–CTLA-4 at 10 mg/kg/dose are provided in Fig. 3B and C for frequency of CD4+ICOShi (Fig. 3B) and CD8+ICOShi T cells (Fig. 3C) at pretherapy, posttherapy week 3, and posttherapy week 7 time points. As shown, there is no statistical difference between CD4+ICOShi and CD8+ICOShi T cell average frequencies in healthy donors (HD; n = 10) as compared with pretherapy values from the bladder cancer patients (n = 6); however, after treatment with anti–CTLA-4 at 10 mg/kg/dose there was a statistically significant increase in CD4+ICOShi (Fig. 3B; P = 0.036 at weeks 3 and 7 as compared with pretherapy values) and CD8+ICOShi T cells (Fig. 3C; P = 0.031 and 0.036 at weeks 3 and 7, respectively, as compared with pretherapy values).

Fig. 3.

Increased frequency of CD4+ICOShi and CD8+ICOShi T cells in the peripheral blood after treatment with 10 mg/kg/dose of anti–CTLA-4. A, representative peripheral blood samples taken after the first dose of anti–CTLA-4 at week 3 and after the second dose of anti–CTLA-4 at week 7 showed an increased frequency of CD4+ICOShi (top) and CD8+ICOShi T cells (bottom) as compared with baseline (pretherapy) samples. Compilation of data showing pretherapy values for frequency of CD4+ICOShi T cells (B) and CD8+ICOShi T cells (C) in bladder cancer patients (n = 6) and average frequency in healthy donors (HD; n = 10) with statistically significant increases in frequencies of ICOShi T cells at weeks 3 and 7 after treatment with anti–CTLA-4.

Fig. 3.

Increased frequency of CD4+ICOShi and CD8+ICOShi T cells in the peripheral blood after treatment with 10 mg/kg/dose of anti–CTLA-4. A, representative peripheral blood samples taken after the first dose of anti–CTLA-4 at week 3 and after the second dose of anti–CTLA-4 at week 7 showed an increased frequency of CD4+ICOShi (top) and CD8+ICOShi T cells (bottom) as compared with baseline (pretherapy) samples. Compilation of data showing pretherapy values for frequency of CD4+ICOShi T cells (B) and CD8+ICOShi T cells (C) in bladder cancer patients (n = 6) and average frequency in healthy donors (HD; n = 10) with statistically significant increases in frequencies of ICOShi T cells at weeks 3 and 7 after treatment with anti–CTLA-4.

Close modal

Correlation of frequency of CD4+ICOShi T cells with clinical benefit in a cohort of metastatic melanoma patients

We carried out multiparametric flow cytometric analyses on fresh PBMC samples from healthy donors and a group of 14 melanoma patients prior to and at various time points after anti–CTLA-4 therapy (ipilimumab) at 10 mg/kg/dose of antibody. We also analyzed frozen PBMC samples from control patients with advanced melanoma who received other treatments. Of note, we did not notice significant differences in ICOS expression on T cells from frozen samples as compared with fresh samples (Supplementary Fig. S2). Healthy donors, control melanoma patients, and the 14 melanoma patients prior to anti–CTLA-4 therapy all had low but detectable expression of CD4+ICOShi cells of approximately 2% to 3% of the CD4+ population. There was no significant difference between each of these groups. Following therapy with anti–CTLA-4, the majority of patients had an increase in frequency of CD4+ICOShi T cells at weeks 7 (P = 0.0012) and 12 (P = 0.0006) following dose 2 and dose 4 of anti–CTLA-4 antibody, respectively, compared with baseline values (Fig. 4A and B). By week 24, the frequency of CD4+ICOShi T cells had returned to approximately the baseline values.

Fig. 4.

Increased frequency of CD4+ICOShi T cells is detected after patients with metastatic melanoma are treated with anti–CTLA-4. A, representative dot plot of ICOS staining in a melanoma patient at baseline and after anti–CTLA-4 therapy, as well as the mouse IgG1 isotype control. B, all samples analyzed for % CD4+ICOShi expression in the different donor and patient groups at different time points. HD, healthy donor; Mel-Pt, control melanoma patients; Pre-tx, pretreatment; SAV, streptavidin.

Fig. 4.

Increased frequency of CD4+ICOShi T cells is detected after patients with metastatic melanoma are treated with anti–CTLA-4. A, representative dot plot of ICOS staining in a melanoma patient at baseline and after anti–CTLA-4 therapy, as well as the mouse IgG1 isotype control. B, all samples analyzed for % CD4+ICOShi expression in the different donor and patient groups at different time points. HD, healthy donor; Mel-Pt, control melanoma patients; Pre-tx, pretreatment; SAV, streptavidin.

Close modal

In addition, we also examined FOXP3 expression in CD4+ cells for the above groups of donors and patients as a marker of regulatory T cells. The data are shown in Supplementary Fig. S3A and B. Healthy donors and control melanoma patients had relatively low frequency of CD4+FOXP3+ T cells, averaging 2% to 3%. Our cohort of 14 anti–CTLA-4 treated patients had a frequency of CD4+FOXP3+ T cells of approximately 5% at baseline, which was not statistically different from what was observed in the healthy donor and control melanoma patient samples. The frequency of CD4+FOXP3+ T cells did not change during weeks 7 and 12 of anti–CTLA-4 therapy. By week 24, the frequency of CD4+FOXP3+ T cells had decreased to levels approximating those of the healthy donors and control melanoma patients. We also assessed coexpression of ICOS and FOXP3 in CD4 T cells. We noted that <20% of the CD4+ICOShi population was FOXP3+ (Supplementary Fig. S3C). A similar proportion of CD4+FOXP3+ cells were ICOShi (Supplementary Fig. S3D), suggesting that only a minority of cells was positive for both markers after treatment with anti–CTLA-4 therapy, as previously reported for patients with urothelial carcinoma (18).

We then correlated changes in ICOS expression in the 14 treated patients with clinical outcome. Specifically, we examined changes in the CD4+ICOShi expression from baseline to weeks 7 and 12 of anti–CTLA-4 therapy. Eight of 14 patients (IDs 5, 8, 9, 10, 11, 12, 13, and 14) were noted to have a persistent increase in CD4+ICOShi expression, defined as a ≥2-fold increase in % CD4+ICOShi expression at week 7 or 12 over baseline that was sustained at week 12. The other six patients (IDs 1, 2, 3, 4, 6, and 7) either had a <2-fold increase in CD4+ICOShi expression at either week 7 or 12 over baseline or had a ≥2-fold increase in CD4+ICOShi expression at week 7 that had declined by week 12 from the week 7 value. Of the eight patients with persistent increase in CD4+ICOShi expression, seven had evidence of clinical benefit at week 24 consisting of stable disease for six months, partial responses, and complete responses as defined by immune-related response criteria (Fig. 5A; ref. 24). Of the six patients without persistent increase in CD4+ICOShi expression, none had evidence of clinical benefit at week 24 (Fig. 5A). The proportion of patients with persistent CD4+ICOShi increase who had clinical benefit at week 24 was significantly higher than those without persistent CD4+ICOShi expression (P = 0.004).

Fig. 5.

Correlation of clinical outcome with frequency of CD4+ICOShi T cells after patients were treated with anti–CTLA-4. A, multiparameter flow cytometric analyses were done on fresh patient PBMCs at baseline, and on weeks 7 and 12. Seven of seven patients with clinical benefit at week 24 had persistent elevation in % of CD4+ICOShi cells, defined as a ≥2-fold increase in % CD4+ICOShi expression at week 7 or 12 over baseline that was sustained at week 12. In comparison, one of seven patients without clinical benefit, i.e., with progressive disease or death at week 24, had persistent elevation in % of CD4+ICOShi cells (*). B, Kaplan-Meier curve showing the difference in overall survival for patients with and without persistent % CD4+ICOShi increase is statistically significant (median overall survival not reached versus 27 weeks, P = 0.03).

Fig. 5.

Correlation of clinical outcome with frequency of CD4+ICOShi T cells after patients were treated with anti–CTLA-4. A, multiparameter flow cytometric analyses were done on fresh patient PBMCs at baseline, and on weeks 7 and 12. Seven of seven patients with clinical benefit at week 24 had persistent elevation in % of CD4+ICOShi cells, defined as a ≥2-fold increase in % CD4+ICOShi expression at week 7 or 12 over baseline that was sustained at week 12. In comparison, one of seven patients without clinical benefit, i.e., with progressive disease or death at week 24, had persistent elevation in % of CD4+ICOShi cells (*). B, Kaplan-Meier curve showing the difference in overall survival for patients with and without persistent % CD4+ICOShi increase is statistically significant (median overall survival not reached versus 27 weeks, P = 0.03).

Close modal

We also examined the correlation between the absolute number of CD4+ICOShi cells and clinical benefit and found that a similar trend existed. A persistent increase in the absolute number of CD4+ICOShi cells was defined as a ≥2-fold increase in the number of CD4+ICOShi cells at week 7 or 12 over baseline that was sustained at week 12. Eight of the 14 patients had a persistent increase in the number of CD4+ICOShi cells. Of these, seven had clinical benefit at week 24. Again, the proportion of patients with persistent increase in CD4+ICOShi cell number who had clinical benefit at week 24 was significantly higher than those without persistent CD4+ICOShi increase (P = 0.03).

Finally, we noted a statistically significant difference in overall survival when the data were stratified by persistent versus nonpersistent % CD4+ICOShi increase (median overall survival not reached versus 27 weeks; P = 0.03). A Kaplan-Meier survival curve is shown in Fig. 5B.

We determined the immunodulatory effects following a brief exposure of anti–CTLA-4 in patients with urothelial carcinoma of the bladder requiring surgery. This study, to our knowledge, is the first analysis of CTLA-4 blockade in the setting of urothelial carcinoma and in the setting of a presurgical clinical trial. The study population consisted of 12 patients, with 6 patients receiving 3 mg/kg/dose of anti–CTLA-4 and another 6 patients receiving 10 mg/kg/dose for two doses prior to surgery. The treatment was found to be tolerable in our cohort of patients with 11 of 12 patients receiving both doses of antibody. Grade 1-2 diarrhea and rash were the most common drug-related side effects. Of relevance, the only noted grade 3 irAEs were ischemic papillopathy and diarrhea, which were both responsive to treatment with steroids. Patients have been followed for a median of 20 months with 9 of 12 patients continuing to remain without evidence of disease. In addition, the preoperative approach in this study overcomes a major hindrance of biological studies, in that it provides for analyses of tumor tissues. The availability of cystectomy specimens provided sufficient tissue to carry out detailed immunologic analyses, which could be correlated with biomarkers in peripheral blood.

Data from our preliminary results on the first six patients treated with 3 mg/kg/dose of anti–CTLA-4, as well as the current analyses on the six patients treated at 10 mg/kg/dose showed that treatment with anti–CTLA-4 antibody leads to an increase in the frequency of CD4+ICOShi cells, which comprise a population of effector T cells. This population of CD4+ICOShi cells, which was found to be increased in both tumor tissues and peripheral blood, represents a potential biomarker that could be used for correlation with clinical outcome in patients with metastatic disease who receive treatment with anti–CTLA-4. A retrospective analyses of peripheral blood samples obtained from patients with metastatic melanoma who were treated with anti–CTLA-4 antibody at 10 mg/kg/dose showed that a sustained increase in CD4+ICOShi T cells at week 12, after four doses of therapy, correlated with improved overall survival.

Our clinical trial does have limitations. The analyses of untreated bladder tumor tissues were done on samples obtained from a separate group of patients because cystectomy samples consisting of the entire bladder were necessary to obtain sufficient numbers of cells for immunologic analyses. Therefore, specimens from stage-matched untreated patients were utilized for comparison in flow cytometry studies. This does allow for confounders in that we could not account for unknown factors that may impact our data. The general trend in the group of patients suggests that although there may be unknown factors that could account for differences between patients in the two separate groups, the increased frequency of CD4+ICOShi cells after treatment serves as a marker of CTLA-4 blockade that supersedes minor contributions from unknown variables. Another limitation is that our small sample size limits the statistical power of the immunologic correlates. More patients will need to be analyzed in larger studies.

In our current study, we report that anti–CTLA-4 is tolerable in the preoperative setting, which provides an opportunity to obtain immunologic data from both tumor tissues and the peripheral blood. Our data, consisting of an increased frequency of CD4+ICOShi T cells, were obtained in a cohort of patients with localized urothelial carcinoma of the bladder but nonetheless may be relevant in patients with other types and stages of malignancies, such as metastatic melanoma, as we report here. Our data support the concept that a sustained increased frequency of CD4+ICOShi T cells may serve as a biomarker of anti–CTLA-4 activity and/or of clinical benefit for patients who are being treated with this novel agent. We have shown that anti–CTLA-4 can induce similar immunologic changes in patients with different types of malignancies and in different tumor tissues (25). Future studies with additional patients will need to be conducted to validate CD4+ICOShi T cells as a biomarker to optimize anti–CTLA-4 therapy and/or indicate potential clinical benefit thus warranting continued therapy.

Ours are the first studies to show alterations in ICOS expression on T cells during antitumor responses. It is of considerable interest to determine the role of ICOS and its interactions with its ligand in these responses. ICOS is expressed on both effector and regulatory T cells and has a very complex biology, having been variously implicated in T/B-cell interactions, germinal center formation, and regulation of Th1 and Th2 cytokines (2628). A key fact may be that it has the potential to signal via the PI3 kinase pathway and may enhance T-cell survival. Mechanistic studies are ongoing to understand how the ICOS pathway affects antitumor responses.

In summary, we have shown that anti–CTLA-4 can be delivered in the preoperative setting without an increase in surgical complication. The previously reported toxicities associated with anti–CTLA 4 therapy were observed and appropriately managed. Furthermore, the preoperative model can serve as a powerful discovery platform to efficiently identify biomarkers that can be applied to the metastatic disease setting to establish the relevance of experimental findings. Our identification of ICOS is the first immunologic marker to be identified in both tumor tissues and the peripheral blood of patients treated with anti–CTLA-4, thus providing a relevant biomarker on which to build future immune monitoring strategies.

P. Sharma, J. Wolchok, C.J. Logothetis, and J.P. Allison: advisory boards and honoraria, Bristol-Myers Squibb; J.P. Allison: holds patent for anti–CTLA-4, which is currently being developed as Ipilimumab by Bristol-Myers Squibb.

Grant Support: B.C. Carthon was supported in part by a NIH T32 Training grant (NIH 5 T32 CA009666) awarded to M. D. Anderson Cancer Center. J.D. Wolchok was supported in part by a Melanoma Research Alliance Established Award. This work was also supported in part by a UTMDACC Physician-Scientist Program Award, a Gillson Longenbaugh Foundation Award, a Carl C. Anderson Sr. & Marie Jo Anderson Charitable Foundation Award, a Melanoma Research Alliance Young Investigator Award and a Doris Duke Clinical Scientist Development Award (P. Sharma). Bristol-Myers Squibb (BMS) sponsored and funded the clinical trial of preoperative Ipilimumab in patients with localized urothelial carcinoma of the bladder. Immune monitoring done at MSKCC was supported by the Ludwig Trust and the Goodwin-Commonwealth Fund for Cancer Research. The authors would like to thank Ramy Ibrahim, Jason Corsa, and Lori Cykowski at BMS for their assistance in managing the presurgical blader cancer trial with Ipilimumab and for their review of the manuscript for accuracy.

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

1
Harding
FA
,
McArthur
JG
,
Gross
JA
,
Raulet
DH
,
Allison
JP
. 
CD28-mediated signalling co-stimulates murine T cells and prevents induction of anergy in T-cell clones
.
Nature
1992
;
356
:
607
9
.
2
Thompson
CB
,
Allison
JP
. 
The emerging role of CTLA-4 as an immune attenuator
.
Immunity
1997
;
7
:
445
50
.
3
Krummel
MF
,
Allison
JP
. 
CD28 and CTLA-4 have opposing effects on the response of T cells to stimulation
.
J Exp Med
1995
;
182
:
459
65
.
4
Krummel
MF
,
Allison
JP
. 
CTLA-4 engagement inhibits IL-2 accumulation and cell cycle progression upon activation of resting T cells
.
J Exp Med
1996
;
183
:
2533
40
.
5
Leach
DR
,
Krummel
MF
,
Allison
JP
. 
Enhancement of antitumor immunity by CTLA-4 blockade
.
Science
1996
;
271
:
1734
6
.
6
van Elsas
A
,
Allison
JP
,
Hurwitz
AA
. 
Combination immunotherapy of B16 melanoma using anti-cytotoxic T lymphocyte-associated antigen 4 (CTLA-4) and granulocyte/macrophage colony-stimulating factor (GM-CSF)-producing vaccines induces rejection of subcutaneous and metastatic tumors accompanied by autoimmune depigmentation
.
J Exp Med
1999
;
190
:
355
66
.
7
Quezada
SA
,
Peggs
KS
,
Curran
MA
,
Allison
JP
. 
CTLA4 blockade and GM-CSF combination immunotherapy alters the intratumor balance of effector and regulatory T cells
.
J Clin Invest
2006
;
116
:
1935
45
.
8
Hodi
FS
,
Mihm
MC
,
Soiffer
RJ
, et al
. 
Biologic activity of cytotoxic T lymphocyte-associated antigen 4 antibody blockade in previously vaccinated metastatic melanoma and ovarian carcinoma patients
.
Proc Natl Acad Sci U S A
2003
;
100
:
4712
7
.
9
Phan
GQ
,
Yang
JC
,
Sherry
RM
, et al
. 
Cancer regression and autoimmunity induced by cytotoxic T lymphocyte-associated antigen 4 blockade in patients with metastatic melanoma
.
Proc Natl Acad Sci U S A
2003
;
100
:
8372
7
.
10
Korman
A
,
Yellin
M
,
Keler
T
. 
Tumor immunotherapy: preclinical and clinical activity of anti-CTLA4 antibodies
.
Curr Opin Investig Drugs
2005
;
6
:
582
91
.
11
Saenger
YM
,
Wolchok
JD
. 
The heterogeneity of the kinetics of response to ipilimumab in metastatic melanoma: patient cases
.
Cancer Immun
2008
;
8
:
1
.
12
Weber
JS
,
O'Day
S
,
Urba
W
, et al
. 
Phase I/II study of ipilimumab for patients with metastatic melanoma
.
J Clin Oncol
2008
;
26
:
5950
6
.
13
Small
EJ
,
Tchekmedyian
NS
,
Rini
BI
,
Fong
L
,
Lowy
I
,
Allison
JP
. 
A pilot trial of CTLA-4 blockade with human anti–CTLA-4 in patients with hormone-refractory prostate cancer
.
Clin Cancer Res
2007
;
13
:
1810
5
.
14
Ansell
SM
,
Hurvitz
SA
,
Koenig
PA
, et al
. 
Phase I study of ipilimumab, an anti–CTLA-4 monoclonal antibody, in patients with relapsed and refractory B-cell non-Hodgkin lymphoma
.
Clin Cancer Res
2009
;
15
:
6446
53
.
15
Camacho
LH
,
Antonia
S
,
Sosman
J
, et al
. 
Phase I/II trial of tremelimumab in patients with metastatic melanoma
.
J Clin Oncol
2009
;
27
:
1075
81
.
16
Dillard
T
,
Yedinak
CG
,
Alumkal
J
,
Fleseriu
M
. 
Anti–CTLA-4 antibody therapy associated autoimmune hypophysitis: serious immune related adverse events across a spectrum of cancer subtypes
.
Pituitary
2010
;
13
:
29
38
.
17
Fadel
F
,
El Karoui
K
,
Knebelmann
B
. 
Anti–CTLA4 antibody-induced lupus nephritis
.
N Engl J Med
2009
;
361
:
211
2
.
18
Liakou
CI
,
Kamat
A
,
Tang
DN
, et al
. 
CTLA-4 blockade increases IFNgamma-producing CD4+ICOShi cells to shift the ratio of effector to regulatory T cells in cancer patients
.
Proc Natl Acad Sci U S A
2008
;
105
:
14987
92
.
19
Sun
J
,
Schiffman
J
,
Raghunath
A
,
Ng Tang
D
,
Chen
H
,
Sharma
P
. 
Concurrent decrease in IL-10 with development of immune-related adverse events in a patient treated with anti–CTLA-4 therapy
.
Cancer Immun
2008
;
8
:
9
.
20
Bauquet
AT
,
Jin
H
,
Paterson
AM
,
Lipp
M
. 
The costimulatory molecule ICOS regulates the expression of c-Maf and IL-21 in the development of follicular T helper cells and TH-17 cells
.
Nature Immunology
2009
;
10
:
167
75
.
21
Rasheed
AU
,
Rahn
HP
,
Sallusto
F
,
Lipp
M
,
Muller
G
. 
Follicular B helper T cell activity is confined to CXCR5(hi)ICOS(hi) CD4 T cells and is independent of CD57 expression
.
Eur J Immunol
2006
;
36
:
1892
903
.
22
Akiba
H
,
Takeda
K
,
Kojima
Y
, et al
. 
The role of ICOS in the CXCR5+ follicular B helper T cell maintenance in vivo
.
J Immunol
2005
;
175
:
2340
8
.
23
Sharma
P
,
Gnjatic
S
,
Jungbluth
AA
, et al
. 
Frequency of NY-ESO-1 and LAGE-1 expression in bladder cancer and evidence of a new NY-ESO-1 T-cell epitope in a patient with bladder cancer
.
Cancer Immun
2003
;
3
:
19
.
24
Wolchok
JD
,
Hoos
A
,
O'Day
S
, et al
. 
Guidelines for the evaluation of immune therapy activity in solid tumors: immune-related response criteria
.
Clin Cancer Res
2009
;
15
:
7412
20
.
25
Chen
H
,
Liakou
CI
,
Kamat
A
, et al
. 
Anti–CTLA-4 therapy results in higher CD4+ICOShi T cell frequency and IFN-gamma levels in both nonmalignant and malignant prostate tissues
.
Proc Natl Acad Sci U S A
2009
;
106
:
2729
34
.
26
Simpson
TR
,
Quezada
SA
,
Allison
JP
. 
Regulation of CD4 T cell activation and effector function by inducible costimulator (ICOS)
.
Curr Opin Immunol
2010
,
[Epub ahead of print]
.
27
Kohyama
M
,
Sugahara
D
,
Sugiyama
S
,
Yagita
H
,
Okumura
K
,
Hozumi
N
. 
Inducible costimulator-dependent IL-10 production by regulatory T cells specific for self-antigen
.
Proc Natl Acad Sci U S A
2004
;
101
:
4192
7
.
28
Gigoux
M
,
Shang
J
,
Pak
Y
, et al
. 
Inducible costimulator promotes helper T-cell differentiation through phosphoinositide 3-kinase
.
Proc Natl Acad Sci U S A
2009
;
106
:
20371
6
.

Supplementary data