Objective: Mailed surveys are widely used to collect epidemiologic and health service data. Given that nonresponse can threaten the validity of surveys, modest incentives are often used to increase response rates. A study was undertaken among childhood cancer survivors and their parents to determine if response rate to a mailed survey differed with provision of immediate versus delayed incentives.

Design: A self-administered survey designed to ascertain health behaviors was mailed to 397 childhood cancer survivors (and their parents if the survivor was <18 years of age). Subjects were randomized into two groups based on gender, age, race, and cancer type. One group received a $10 incentive with their blank survey (unconditional incentive), whereas the other group received the incentive upon receipt of their completed survey (conditional incentive). If children were minors, both the parent and the child received incentives. Results: No significant differences in response rates were observed with respect to gender, age, race, or cancer type. However, significant differences in response rates were observed between incentive groups, with unconditional incentives yielding significantly higher response rates than conditional incentives for child survivors who were ≥18 years (64.4% versus 49.0%), as well as younger child survivors (62.5% versus 43.6%) and their parents (64.8% versus 41.5%; all P < 0.05). Conclusions: The provision of an immediate incentive generated significantly higher response rates to this mailed health survey among childhood cancer survivors and their parents. Given that survey studies are commonly conducted across various pediatric populations, these findings may help inform the design of future pediatric survey research. Mailed surveys are frequently used to collect data for epidemiologic and other health-related research. Poor response rates pose challenges to investigators because they may interject bias and threaten study validity. Strategies for increasing response rates have been recently reviewed by Edwards et al. (1) with consensus that monetary incentives more than double response rates (odds ratio, 2.02; 95% confidence interval, 1.79-2.27) in surveys conducted in adults as well as in children. The timing of incentives, however, is not as well-characterized and questions remain whether incentives should be included within initial mailings or whether better response rates are realized when incentives are provided upon survey completion. To date, 13 studies have been conducted and the majority show that response rates are higher when incentives are provided at the time of survey administration rather than upon return (1-4). However, the majority of these studies were conducted in healthy populations; to date, no studies have explored conditional (incentive provided upon survey completion) versus unconditional (incentive provided at the time of survey administration) incentives among clinic-based pediatric populations and/or their parents or guardians. Our goal was to determine if response rate to a mailed survey aimed at childhood cancer survivors differs if a monetary incentive ($10) is inserted within the initial mailing or is mailed to subjects after receipt of their completed survey. Like previous studies, we hypothesized that within this group of childhood cancer survivors and their parents, response rates would also be higher among those incentivized before completing the survey.

This study of immediate versus delayed incentives was embedded within a mailed survey study aimed at assessing health-related behaviors among childhood cancer survivors and their parents (Institutional Review Board protocol 4635-03-3R0ER). The sample for this study was comprised of childhood cancer (lymphoma, leukemia, or central nervous system cancer) survivors who were between the ages of 11 and 33 and who were at least 1 year out from completion of treatment with either no evidence of disease or stable disease. The time from the end of treatment ranged from 1 to 28 years. Cases were identified through the various registries at Duke University Medical Center (i.e., Central Cancer Registry, Brain Tumor Center, Young Cancer Survivors Program, and Children's Cancer Center), and approved for contact by their primary oncology care physician. The sample, comprised of 497 cases, was block randomized into two groups based on gender, age (<18 versus ≥18 years), and race (White versus non-White) because these parameters have been shown to influence response rates in previous studies (1). In addition, the sample was block randomized on cancer type. Assuming response rates similar to those reported by Edwards et al. (1), the study had 83% power (two-sided, α = 0.05) to detect a difference between the incentive arms. The power calculations were based upon seeing an effect size difference of between 50% and 64%; these calculations were based upon an assumption that we would achieve response rates that were similar in magnitude to previous studies (2) and would allow us to detect differences between groups given a response rate of 50% in one group versus 64% in the other.

One group received the incentive ($10 bill) attached to the cover letter, “as a gesture of thanks.” The other group received a cover letter with information that they would receive *$10 in cash upon receipt of their completed survey. Both groups received an 11-page survey along with a postage-paid, preaddressed envelope for return. If the childhood survivor was under 18 years of age, the survey was included within a mailing sent to the parents. Parents also received a survey and were incentivized in an identical manner as the child; a separate envelope for return was also provided. We did not specify which parent should fill out the questionnaire nor did we include an item to indicate which had done so. Data for parent responses was not stratified by the type of disease their child had due to sample size considerations.

We allowed a significant amount of time for the surveys to be returned to us; after a 2-month period, nonrespondents received a follow-up telephone call using a standardized script. In the case where additional surveys were mailed, no additional incentive was supplied. Additional surveys were mailed to those who stated that they did not receive the original survey. In cases where phone numbers were inactive or subjects were unreachable, it was assumed that the survey never met its intended target (n = 61). This number was added to the number of surveys returned by the post office with no forwardable address (n = 29), as well as those going to subjects who later were identified as deceased (n = 10); this total was subtracted from the denominator yielding an evaluable sample of 397. Whereas we cannot exclude the possibility that some (or perhaps all) of the nonrespondents may have received the surveys, kept the incentive, and then denied either living at the contact address or phone number, we thought this to be unlikely and thus excluded these patients from our totals. An analysis of each of the subgroups that we were not able to contact showed that there no significant differences between assignments to the conditional or unconditional incentive arms of the study (data not shown). The χ2 test of proportions was used to compare the response rates in the two arms (as well as within strata).

The evaluable sample was comprised of 215 cancer survivors who were currently >18 years of age, and 182 survivors who were younger (plus their parents). A majority of the survivor sample was White (83%) and male (55%), and the distribution among cancer types was roughly 40% central nervous system cancers, 21% lymphomas, and 39% leukemias. There was also no association with response rate with time from completion of therapy.

No significant differences in response rates were observed on the basis of age, gender, race, or disease category. However, there was a significant difference (P < 0.0001) in overall response rates between incentive arms, with a 44.8% overall response rate noted among those who were offered the conditional incentive versus a 63.9% response rate among those who received the unconditional incentive. Significant differences in response rates were also detected within the adult survivors, child survivors, and parents. Odds ratios (95% confidence intervals) for unconditional versus conditional incentives for adult survivors and child survivors and their parents were 1.31 (1.03, 1.67), 1.43 (1.08, 1.90), and 1.56 (1.17, 2.08), respectively. Response rates for each of these groups of subjects, as well as groups stratified by race, gender, and disease type are provided in Table 1.

Table 1.

Response rates among childhood cancer survivors and their parents

Survivors age 18+, %response (ratio)Survivors age <18, %response (ratio)Parents of survivors <18, %response (ratio)
Overall
Conditional 49.0% (49/100)* 43.6% (41/94)* 41.5% (39/94)*
Unconditional 64.4% (74/115) 62.5% (55/88) 64.8% (57/88)
Gender
Male conditional 43.6% (24/55) 46.9% (23/49) —
Male unconditional 59.4% (38/64) 57.1% (28/49) —
Female conditional 53.5% (23/43) 40.0% (18/45) —
Female unconditional 70.6% (36/51) 69.2% (27/39) —
Race
Whites conditional 48.8% (39/80)* 43.2% (32/74)* —
Whites unconditional 64.1% (66/103) 64.8% (46/71) —
Non-Whites conditional 44.4% (8/18) 45.0% (9/20) —
Non-Whites unconditional 66.7% (8/12) 52.9% (9/17) —
Cancer type
CNS conditional 56.4% (22/39) 39.0% (16/41)* —
CNS unconditional 65.8% (25/38) 66.7% (26/39) —
Leukemia conditional 40.0% (12/30)* 46.5% (20/43) —
Leukemia unconditional 63.6% (28/44) 58.3% (21/36) —
Lymphoma conditional 44.8% (13/29) 44.4% (4/9) —
Lymphoma unconditional 62.5% (20/32) 72.7% (8/11) —
Survivors age 18+, %response (ratio)Survivors age <18, %response (ratio)Parents of survivors <18, %response (ratio)
Overall
Conditional 49.0% (49/100)* 43.6% (41/94)* 41.5% (39/94)*
Unconditional 64.4% (74/115) 62.5% (55/88) 64.8% (57/88)
Gender
Male conditional 43.6% (24/55) 46.9% (23/49) —
Male unconditional 59.4% (38/64) 57.1% (28/49) —
Female conditional 53.5% (23/43) 40.0% (18/45) —
Female unconditional 70.6% (36/51) 69.2% (27/39) —
Race
Whites conditional 48.8% (39/80)* 43.2% (32/74)* —
Whites unconditional 64.1% (66/103) 64.8% (46/71) —
Non-Whites conditional 44.4% (8/18) 45.0% (9/20) —
Non-Whites unconditional 66.7% (8/12) 52.9% (9/17) —
Cancer type
CNS conditional 56.4% (22/39) 39.0% (16/41)* —
CNS unconditional 65.8% (25/38) 66.7% (26/39) —
Leukemia conditional 40.0% (12/30)* 46.5% (20/43) —
Leukemia unconditional 63.6% (28/44) 58.3% (21/36) —
Lymphoma conditional 44.8% (13/29) 44.4% (4/9) —
Lymphoma unconditional 62.5% (20/32) 72.7% (8/11) —

Abbreviation: CNS, central nervous system.

*

P < 0.05.

P < 0.01.

Survey research standards for studies conducted within the general population purport a 60% response rate as a standard for “acceptability”—a standard that often requires additional effort and resources associated with precontact, incentives, or reminder postcards or calls (5, 6). In this study of childhood cancer survivors and their parents, 60% response rates were achieved via a follow-up phone call, plus the use of a *$10 incentive—but only if the incentive was provided concurrently with the survey and not conditional upon survey completion and return. These findings are in direct contrast to those reported in a recent survey study of 855 prostate cancer survivors, where a 60% response rate was achieved regardless of conditional or unconditional incentive, and without the use of follow-up telephone calls (2). The discrepancy between studies may be attributable to obvious age differences between these two populations of cancer survivors. This explanation is supported by data of Caan et al. (7) who confirm a positive association between age and response rates to health behavior surveys. Further, the lack of response rate differences in the previous study may have been due to participants' valuing the incentive, a 30-minute prepaid phone card, <*$10 in cash. Indeed, our findings are more similar to the previous studies reviewed by Edwards et al. (1), which indicate that response rates are higher among those who received unconditional compared with conditional incentives. It must be noted, however, that our odds ratios were more modest (1.3-1.5 compared with 1.7), suggesting that either this survey or this sample taking it differed somewhat from surveys and samples included within the prior review.

A previous methods paper by Mertens et al. (8) describes a host of barriers that must be overcome to conduct survey research in childhood cancer populations. Ensuring that substantial numbers of children and their parents are not to be lost to follow-up in today's highly mobile society requires resources such as comprehensive databases and intensive tracking systems. The fact that we were unable to locate 20% of our original sample is testimony to this need and acknowledged as a limitation of this study. Although our sample provided ample power to detect differences in response rates overall and within the major age groups of patients and their parents, we lacked adequate power to test for differences once these groups were further stratified by race, gender, or cancer type. Mertens et al. (8) also described an intensive campaign using reminder postcards and several follow-up telephone calls to achieve response rates that are deemed acceptable. Findings of this study suggest that the provision of study incentives is helpful in eliciting mailed survey responses, but that incentives need to be provided unconditionally to have optimal impact. These findings can inform future survey research conducted in other populations of childhood cancer survivors, as well as pediatric populations, in general.

Grant support: Duke Comprehensive Cancer Center grant P30-CA14236-32.

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

We thank the efforts of Dr. Bercedis Peterson, Denise Snyder, Shelley Rusincovitch, Amy Hensley, Meredith Wood, and Cheri Willard.

1
Edwards P, Roberts I, Clarke M, et al. Increasing response rates to postal questionnaires: systematic review.
BMJ
2002
;
324
:
1183
.
2
Evans BR, Peterson BL, Demark-Wahnefried W. No difference in response rate to a mailed survey among prostate cancer survivors using conditional versus unconditional incentives.
Cancer Epidemiol Biomarkers Prev
2004
;
13
:
277
–8.
3
Doody MM, Sigurdson AS, Kampa D, et al. Randomized trial of financial incentives and delivery methods for improving response to a mailed questionnaire.
Am J Epidemiol
2003
;
157
:
643
–51.
4
Whiteman MK, Langenberg P, Kjerulff K, et al. A randomized trial of incentives to improve response rates to a mailed women's health questionnaire.
J Womens Health (Larchmt)
2003
;
12
:
821
–8.
5
Dillman DA. The design and administration of mailed surveys.
Annu Rev Sociol
1991
;
17
:
225
–49.
6
Salant P, Dillman DA. How to conduct your own survey. New York: John Wiley and Sons, Inc.; 1994.
7
Caan B, Hiatt RA, Owen AM. Mailed dietary surveys: response rates, error rates, and the effect of omitted food items on nutrient values.
Epidemiology
1991
;
2
:
430
–6.
8
Mertens AC, Potter JD, Neglia JP, et al. Methods for tracing, contacting, and recruiting a cohort of survivors of childhood cancer.
J Pediatr Hematol Oncol
1997
;
19
:
212
–9.