Purpose: To identify evidence-based, low-cost, and easy-to-implement strategies to improve
students’ participation in a university feedback survey in a joint-venture university in China.
Methods: A 2×2 factorial randomized controlled trial was implemented to test the effectiveness of
personalization and bilingual subject line in increasing survey participation. All study procedures
were approved by the Duke Kunshan University Institutional Review Board (approval number:
FWA00021580).
Results: Among 1207 participants invited to the survey, 8 were removed from data analysis due
to missing data. Separate logistical regression models were run to examine the effectiveness of
proposed interventions. Contrary to the hypotheses, none of the treatments were found to have
statistically significant impacts on opening (OR bilingual vs. English subject line = 1.27, P=0.08; OR first vs. last name = 1.16, P=0.27), responding to (OR bilingual vs. English subject line = 1.24, P=0.14; OR first vs. last name= 1.13, P=0.40), and completing the survey (OR bilingual vs. English subject line = 1.13, P=0.42; OR first vs. last name = 1.09, P=0.58), after controlling for covariates. Meanwhile, academic level and place of residence were strong predictors of all survey participation behaviors.
Implications: These findings suggest that low-cost inventions are unlikely to improve the survey
response rate.
