"Testing the Waters: Behavior across Participant Pools", a cargo de Erik Snowberg (UBC)
Testing the Waters: Behavior across Participant Pools
Abstract: We leverage a large-scale incentivized survey eliciting behaviors from (almost) an en- tire university student population, a representative sample of the U.S. population, and Amazon Mechanical Turk (MTurk) to address concerns about the external va- lidity of experiments with student participants. Behavior in the student population offers bounds on behaviors in other populations, and correlations between behaviors are largely similar across samples. Furthermore, non-student samples exhibit higher measurement error. Adding historical lab participation data, we find a small set of attributes over which lab participants differ from non-lab participants. Using an addi- tional set of lab experiments, we see no evidence of observer effects.