Hi, I asked a colleague about this and here are some resources she pointed me to: Paolacci, G., Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a Participant Pool. Current Directions in Psychological Science, 23(3), 184-188. Paolacci, G., Chandler, J., Ipeirotis, P. G. (2010). Running Experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5(5), 411-419. Kittur, Chi, and Suh. Crowdsourcing User Studies with Mechanical Turk. CHI '08. Paolacci also has a blog called 'Experimental Turk <http://experimentalturk.wordpress.com/2013/12/11/reputation-as-a-sufficient-condition-for-high-data-quality-on-mturk/>' that might have posts about this (e.g., http://experimentalturk.wordpress.com/2013/12/11/reputation-as-a-sufficient-... ) She wrote a workshop paper awhile back that cites other stuff that is further afield (mostly cognitive psych) but related to the same question: http://crowdresearch.org/chi2011-workshop/papers/hullman.pdf Hope this is helpful. Nicole Nicole Ellison Associate Professor School of Information University of Michigan