Online Experiments

1. Home
2. Projects
3. Online Experiments

In 2015 the Adelaide Computational Cognitive Science lab ran a half-day workshop at the Australasian Experimental Psychology Conference (EPC), discussing the mechanics, practicalities and ethics of running psychology experiments online. The workshop presentations were given by Drew Hendrickson, Dani Navarro and Steve Langsford, with additional material contributed by Lauren Kennedy, with Amy Perfors contributing a huge amount of work behind the scenes and the whole of the lab contributing in different places.

Readings

• Berinsky, Huber and Lenz (2012) Evaluating Online Labor Markets for Experimental Research: Amazon.coms Mechanical Turk DOI:10.1093/pan/mpr057
• Berinsky, Margolis and Sances (2014) Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self-Administered Surveys DOI:10.1111/ajps.12081
• Buhrmester, Kwang and Gosling (2011) Amazons Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data DOI:10.1177/1745691610393980
• Chandler, Mueller and Paolacci (2013) Non-naivete among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers DOI:10.3758/s13428-013-0365-7
• Crump, McDonnell and Gureckis (2013) Evaluating Amazons Mechanical Turk as a Tool for Experimental Behavioral Research DOI:10.1371/journal.pone.0057410
• Leeuw and Motz (2015) Psychophysics in a Web browser? Comparing response times collected with JavaScript and Psychophysics Toolbox in a visual search task DOI:10.3758/s13428-015-0567-2
• Enochson and Culbertson (2015) Collecting Psycholinguistic Response Time Data Using Amazon Mechanical Turk DOI:10.1371/journal.pone.0116946
• Fort, Adda and Cohen (2011) Amazon Mechanical Turk: Gold Mine or Coal Mine? DOI:10.1162/COLI_a_00057
• Gosling, Vazire, Srivastava and John (2004) Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires DOI:10.1037/0003-066X.59.2.93
• Mason and Suri (2012) Conducting behavioral research on Amazons Mechanical Turk DOI:10.3758/s13428-011-0124-6
• Paolacci, Chandler and Ipeirotis (2010) Running experiments on Amazon Mechanical Turk SSRN:http://ssrn.com/abstract=1626226
• Shank (2015) Using Crowdsourcing Websites for Sociological Research: The Case of Amazon Mechanical Turk DOI:10.1007/s12108-015-9266-9
• Shapiro, Chandler and Mueller (2013) Using Mechanical Turk to Study Clinical Populations DOI:10.1177/2167702612469015
• Simcox and Fiez (2013) Collecting response times using Amazon Mechanical Turk and Adobe Flash DOI:10.3758/s13428-013-0345-y