Designed and built by Laurel Aynne Cook
© Laurel Aynne Cook 2024
Experimental Design
CONCLUSIVE RESEARCH (vs. EXPLORATORY)
I usually take a deductive approach to address my research questions. Conclusive research, used to test specific hypotheses,
examine specific relationships, or make predictions, includes (1) descriptive and (2) causal study designs. Since I’m primarily
interested in cause-and-effect relationships, experimental design is my preferred methodology. My guide (below) helps to
describe some of the basics in experimental design. I’ve also included a few tips regarding the survey experience for online
participants. (See the section on ‘Crowdsourced Data’ for additional information.)
EXPERIMENT BUILDER (GORILLA)
Researchers from the Universities of Cambridge, London, and Cauldron Science have created The Gorilla Experiment Builder
in 2016. This is a fully tooled experiment authoring and deployment platform, designed to resolve many timing issues, and
make reliable online experimentation open and accessible to a wider range of technical abilities. There is an easy-to-use
graphical interface (i.e., you don’t need to know how to code) and you can collect online behavioral data with response
latencies. The Gorilla platform allows researchers to build for free & pay per participant. Citation = Anwyl-Irvine, A.L.,
Massonnié, J., Flitton, A., Kirkham, N. and Evershed, J.K. (2019), “Gorilla in our Midst: An online behavioral experiment
builder,” Behavior Research Methods, 1-20.
GORILLA.SC
MANIPULATIONS | MANY LABS 2
A large group of authors (n = 173) had support from the Center for Open Sciences and with a grant through the Association
for Psychological Science. Their goal included replicating nearly 30 classic and contemporary published findings from
protocols/ manipulations across more than 15,000 participants. In their freely available preprint (here), you can see a variety
of helpful examples of various manipulations including the following: correspondence bias, intentional side effects, trolley
dilemma, false consensus, moral typecasting, intuitive reasoning, tempting fate, priming consumerism, position & power,
social value orientation, SMS & well-being, affect & risk, goal pursuit, and many others. This research has been published
(2018) in Advances in Methods and Practices in Psychological Science.
PSYARXIV.COM
SAMPLE SIZE CALCULATOR
Created by Dr. Rebecca Hofstein Grady (Ph.D. in Social Psychology at the University of California, Irvine) to help academics
calculate the following information for MTurk: (1) total sample size, (2) cost for Amazon, including their 20% fee, (3) cost for
Cloud Research (formerly TurkPrime), (4) total cost, and (5) wage per participant. Simply enter your study information in the
white cells and the information (above) will be automatically populated in the gray boxes at the bottom of the Google Sheets
document.
DOCS.GOOGLE.COM
Grants & Funding
AMERICAN COUNCIL ON CONSUMER INTERESTS (ACCI) SMALL GRANTS PROGRAM
The ACCI is currently accepting proposals for their small grants program. The program’s purpose is to promote rigorous,
research-based investigations that address pressing consumer issues. Both qualitative and quantitative research designs are
encouraged. Proposals may utilize primary or secondary data and must adhere to the ACCI’s mission, vision and goals.
ACCI SMALL GRANTS PROGRAM
ACR TRANSFORMATIVE CONSUMER RESEARCH (TCR)
Through the Association for Consumer Research, TCR grants are designed to promote research that “focuses first and
foremost on matters of well-being and emancipatory interest as it pertains to consumption and market related phenomena.
TCR projects involve almost exclusively a specific consumption problem or opportunity. Accordingly, such projects strive to
develop insights that can be acted upon by consumers and/or their agents (e.g., family members, professional caregivers,
NGOs, policy makers, social enterprises), for the purpose of upholding and improving well-being for individuals, subgroups,
societies, other living entities, and/or the natural environment.” The submission deadlines are usually in May and funding
notifications are sent by early September
ACR.ORG/TCRGRANTS
BERKMAN CHARITABLE FOUNDATION
The Harold & Muriel Berkman Foundation Research Grants are awarded to Departments of Marketing in Colleges of
Businesses at AACSB accredited institutions within the United States. Designed for tenure-track (or tenured) faculty, these
grants are aimed at further developing scientific research and knowledge creation in business administration with an
emphasis on the marketing discipline. Awards include up to $3K and applications open May 1 - August 31 yearly.
BERKMANFOUNDATION.ORG/GRANTS
NATIONAL INSTITUTES OF HEALTH (NIH)
While the NIL is the primary agency (at the federal level) associated with supporting biomedical research ($32 billion a year),
they also support non-clinical research related to work conducted in their Institutes and Centers. During a recent TCR pre-
conference event, Dr. Connie Pechmann (University of California, Irvine) shared her experiences with NIH grants (e.g., she
was awarded a 5-year NIH grant in the amount of >$2.5 million for her work related to social media technology used for
treating tobacco addiction). She suggested applying for R34 grants as these are for exploratory research and are designed as
“a versatile grant mechanism that could be used for planning of basic research projects”.
GRANTS.NIH.GOV/FUNDING
NATIONAL SCIENCE FOUNDATION (NSF)
The National Science Foundation funds research and education in most fields of science and engineering. The Foundation
accounts for about ¼ of federal support to academic institutions for basic research. NSF receives approximately 40,000
proposals each year for research, education and training projects, of which approximately 11,000 are funded. One of the
primary research areas for NSF funding includes social, behavioral, and economic sciences. As of April 2019, there were 114
of these specific funding opportunities. You can also find NSF funding at Grants.gov.
NSF.GOV/FUNDING
WILLIAM T. GRANT FOUNDATION
The mission of the Foundation is to nurture research designed to address “broad issues and work in interdisciplinary ways
to assist young people to reach their full potential.” They promote the following grants: reducing inequality, improving the
use of research evidence, youth services, institutional challenge (for public agency or nonprofit partnerships), and early-
career research. Plus, they have a large grants database here. The Foundation favors an interdisciplinary approach to
research, so keep that in mind if you choose to apply.
WTGRANTFOUNDATION.ORG/GRANTS
Explore some of the things I’ve found helpful in my career as a researcher