Designing Experiments That Generalize

By Scott Highhouse. 2009

311 citations recorded by the source corpus.

Subfields: Management Science and Operations Research, Organizational Behavior and Human Resource Management

View Paper: https://www.semanticscholar.org/paper/82e4118525c7f5bc9e510173e5e4750ecafbbfc1

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Management Science and Operations Research

In Organizational Behavior and Human Resource Management

Citations in the corpus

On doing relevant and rigorous experiments: Review and recommendations (2018, background): “rather than tools for assessing the size of a statistical effect (Highhouse, 2009; Rubinstein, 2001), they are useful for capturing directional effects of theoretically informed treatments, yet await field tests for a more precise assessment of the practical effect.”
Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies (2014, methodology): “Specifically, it takes more time and effort to conduct an experiment, involving the creation of experimental materials, recruiting of participants, administering the experimental treatments, and addressing ethical challenges in administering the treatments compared to using archival data or an onlin”
Is This How I Will Be Treated? Reducing Uncertainty through Recruitment Interactions (2013, background): “Scholars have argued that carefully designed experiments can provide compelling evidence of causal relationships and underlying psychological processes (e.g., Highhouse, 2009; Spencer et al., 2005).”
Experimental Manipulation of Psychological Involvement with Media (2014, background): “Arguably, extreme manipulations that sacrifice realism produce less informative results than the modest manipulations that demonstrate effect sizes consistent with what can be observed in the real world (Highhouse, 2009).”
Leader Narcissism Predicts Malicious Envy and Supervisor-Targeted Counterproductive Work Behavior: Evidence from Field and Experimental Research (2018, methodology): “Third, we apply experimental and field research designs with self- and other-report measures to strengthen validity (Highhouse 2009).”
Looking Forward to Performance Improvement: A Field Test of the Feedforward Interview for Performance Management (2015, background): “Both Highhouse (2009) and Hollenbeck (2002) argued for the use of field experiments where the phenomenon of interest can be examined within a naturally occurring environment.”
Designing Entrepreneurship Experiments (2017, background): “We also clarify that the purpose of conducting experiments in entrepreneurship research is to test theories that generalize across multiple contexts and not to generalize statistical effects that are observed in a specific context (Highhouse, 2009).”
The impact of online reviews on hotel booking intentions and perception of trust. (2011, background): “Experimental designs are useful for generalising about theoretical effects of variables rather than generalising statistical effects to wider populations (Highhouse, 2009).”
Does Anger Expression Help or Harm Leader Effectiveness? The Role of Competence-based versus Integrity-based Violations and Abusive Supervision (2017, result): “While this design enabled us to demonstrate causality and rule out alternative explanations (Highhouse, 2009), the fact that we used a “paper person” as a leader may render the anger expression less realistic.”
Self-Reported Limitations and Future Directions in Scholarly Reports (2013, background): “Causality evidence remains elusive in management research (Aguinis & Lawal, 2012; Grant & Wall, 2009; Highhouse, 2009), and such concern, whether for theory testing or applied research, has long been recognized to be of the highest priority in the social sciences, reflecting what Cook and Campbell l”
Persuasion in crowdfunding: An elaboration likelihood model of crowdfunding performance (2017, background): “, Meade and Craig, 2012), directed answer, manipulation check, and content check questions were presented to participants (Highhouse, 2009; Huang et al., 2012).”