Test-retest reliability in metric conjoint experiments : a new workflow to evaluate confidence in model results
- Author
- Jens Schüler, Brian Anderson (UGent) , Brian S. Anderson, Charles Y. Murnieks, Matthias Baum and Alexander Küsshauer
- Organization
- Abstract
- Metric conjoint studies are a popular research design in the entrepreneurship domain. For these studies, test-retest reliabilities of ρ > .70 or higher are an often-cited reliability criterion. Despite their widespread use, however, there is little rigorous analysis of whether test-retest reliability in metric conjoint studies relates to model efficacy. Informed by a systematic literature review, we conducted two Monte Carlo simulations to evaluate the effects of various determinants of test-retest reliability in conjoint experiments. We then illustrate a workflow for entrepreneurship researchers employing conjoint designs to better evaluate—and communicate—confidence in statistical models estimated from conjoint data.
- Keywords
- Economics and Econometrics, Business and International Management, entrepreneurship experiments, metric conjoint analysis, test-retest, reliability, Monte Carlo simulation, testing entrepreneurship theory, CONSTRUCT DIMENSIONALITY, ORGANIZATIONAL RESEARCH, DECISION-MAKING, ENTREPRENEURSHIP, COEFFICIENTS, ISSUES, BIAS
Downloads
-
(...).docx
- full text (Published version)
- |
- UGent only
- |
- Word
- |
- 233.04 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HMSB8GA51BC9Z9GCNW0NV07Y
- MLA
- Schüler, Jens, et al. “Test-Retest Reliability in Metric Conjoint Experiments : A New Workflow to Evaluate Confidence in Model Results.” ENTREPRENEURSHIP THEORY AND PRACTICE, vol. 48, no. 2, 2024, pp. 742–57, doi:10.1177/10422587231184071.
- APA
- Schüler, J., Anderson, B., Anderson, B. S., Y. Murnieks, C., Baum, M., & Küsshauer, A. (2024). Test-retest reliability in metric conjoint experiments : a new workflow to evaluate confidence in model results. ENTREPRENEURSHIP THEORY AND PRACTICE, 48(2), 742–757. https://doi.org/10.1177/10422587231184071
- Chicago author-date
- Schüler, Jens, Brian Anderson, Brian S. Anderson, Charles Y. Murnieks, Matthias Baum, and Alexander Küsshauer. 2024. “Test-Retest Reliability in Metric Conjoint Experiments : A New Workflow to Evaluate Confidence in Model Results.” ENTREPRENEURSHIP THEORY AND PRACTICE 48 (2): 742–57. https://doi.org/10.1177/10422587231184071.
- Chicago author-date (all authors)
- Schüler, Jens, Brian Anderson, Brian S. Anderson, Charles Y. Murnieks, Matthias Baum, and Alexander Küsshauer. 2024. “Test-Retest Reliability in Metric Conjoint Experiments : A New Workflow to Evaluate Confidence in Model Results.” ENTREPRENEURSHIP THEORY AND PRACTICE 48 (2): 742–757. doi:10.1177/10422587231184071.
- Vancouver
- 1.Schüler J, Anderson B, Anderson BS, Y. Murnieks C, Baum M, Küsshauer A. Test-retest reliability in metric conjoint experiments : a new workflow to evaluate confidence in model results. ENTREPRENEURSHIP THEORY AND PRACTICE. 2024;48(2):742–57.
- IEEE
- [1]J. Schüler, B. Anderson, B. S. Anderson, C. Y. Murnieks, M. Baum, and A. Küsshauer, “Test-retest reliability in metric conjoint experiments : a new workflow to evaluate confidence in model results,” ENTREPRENEURSHIP THEORY AND PRACTICE, vol. 48, no. 2, pp. 742–757, 2024.
@article{01HMSB8GA51BC9Z9GCNW0NV07Y,
abstract = {{Metric conjoint studies are a popular research design in the entrepreneurship domain. For these studies, test-retest reliabilities of ρ > .70 or higher are an often-cited reliability criterion. Despite their widespread use, however, there is little rigorous analysis of whether test-retest reliability in metric conjoint studies relates to model efficacy. Informed by a systematic literature review, we conducted two Monte Carlo simulations to evaluate the effects of various determinants of test-retest reliability in conjoint experiments. We then illustrate a workflow for entrepreneurship researchers employing conjoint designs to better evaluate—and communicate—confidence in statistical models estimated from conjoint data.}},
author = {{Schüler, Jens and Anderson, Brian and Anderson, Brian S. and Y. Murnieks, Charles and Baum, Matthias and Küsshauer, Alexander}},
issn = {{1042-2587}},
journal = {{ENTREPRENEURSHIP THEORY AND PRACTICE}},
keywords = {{Economics and Econometrics,Business and International Management,entrepreneurship experiments,metric conjoint analysis,test-retest,reliability,Monte Carlo simulation,testing entrepreneurship theory,CONSTRUCT DIMENSIONALITY,ORGANIZATIONAL RESEARCH,DECISION-MAKING,ENTREPRENEURSHIP,COEFFICIENTS,ISSUES,BIAS}},
language = {{eng}},
number = {{2}},
pages = {{742--757}},
title = {{Test-retest reliability in metric conjoint experiments : a new workflow to evaluate confidence in model results}},
url = {{http://doi.org/10.1177/10422587231184071}},
volume = {{48}},
year = {{2024}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: