Selecting ideas for new product development: Comparison of monadic test and adaptive concept screening under the G theory framework
Abstract
Purpose
New product concept screening, i.e., selecting a few viable innovative concepts from numerous candidates, involves high stakes and is complicated and resource intensive. Over the years, there has been heated debate about the relative merit of monadic (sequential) tests vs that of preference-based paired comparisons. The paper aims to discuss these issues.
Design/methodology/approach
This study proposes the Generalizability Theory as a framework to assess and compare the performance of traditional monadic test with the Adaptive Concept Screening (ACS) in terms of their testing results and psychometric quality.
Findings
Using 50 yogurt concepts and two independent groups of respondents, the results indicate that ACS requires a significant smaller sample of respondents to achieve a necessary minimum G coefficient for decision making. Moreover, ACS offers a more discriminating and reliable solution for early stage concept screening as manifested by a higher G coefficient and greater percentage of variance due to the selected concepts given the same sampling design.
Practical implications
The results lend strong support to ACS as a more cost-effective method for screening new product concepts and the Generalizability Theory as a systematic framework for assessing concept testing methods.
Originality/value
This study adopts the Generalizability Theory framework to assess the validity of new product concept screening method.
Keywords
Citation
Cui, G., Peng, L. and Florès, L.P. (2015), "Selecting ideas for new product development: Comparison of monadic test and adaptive concept screening under the G theory framework", European Journal of Innovation Management, Vol. 18 No. 3, pp. 380-396. https://doi.org/10.1108/EJIM-04-2014-0046
Publisher
:Emerald Group Publishing Limited
Copyright © 2015, Emerald Group Publishing Limited