Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Identifying high quality ideas in the online context: evidence from a meta-analysis

Identifying high quality ideas in the online context: evidence from a meta-analysis With the rapid development of web-based ideation platforms, firms are increasingly reaching outside their boundaries to obtain ideas, which makes idea evaluation tricky and ineffective. Numerous studies have investigated the antecedents of idea quality, but few have focused on the fragmented and contradictory conclusions these studies have drawn. Thus, the purpose of this paper is to disentangle conflicting findings regarding factors affecting idea quality.Design/methodology/approachA total of 41 independent samples from 40 articles published between 2009 and 2020 were retrieved and encoded to conduct a meta-analysis. By using Comprehensive Meta-analysis 3.0 (CMA 3.0) software, the relationship between identified influencing factors and idea quality, and the moderating effects of potential variables were investigated.FindingsFactors affecting idea quality were summarized and divided into three categories: idea-related factors, ideator-related factors and platform-related factors. The results indicated that all proposed factors (idea length, supporting evidence, past success, past submissions, past comments, votes received and comments received) had significant positive effects on idea quality. Moreover, the measurement of idea quality and idea type was the causative factor for the inconsistent findings, whereas the moderating effect of platform type was not significant.Originality/valueThis study systematically synthesized the existing research on the factors influencing idea quality and helped to reconcile the mixed results. The findings serve to enrich current knowledge of idea evaluation in the online context, which could have important implications for both scholars and practitioners. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png European Journal of Innovation Management Emerald Publishing

Identifying high quality ideas in the online context: evidence from a meta-analysis

Hu, Suya; Xu, Di
European Journal of Innovation Management , Volume 26 (3): 23 – Apr 4, 2023
Download PDF
23 pages

Loading next page...
 
/lp/emerald-publishing/identifying-high-quality-ideas-in-the-online-context-evidence-from-a-3PDMH2CGPo

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
1460-1060
DOI
10.1108/ejim-04-2021-0194
Publisher site
See Article on Publisher Site

Abstract

With the rapid development of web-based ideation platforms, firms are increasingly reaching outside their boundaries to obtain ideas, which makes idea evaluation tricky and ineffective. Numerous studies have investigated the antecedents of idea quality, but few have focused on the fragmented and contradictory conclusions these studies have drawn. Thus, the purpose of this paper is to disentangle conflicting findings regarding factors affecting idea quality.Design/methodology/approachA total of 41 independent samples from 40 articles published between 2009 and 2020 were retrieved and encoded to conduct a meta-analysis. By using Comprehensive Meta-analysis 3.0 (CMA 3.0) software, the relationship between identified influencing factors and idea quality, and the moderating effects of potential variables were investigated.FindingsFactors affecting idea quality were summarized and divided into three categories: idea-related factors, ideator-related factors and platform-related factors. The results indicated that all proposed factors (idea length, supporting evidence, past success, past submissions, past comments, votes received and comments received) had significant positive effects on idea quality. Moreover, the measurement of idea quality and idea type was the causative factor for the inconsistent findings, whereas the moderating effect of platform type was not significant.Originality/valueThis study systematically synthesized the existing research on the factors influencing idea quality and helped to reconcile the mixed results. The findings serve to enrich current knowledge of idea evaluation in the online context, which could have important implications for both scholars and practitioners.

Journal

European Journal of Innovation Management – Emerald Publishing

Published: Apr 4, 2023

Keywords: User innovation; Idea quality; Meta-analysis; Moderating effects

References

  • A manager's perspective on virtual customer integration for new product development
    Bartl, M.; FüLler, J.; Mühlbacher, H.; Ernst, H.
  • Crowdsourcing new product ideas over time: an analysis of the Dell IdeaStorm community
    Bayus, B.L.
  • Idea selection in web-enabled ideation systems
    Beretta, M.
  • Rate or trade? Identifying winning ideas in open idea sourcing
    Blohm, I.; Riedl, C.; FüLler, J.; Leimeister, J.M.
  • Team innovation and perceptions of consideration: what difference does diversity make?
    Cady, S.H.; Valentine, J.
  • Fostering customer ideation in crowdsourcing community: the role of peer-to-peer and peer-to-firm interactions
    Chan, K.W.; Li, S.Y.; Zhu, J.J.
  • Good to be novel? Understanding how idea feasibility affects idea adoption decision making in crowdsourcing
    Chan, K.W.; Li, S.Y.; Zhu, J.J.
  • Social capital and individual motivations on knowledge sharing: participant involvement as a moderator
    Chang, H.H.; Chuang, S.
  • Theory and analysis of company-sponsored value co-creation
    Chen, L.; Marsden, J.R.; Zhang, Z.
  • Collective firm-internal online idea development: exploring the impact of feedback timeliness and knowledge overlap
    Chen, Q.; Magnusson, M.; BjöRk, J.
  • Inferior member participation identification in innovation communities: the signaling role of linguistic style use
    Coussement, K.; Debaere, S.; De Ruyck, T.
  • Scoring vs. ranking: an experimental study of idea evaluation processes
    Cui, Z.; Shijith, K.; Gonçalves, D.
  • Identifying quality, novel, and creative ideas: constructs and scales for idea evaluation
    Dean, D.L.; Hender, J.M.; Rodgers, T.L.; Santanen, E.L.
  • Steal my idea! organizational adoption of user innovations from a user innovation community: a case study of Dell IdeaStorm
    Di Gangi, P.M.; Wasko, M.
  • Getting customers' ideas to work for you: learning from Dell how to succeed with online user innovation communities
    Di Gangi, P.M.; Wasko, M.; Hooker, R.E.
  • Attention to ideas! Exploring idea survival in internal crowdsourcing
    Di Vincenzo, F.; Mascia, D.; Björk, J.; Magnusson, M.
  • Cognitive stimulation in brainstorming
    Dugosh, K.L.; Paulus, P.B.; Roland, E.J.; Yang, H.
  • The impact of service innovation on firm performance: a meta-analysis
    Feng, C.L.; Ma, R.; Jiang, L.
  • Video conferencing in the field: a heuristic processing model
    Ferran, C.; Watts, S.
  • Recombinant uncertainty in technological search
    Fleming, L.
  • Finding commercially attractive user innovations: a test of lead-user theory
    Franke, N.; Von Hipple, E.; Schreier, M.
  • Impact of idea titles on idea implementation: based on primacy effect and cognitive psychology
    Gao, B.L.; Wei, T.
  • A review and evaluation of meta-analysis practices in management research
    Geyskens, I.; Krishnan, R.; Steenkamp, J.E.M.; Cunha, P.V.
  • Idea generation and the quality of the best idea
    Girotra, K.; Terwiesch, C.; Ulrich, K.T.
  • Primary, secondary, and meta-analysis of research
    Glass, G.V.
  • Meta-analysis: integrating accumulated knowledge
    Grewal, D.; Puccinelli, N.; Monroe, K.B.
  • The influence of user-related characteristics on the idea's adoption in virtual innovation community: an empirical study based on the Dell's ‘IdeaStorm’ community
    Guo, A.F.; Chen, J.F.; Guo, J.; Li, Y.N.
  • Stimulating innovation on social product development: an analysis of social behaviors in online innovation communities
    Han, C.; Yang, M.
  • The innovational value chain
    Hansen, R.; Birkinshaw, J.
  • Measuring inconsistency in meta-analyses
    Higgins, J.P.; Thompson, S.G.; Deeks, J.J.; Altman, D.G.
  • Should you really produce what consumers like online? Empirical evidence for reciprocal voting in open innovation contests
    Hofstetter, R.; Aryobsei, S.; Herrmann, A.
  • Understanding the determinants of online review helpfulness: a meta-analytic investigation
    Hong, H.; Xu, D.; Wang, G.A.; Fan, W.
  • Identifying new product ideas: waiting for the wisdom of the crowd or screening ideas in real time
    Hoornaert, S.; Ballings, M.; Malthouse, E.C.; Van den Poel, D.
  • Generating ideas on online platforms: a case study of ‘my Starbucks idea’
    Hossain, M.; Islam, K.M.Z.
  • Ideation through online open innovation platform: Dell IdeaStorm
    Hossain, M.; Islam, K.M.Z.
  • Idea response and adoption in open innovation communities: the signaling role of linguistic style
    Hu, S.Y.; Di, X.; Wang, A.
  • Crowdsourcing new product ideas under consumer learning
    Huang, Y.; Singh, P.V.; Srinivasan, K.
  • Jack of all, master of some: information network and innovation in crowdsourcing communities
    Hwang, E.H.; Singh, P.V.; Argote, L.
  • Forecasting the commercial attractiveness of user-generated designs using online data: an empirical study within the LEGO user community
    Jensen, M.B.; Hienerth, C.; Lettl, C.
  • Information overload and the message dynamics of online interaction spaces: a theoretical model and empirical exploration
    Jones, Q.; Ravid, G.; Rafali, S.
  • Publication bias in the organizational sciences
    Kepes, S.; Banks, G.C.; Mcdaniel, M.; Whetzel, D.L.
  • Understanding the role and methods of meta-analysis in IS research
    King, W.R.; He, J.
  • Market orientation: a meta-analytic review and assessment of its antecedents and impact on performance
    Kirca, A.H.; Jayachandran, S.; Bearden, W.O.
  • The importance of the raw idea in innovation: testing the sow's ear hypothesis
    Kornish, L.J.; Ulrich, K.T.
  • Persuasion in corporate idea contests: the moderating role of content scarcity on decision-making
    Kruft, T.; Tilsner, C.; Schindler, A.; Kock, A.
  • Recommending valuable ideas in an open innovation community: a text mining approach to information overload problem
    Lee, H.; Choi, K.; Yoo, D.; Suh, Y.; Lee, S.; He, G.
  • Customer favourable idea versus company adoptable idea: comparative analysis through Elaboration Likelihood Model
    Lee, H.; Han, J.; Suh, Y.
  • Empirical study on influence of interaction among users in online brand communities on quality of product idea
    Li, D.; Hu, Y.L.
  • Which ideas are more likely to be implemented in online user innovation communities? An empirical analysis
    Li, M.; Kankanhalli, A.; Kim, S.H.
  • The way in which intervention studies have ‘personality’ and why it is important to meta-analysis
    Lipsey, M.W.; Wilson, D.B.
  • Innovation excellence 2005: how companies use innovation to improve profitability and growth
    Little, A.D.
  • User idea implementation in open innovation communities: evidence from a new product development crowdsourcing community
    Liu, Q.; Du, Q.; Hong, Y.; Fan, W.; Wu, S.
  • The effect of online interaction on users' idea quality in crowdsourcing-based open innovation community: the moderating effect of professional success experience
    Liu, Q.; Sun, B.W.
  • User innovation evaluation: empirical evidence from an online game community
    Ma, J.; Lu, Y.; Gupta, S.
  • Exploring the contributions of involving ordinary users in ideation of technology-based services
    Magnusson, P.R.
  • Exploring holistic intuitive idea screening in the light of formal criteria
    Magnusson, P.R.; Netz, J.; WäStlund, E.
  • Exploring users' appropriateness as a proxy for experts when screening new product/service ideas
    Magnusson, P.R.; WäStlund, E.; Netz, J.
  • Virtual lead user communities: drivers of knowledge creation for innovation
    Mahr, D.; Lievens, A.
  • Meta-analysis in information systems research: method choices and recommendations for future research
    Markus, B.
  • Analysis of open innovation communities from the perspective of social network analysis
    MartíNez-Torres, M.R.
  • Distant search, narrow attention: how crowding alters organizations' filtering of user suggestions in crowdsourcing
    Piezunka, H.; Dahlander, L.
  • Common method biases in behavioral research: a critical review of the literature and recommended remedies
    Podsakoff, P.M.; Mackenzie, S.B.; Lee, J.Y.; Podsakoff, N.P.
  • The value of crowdsourcing: can users really compete with professionals in generating new product ideas?
    Poetz, M.K.; Schreie, M.
  • A meta-analytic investigation of the role of valence in online reviews
    Purnawirawan, N.; Eisend, M.; De Pelsmacker, P.; Dens, N.
  • A machine learning approach for classifying textual data in crowdsourcing
    Rhyn, M.; Blohm, I.
  • The file drawer problem and tolerance for null results
    Rosenthal, R.
  • The right kind of people: characteristics of successful ideators' online behaviour
    Schemmann, B.; Chappin, M.M.H.; Herrmann, A.M.
  • Crowdsourcing ideas: involving ordinary users in the ideation phase of new product development
    Schemmann, B.; Herrmann, A.M.; Chappin, M.M.H.; Heimeriks, G.J.
  • Idea assessment in open innovation: a state of practice
    Schulze, T.; Indulska, M.; Geiger, D.; Korthaus, A.
  • Comparing internal and external lead users as sources of innovation
    Schweisfurth, T.G.
  • The role of perceived comprehension in idea evaluation
    Sukhov, A.
  • A meta-analysis of applications of diffusion models
    Sultan, F.; Farley, J.U.; Lehmann, D.R.
  • Social networks and the diffusion of user-generated content: evidence from YouTube
    Susarla, A.; Oh, J.; Tan, Y.
  • Informational influence in organizations: an integrated approach to knowledge adoption
    Sussman, S.W.; Siegal, W.S.
  • Customer satisfaction: a meta-analysis of the empirical evidence
    Szymanski, D.M.; Henard, D.H.
  • Idea management in Switzerland and Germany: past, present and future
    Thom, N.
  • The front end of innovation: organizing search for ideas
    Van den Ende, J.; Frederiksen, L.; Prencipe, A.
  • Innovation by user communities: learning from open-source software
    Von Hipple, E.
  • Carrots and rainbows: motivation and social practice in open source software development
    Von Krogh, G.; Haefliger, S.; Spaeth, S.; Wallin, M.W.
  • Idea selection and adoption by users – a process model in an online innovation community
    Wang, N.; Tiberius, V.; Chen, X.; Brem, A.; Yu, F.
  • An analytical framework for understanding knowledge-sharing processes in online Q&A communities
    Wang, G.A.; Wang, H.; Li, J.; Abrahams, A.S.; Fan, W.
  • Distant search, but local implementation? Using the crowd's evaluation to overcome organizational limitations in the selection of crowdsourced ideas
    Wimbauer, L.; Figge, P.; Haeussler, C.
  • Differential innovativeness outcomes of user and employee participation in an online user innovation community
    Yan, J.K.; Leidner, D.E.; Benbya, H.
  • How does cognitive fixation affect innovation? An empirical examination of image ideation crowdsourcing
    Yang, G.; Wang, L.
  • Promoting the quality of user generated ideas in online innovation communities: a knowledge collaboration perspective
    Ye, J.; Blohm, I.; Bretschneider, U.; Goswami, S.; Leimeister, J.M.; Krcmar, H.
  • The impact of employee participation in online innovation communities on idea quality
    Yu, J.; Liu, C.
  • How does online interaction affect idea quality? The effect of feedback in firm-internal idea competitions
    Zhu, H.; Kock, A.; Wentker, M.; Leker, J.