New Publication in the International Journal of Human-Computer Studies (IJHCS)

  • Date: 31.03.2017

New publication in IJHCS: "Gamified crowdsourcing: Conceptualization, literature review, and future agenda"

The International Journal of Human-Computer Studies published a new research paper by Benedikt Morschheuser, Prof. Alexander Mädche and our colleagues from Tampere University of Technology Prof. Juho Hamari and Jonna Koivisto. The paper provides a holistic overview of current research on the gamification of crowdsourcing systems, based on a review of 110 studies that have been conducted in that field in recent years.

Specifically, the paper review the use of different forms of gamification in different types of crowdsourcing, as well as the interplay of gamification and monetary rewards, the types of work being crowdsourced, the types of crowdsourcees, the domains where gamification in crowdsourcing have been applied, and empirical results of studies on the effectiveness of gamification in crowdsourcing. Based on a meticulous mapping, the authors 1) infer what kinds of gamification efforts are effective in different kinds of crowdsourcing approaches, 2) derive recommendations for designers of gamified crowdsourcing systems, and 3) outline a research agenda for future research.

Insights from the publication

Two parallel phenomena are gaining attention in human-computer interaction research: gamification and crowdsourcing. Because crowdsourcing’s success depends on a mass of motivated crowdsourcees, crowdsourcing platforms have increasingly been imbued with motivational design features borrowed from games; a practice often called gamification. While the body of literature and knowledge of the phenomenon have begun to accumulate, we still lack a comprehensive and systematic understanding of conceptual foundations, knowledge of how gamification is used in crowdsourcing, and whether it is effective.

We first provide a conceptual framework for gamified crowdsourcing systems in order to understand and conceptualize the key aspects of the phenomenon. The paper’s main contributions are derived through a systematic literature review that investigates how gamification has been examined in different types of crowdsourcing in a variety of domains. This meticulous mapping, which focuses on all aspects in our framework, enables us to infer what kinds of gamification efforts are effective in different crowdsourcing approaches as well as to point to a number of research gaps and lay out future research directions for gamified crowdsourcing systems.

Overall, the results indicate that gamification has been an effective approach for increasing crowdsourcing participation and the quality of the crowdsourced work; however, differences exist between different types of crowdsourcing: the research conducted in the context of crowdsourcing of homogenous tasks has most commonly used simple gamification implementations, such as points and leaderboards, whereas crowdsourcing implementations that seek diverse and creative contributions employ gamification with a richer set of mechanics.

You can access the publication here.

Citation: Morschheuser, B., Hamari, J., Koivisto, J., & Maedche, A. (2017). Gamified Crowdsourcing: Conceptualization, literature review, and future Agenda. International Journal of Human-Computer Studies, 107, 26-43
Conceptual Framework