Inside the Social Crowdsourcing Engine: Interaction Dynamics and Evolution

A Social Crowdsourcing Community Case Study: Interaction Patterns, Evolution, and Factors That Affect Them

2020-04-07
Khobaib Zaamout, Tom Arjannikov, Ken Barker
Summary
Problem
Method
Results
Takeaways
Abstract

This paper presents a longitudinal case study of a Social Crowdsourcing Community (SCC), analyzing five years of interaction data from its inception. By applying Social Network Analysis (SNA) and time-series decomposition, the authors characterize the evolution of member behaviors and the structural stability of the interaction network.

TL;DR

This study offers a rare, five-year longitudinal look at a private Social Crowdsourcing Community (SCC) from its very first day. The findings reveal a "volatile yet stable" ecosystem: while individual interaction pairs die out quickly, the community's structural health is maintained by a constant influx of new blood and a shared interest in task-related artifacts rather than social bonding.

Background: The SCC vs. The Social Network

Most of us understand Social Networks (SNs) as platforms for maintaining "friendships" or "associations." However, a Social Crowdsourcing Community (SCC) operates differently. It is a moderated, gamified space where members are recruited to solve specific problems for a beneficiary (e.g., a smartphone manufacturer).

The core insight of this paper is that interactions in SCCs are not indicators of friendship. Instead, they reflect a "coworker" dynamic where people interact because they care about the same topic (the "artifact"), not necessarily because they know each other.

Methodology: Decoding the Interaction DNA

The authors analyze over 770,000 interactions, focusing on the hierarchy of artifacts:

  1. Queries: Posted by moderators (The Root).
  2. Responses: Members answering the queries.
  3. Comments: Discussions surrounding those responses.

The Pareto Distribution of Participation

The study found a massive disparity in activity levels. Splitting the users into "frequent" and "infrequent" groups (based on the Pareto principle) revealed specialized roles:

  • Frequent Members: The "First Responders" who jump on new queries quickly.
  • Infrequent Members: The "Discussants" who initiate deeper conversations around existing responses.

Model Architecture: The Social Crowdsourcing Process

Why Do People Respond? The Role of Rewards and Following

One of the most actionable parts of the study involves responsiveness. The authors tested two factors:

  1. Follow: Getting notified when a specific member or artifact is active.
  2. Rewards: The gamification aspect (badges).

Using the Kolmogorov–Smirnov test, the authors proved that following has a stronger immediate impact on speed, but rewards provide more consistent motivation over time. When combined (the "TT" group in the data), responsiveness reaches its peak.

Evidence: Response Time CDFs

Network Evolution: The Stability Paradox

The most surprising find is the "Stability Paradox." From a microscopic view, the network is chaotic—71% of pairs that interact this month won't interact next month. Yet, from a macroscopic view, the network's structural properties (like density and average path length) remain remarkably stable over years.

The Two Pillars of Stability:

  1. High Replenishment Rate: For every 100 members who stop interacting, 129 new members step in.
  2. Novelty Bias: Members have a persistent tendency to interact with new people they've never engaged with before.

Structural Stability over Time

Takeaway for Community Builders

For those managing online communities or crowdsourcing platforms, the lesson is clear: Churn is not necessarily a failure of the system. In an SCC, the constant rotation of members prevents "cliques" and ensures a fresh stream of perspectives. To keep the engine running, focus on:

  • Facilitating "Following": It's the #1 driver for day-one engagement.
  • Pacing Rewards: Use badges to sustain engagement as the "novelty" of following wears off.
  • Monitoring the Replenishment Rate: As long as new members arrive faster than old ones leave, the network's structural integrity remains safe.

Future Work

The authors suggest that the next frontier is developing a "topology-generation model" to simulate how these communities might react to "attacks" or sudden shifts in moderation, providing a playbook for community resilience.

Find Similar Papers

Try Our Examples

  • Search for recent longitudinal studies on gamification effectiveness in enterprise crowdsourcing platforms beyond brand advocacy.
  • Which paper first established the distinction between "association networks" and "interaction networks" in social computing, and how does this paper extend that theory?
  • Examine how the structural stability of interaction networks in SCCs compares to that of decentralized Autonomous Organizations (DAOs) or open-source software communities.
Contents
Inside the Social Crowdsourcing Engine: Interaction Dynamics and Evolution
1. TL;DR
2. Background: The SCC vs. The Social Network
3. Methodology: Decoding the Interaction DNA
3.1. The Pareto Distribution of Participation
4. Why Do People Respond? The Role of Rewards and Following
5. Network Evolution: The Stability Paradox
5.1. The Two Pillars of Stability:
6. Takeaway for Community Builders
7. Future Work