Decoding Wikipedia's Web of Trust: Predicting Votes via Social Network Metrics

Predicting Trust in Wikipedia’s Vote Network Using Social Networks measures

2017-01-01
J. David Nuñez-Gonzalez, Manuel Graña
Summary
Problem
Method
Results
Takeaways
Abstract

This paper presents a trust prediction framework for Wikipedia’s Vote Network using Social Network Analysis (SNA) metrics. By extracting 20 structural features from positive, negative, and total adjacency matrices, the authors trained multiple classifiers—notably Random Forest—to predict whether a user will support or oppose a candidate for adminship.

TL;DR

Can we predict how one Wikipedia editor will vote on another's promotion? This paper investigates trust prediction by transforming the "Wikipedia Voted Network" into a series of structural features. By leveraging Degree Centrality, Betweenness, and Clustering Coefficients across positive and negative relationship sub-graphs, the authors achieved nearly 90% accuracy in predicting trust using Random Forest classifiers.

Context & Motivation

In the digital world, "Trust" is more than a feeling—it is a measurable link in a Social Network. Wikipedia's "Request for Adminship" (RfA) process is a goldmine for this research. When a user is nominated for admin privileges, other users vote: Support (+1), Neutral (0), or Oppose (-1).

The authors argue that previous models often missed the "structural fingerprint" of the users involved. Their insight was to treat trust not just as a global reputation score, but as a local network property. Why does a specific user trust another? It likely depends on their shared neighbors and their historical voting behaviors within the network structure.

Methodology: The Architecture of Trust

The core of the methodology lies in Feature Engineering. Since the Wikipedia network is "signed" (positive and negative), the authors couldn't use a single adjacency matrix. Instead, they decomposed the network into three perspectives:

  1. Adj_pos: Only positive (support) links.
  2. Adj_neg: Only negative (oppose) links.
  3. Adj_tot: All links treated as neutral connections.

From these, they extracted 20 specific features for every pair (Actor A, Actor B):

  • Degree Centrality: Measuring the "flow" of votes in and out of the nodes.
  • Betweenness: Identifying if a user acts as a "bridge" between different communities in the network.
  • Clustering Coefficient: Measuring the density of a user's local neighborhood (the "ego network").

Structural Feature extraction logic Fig 1: The feature extraction process involves calculating SNA measures across polarized sub-graphs.

Experiments and Performance

The researchers tested seven different combinations of these feature groups (DB1 through DB7) across various machine learning algorithms, including Naive Bayes, Multilayer Perceptrons (MP), and Random Forests (RF).

Key Findings:

  • Winning Model: Random Forest (RF) consistently outperformed others, hitting an 89.40% Overall Accuracy (OA).
  • Feature Importance: Contrary to intuition, Node Betweenness was a weak predictor. Databases including betweenness (DB2, DB6) performed significantly worse than those focusing on local connectivity (Degree and Clustering).
  • Class Imbalance: The dataset was heavily skewed (approx. 80% positive votes). Despite this, the model achieved a Recall of 66.9% for the negative class, which is a vital metric for identifying potential "distrust" or conflict.

Experimental Results Comparison Table 1: Summary of the best results across different feature databases (DB1-DB7).

Critical Analysis & Conclusion

Takeaway

The paper proves that a user's structural position in a trust network—specifically their "local density" and "inbound/outbound flow"—is a highly reliable indicator of their future voting behavior. You don't need complex user profiles; the graph structure speaks for itself.

Limitations & Future Work

  • Temporal Dynamics: The study treats the network as static, whereas Wikipedia elections happen over time. A user's reputation evolves.
  • Neutrality: The researchers ignored neutral (0) votes to simplify the problem into a binary classification. In a real-world setting, "Neutral" is a significant signal that remains unexplored here.

By focusing on the "dark side" of trust (negative votes), this work provides a foundation for more robust social network moderation and security tools, ensuring that "bad actors" are easier to spot before they gain administrative power.

References

  • Leskovec et al. (2010) - Predicting positive and negative links in online social networks.
  • Wasserman & Faust (1994) - Social Network Analysis: Methods and Applications.

Find Similar Papers

Try Our Examples

  • Search for recent papers on trust prediction in signed social networks using Graph Neural Networks (GNNs) or link prediction methods.
  • What is the original definition of the Clustering Coefficient in directed graphs by Watts and Strogatz, and how has it been adapted for signed networks?
  • Explore how trust prediction models developed for Wikipedia adminship voting are applied to fraud detection in e-commerce or Sybil attack prevention.
Contents
Decoding Wikipedia's Web of Trust: Predicting Votes via Social Network Metrics
1. TL;DR
2. Context & Motivation
3. Methodology: The Architecture of Trust
4. Experiments and Performance
4.1. Key Findings:
5. Critical Analysis & Conclusion
5.1. Takeaway
5.2. Limitations & Future Work
6. References