[Under Review 2026] IDProxy: Bridging the Semantic-Collaborative Gap for Cold-Start Ads at Xiaohongshu

IDProxy: Cold-Start CTR Prediction for Ads and Recommendation at Xiaohongshu with Multimodal LLMs

Summary
Problem
Method
Results
Takeaways
Abstract

IDProxy is a production-scale cold-start CTR prediction framework deployed at Xiaohongshu that leverages Multimodal Large Language Models (MLLMs). It uses a coarse-to-fine alignment mechanism to generate "proxy" item embeddings from text and images, effectively substituting missing ID embeddings for new items and achieving SOTA performance in industrial recommendation and advertising.

TL;DR

Xiaohongshu (RedNote) engineers have solved the notorious "Cold-Start" problem in CTR prediction by using IDProxy. This system uses Multimodal LLMs (MLLMs) to generate "proxy" embeddings for new items that behave exactly like well-trained ID embeddings. By aligning MLLM hidden states with existing recommendation architectures, they achieved a +1.93% increase in Advertiser Value and a 2x AUC improvement for new content compared to global traffic.

The Semantic Mismatch: Why Cold-Starts are Hard

In industrial systems, CTR models are "ID-centric." They learn specific embeddings for every post or ad based on user interactions. When a new post is uploaded, it has no ID history—it is invisible to the collaborative filtering logic.

The researchers at Xiaohongshu pointed out a critical "Insight": Academic benchmarks (like MovieLens) are misleading. In those datasets, ID embeddings form neat clusters based on genres. In a real-world system like Xiaohongshu, ID distributions are irregular and sparse (see Figure 1), making simple MLP mappings from text/image to IDs fail.

Visualization of ID Embeddings: MovieLens vs. Xiaohongshu Figure 1: Comparison between academic (Left) and industrial (Right) ID distributions. The irregular distribution in production demands a more sophisticated alignment than simple projection.

Methodology: Coarse-to-Fine Alignment

IDProxy operates in two distinct stages to bridge the gap between multimodal semantics and ranking structures.

Stage 1: Coarse Proxy Generation

The system feeds the post's image and text into an MLLM (InternVL). Instead of just taking the text output, it uses a special [EMB] token. Through Contrastive Learning, the MLLM is trained to pull the content representation toward the actual ID embeddings of high-frequency (well-trained) items.

Stage 2: CTR-Aware Fine-Graining

A key contribution of this paper is the Structural Reuse. Instead of treating the MLLM output as a "side feature," IDProxy injects it into the Atomic ID Slots of the ranking model.

  • Hierarchical Partitioning: They extract hidden states from shallow, middle, and deep layers of the MLLM (using K-means to group layers).
  • Lightweight Adaptor: A small MLP fuses these multi-granularity features.
  • Residual Gating: This ensures the model only uses the new fine-grained info that isn't already captured by the coarse proxy.

IDProxy Architecture Overview Figure 2: The IDProxy workflow. Content features flow through an MLLM and a gated adaptor to eventually reside in the same feature interaction space as traditional ID embeddings.

Experimental Results: Real-World Impact

The results demonstrate that "plugging in" MLLM knowledge into an existing ranker is far more effective than training a new multimodal model from scratch.

  • Ablation Success: Replacing static MLP mappings with the full IDProxy (Stage 1+2) increased AUC by +0.14% (which is massive for a system serving 300M+ users).
  • Cold-Start Efficiency: For "New Notes" (published <24 hours), the AUC lift was 0.32%, double the gains seen on global traffic.
Metric (Online A/B)Content Feed ImprovementDisplay Ads Improvement
Reads/Impression+0.39%+1.28%
Engagement+0.50%-
Advertiser Value (ADVV)-+1.93%
Business COST-+1.73%

Critical Insight & Conclusion

The core value of IDProxy lies in its Inductive Bias. Most researchers try to make CTR models more like LLMs. Xiaohongshu did the opposite: they forced a powerful MLLM to "speak the language" of their existing CTR ranker.

By reusing the structural priors (the target attention and sequence modules) of the production model, they avoided the "cold-start" of the ranking architecture itself. This work proves that we don't need to replace our mature recommendation pipelines to benefit from the LLM revolution; we just need a smarter proxy.

Limitations

While effective, the system requires real-time inference or pre-computation of MLLM embeddings for every new post. For platforms with millions of daily uploads, the computational overhead of the MLLM encoding stage remains a bottleneck that requires careful engineering of the "IDProxy generation service."

Find Similar Papers

Try Our Examples

  • Search for recent papers using hierarchical hidden state extraction from MLLMs for downstream ranking or retrieval tasks.
  • Identify the origin of contrastive alignment between multimodal content and collaborative filtering embeddings, and how IDProxy's "irregular distribution" observation differs from academic benchmarks.
  • Explore research applying MLLM-based proxy IDs to other sparse-data domains like cold-start user modeling or cross-domain recommendation.
Contents
[Under Review 2026] IDProxy: Bridging the Semantic-Collaborative Gap for Cold-Start Ads at Xiaohongshu
1. TL;DR
2. The Semantic Mismatch: Why Cold-Starts are Hard
3. Methodology: Coarse-to-Fine Alignment
3.1. Stage 1: Coarse Proxy Generation
3.2. Stage 2: CTR-Aware Fine-Graining
4. Experimental Results: Real-World Impact
5. Critical Insight & Conclusion
5.1. Limitations