Transformer-Based Multi-Model Rank Fusion for Cross-Domain Recommendation and Dense Information Retrieval

2026-9-04
Aydoğdu, Mehmet Erdeniz
Rank fusion is an effective approach for combining outputs from multiple ranking models, though existing methods often have difficulty generalizing across different data environments. This thesis introduces EmbMerge, a transformer-based framework that frames rank fusion as a sequence modeling task by mapping discrete ranking features—items, scores, models, and positional ranks—into continuous embedding spaces. The framework is evaluated across two distinct domains: implicit feedback Cross-Domain Recommendation (CDR) and dense semantic Information Retrieval (IR). To handle differing domain constraints, EmbMerge introduces two scoring architectures: a Standard model for global list scaling, and a Direct Prediction model for localized fusion. Our empirical evaluation highlights key architectural trade-offs. In the CDR pipeline, experiments on datasets like Digix and Amazon show that the network relies heavily on explicit item embeddings and absolute scoring, optimized via pointwise Binary Cross-Entropy (BCE) loss. For the dense IR domain, however, the Direct Prediction architecture employs a residual "neural delta" approach trained via InfoNCE contrastive loss. Ablation studies on the zero-shot BEIR benchmark indicate that although item embeddings improve in-domain retrieval, they can hinder domain transfer due to corpus memorization. Thus, zero-shot generalization is more effectively achieved by excluding explicit item representations. Overall, EmbMerge demonstrates strong performance against traditional baselines. This research suggests that domain-independent fusion benefits significantly from dynamically adapting network inputs, scoring architectures, and objective functions to the specific structural requirements of the underlying base models.
Citation Formats
M. E. Aydoğdu, “Transformer-Based Multi-Model Rank Fusion for Cross-Domain Recommendation and Dense Information Retrieval,” M.S. - Master of Science, Middle East Technical University, 2026.