Exciting advancement in recommendation systems from the team at Meituan and Renmin University of China!
Introducing the Dual-Flow Generative Ranking Network (DFGR), an innovative two-stream architecture transforming recommendation approaches by effectively modeling user behaviors.
Traditional recommendation models often depend heavily on manual feature engineering, limiting performance due to information loss. DFGR addresses this by directly utilizing raw user behavior sequences and minimal attribute data, significantly streamlining the process.
Under the hood, DFGR splits user interaction sequences into two flows-real and fake. Both flows share parameters within a decoder-only Transformer network, employing specialized self-attention mechanisms. While the real flow carries genuine action identifiers (e.g., clicks, purchases), the fake flow uses placeholders. During training, this setup ensures comprehensive contextual understanding without revealing action labels prematurely, vastly improving training stability and efficiency compared to Meta's generative recommendation (MetaGR).
At inference, DFGR adopts a single-flow strategy, concatenating candidate items and historical user data, allowing rapid, parallel scoring through a single forward pass. This achieves approximately 4x inference efficiency over previous methods.
Evaluations on open-source datasets (RecFlow, KuaiSAR) and an extensive industrial dataset (TRec) demonstrated DFGR's clear superiority, surpassing established baselines including DIN, DCN, DIEN, DeepFM, and MetaGR.
This advancement not only marks a substantial leap in recommendation technology but also provides valuable insights into optimal parameter allocation and the scaling potential of generative ranking models.