Skip to main navigation Skip to search Skip to main content

Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation

  • Wangyu Wu
  • , Xuhang Chen
  • , Zhenhong Chen
  • , Jing En Jiang
  • , Kim Fung Tsang
  • , Xiaowei Huang
  • , Fei Ma*
  • , Jimin Xiao*
  • *Corresponding author for this work
  • Xi'an Jiaotong-Liverpool University
  • University of Liverpool
  • Huizhou University
  • Microsoft USA
  • Shandong University
  • Shenzhen Institute of Advanced Technology

Research output: Contribution to journalArticlepeer-review

10 Citations (Scopus)

Abstract

Cross-Domain Sequential Recommendation (CDSR) plays a crucial role in modern consumer electronics and e-commerce platforms, where users interact with diverse services such as books, movies, and online retail products. These systems must accurately capture both domain-specific and cross-domain behavioral patterns to provide personalized and seamless consumer experiences. To address this challenge, we propose TEMA-LLM (Tag-Enriched Multi-Attention with Large Language Models), a practical and effective framework that integrates Large Language Models (LLMs) for semantic tag generation and enrichment. Specifically, TEMA-LLM employs LLMs to assign domain-aware prompts and generate descriptive tags from item titles and descriptions. The resulting tag embeddings are fused with item identifiers as well as textual and visual features to construct enhanced item representations. A Tag-Enriched Multi-Attention mechanism is then introduced to jointly model user preferences within and across domains, enabling the system to capture complex and evolving consumer interests. Extensive experiments on four large-scale e-commerce datasets demonstrate that TEMA-LLM consistently outperforms state-of-the-art baselines, underscoring the benefits of LLM-based semantic tagging and multi-attention integration for consumer-facing recommendation systems. The proposed approach highlights the potential of LLMs to advance intelligent, user-centric services in the field of consumer electronics.

Original languageEnglish
JournalIEEE TRANSACTIONS ON CONSUMER ELECTRONICS
DOIs
Publication statusAccepted/In press - 2025

Keywords

  • CDSR
  • Large Language Models
  • Multi-Attention Mechanism
  • Tag-Enriched

Fingerprint

Dive into the research topics of 'Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation'. Together they form a unique fingerprint.

Cite this