TY - GEN
T1 - Identify User Intention for Recommendation Using Chain-of-Thought Prompting in LLM
AU - Li, Gangmin
AU - Yang, Fan
AU - Yue, Yong
N1 - Publisher Copyright:
© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2026.
PY - 2024
Y1 - 2024
N2 - It is crucial for a recommendation system to accurately identify a user’s intention since it dictates the user’s selection once multiple candidates are faced. Traditional user intention identification uses the user’s selection among various items. This technique relies primarily on historical behavioural data, resulting in problems such as the cold start, unintended choice, and failure when unseen items occur. Motivated by recent advancements in Large Language Models (LLMs) like ChatGPT, we present an approach for user intention identification by leveraging Chain-of-Thought (CoT) prompting in an LLM. We use the initial user profile as inputs to LLMs and design a collection of prompts to align the LLM’s response through various recommendation tasks encompassing rating prediction, search and browse history, user clarification, etc. to identify the user’s intention and then the same input with generated user intention feed to the LLM to produce recommendations. We tested our approach with real-world datasets to demonstrate the improvements in the recommendation by comparing the recommendation without the intention of merging it into a user model. The results indicate clear improvements.
AB - It is crucial for a recommendation system to accurately identify a user’s intention since it dictates the user’s selection once multiple candidates are faced. Traditional user intention identification uses the user’s selection among various items. This technique relies primarily on historical behavioural data, resulting in problems such as the cold start, unintended choice, and failure when unseen items occur. Motivated by recent advancements in Large Language Models (LLMs) like ChatGPT, we present an approach for user intention identification by leveraging Chain-of-Thought (CoT) prompting in an LLM. We use the initial user profile as inputs to LLMs and design a collection of prompts to align the LLM’s response through various recommendation tasks encompassing rating prediction, search and browse history, user clarification, etc. to identify the user’s intention and then the same input with generated user intention feed to the LLM to produce recommendations. We tested our approach with real-world datasets to demonstrate the improvements in the recommendation by comparing the recommendation without the intention of merging it into a user model. The results indicate clear improvements.
KW - Chain-Of-Thought Prompting
KW - Generative User Modelling
KW - Large Language Models
KW - Personalized Recommendation
KW - User Intention Identification
UR - https://www.scopus.com/pages/publications/105011967888
U2 - 10.1007/978-3-031-92625-9_5
DO - 10.1007/978-3-031-92625-9_5
M3 - Conference Proceeding
AN - SCOPUS:105011967888
SN - 9783031926242
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 60
EP - 69
BT - Emerging Technologies in Computing - 7th EAI International Conference, iCETiC 2024, Proceedings
A2 - Miraz, Mahdi H.
A2 - Miraz, Mahdi H.
A2 - Ware, Andrew
A2 - Southall, Garfield
A2 - Ali, Maaruf
PB - Springer Science and Business Media Deutschland GmbH
T2 - 7th EAI International Conference on Emerging Technologies in Computing, iCETiC 2024
Y2 - 15 August 2024 through 16 August 2024
ER -