arxiv Preprint – Large Language Models as Zero-Shot Conversational Recommenders

In this episode we discuss Large Language Models as Zero-Shot Conversational Recommenders
by Zhankui He, Zhouhang Xie, Rahul Jha, Harald Steck, Dawen Liang, Yesu Feng, Bodhisattwa Prasad Majumder, Nathan Kallus, Julian McAuley. This paper presents empirical studies on conversational recommendation tasks using large language models (LLMs) in a zero-shot setting, without fine-tuning. The authors introduce a new dataset of recommendation-related conversations, the largest public real-world conversational recommendation dataset to date, and find that LLMs outperform existing fine-tuned conversational recommendation models on this dataset and two others. The authors also propose probing tasks to investigate the mechanisms behind LLM performance and analyze both the models’ behaviors and the characteristics of the datasets.