arxiv Preprint – Active Retrieval Augmented Generation

In this episode we discuss Active Retrieval Augmented Generation
by Zhengbao Jiang, Frank F. Xu, Luyu Gao, Zhiqing Sun, Qian Liu, Jane Dwivedi-Yu, Yiming Yang, Jamie Callan, Graham Neubig. The paper presents FLARE, a method that improves the performance of language models by incorporating retrieval of information from external knowledge resources. Unlike existing retrieval-augmented models, FLARE actively decides when and what to retrieve throughout the generation process, anticipating future content using sentence predictions. The authors demonstrate the effectiveness of FLARE in four knowledge-intensive generation tasks, showing its superiority or comparability to baseline models and its ability to improve the accuracy and reliability of generated text.