Poster
in
Affinity Event: Muslims in ML
Say Less, Mean More: Leveraging Pragmatics in Retrieval-Augmented Generation
Haris Riaz · Ellen Riloff · Mihai Surdeanu
Keywords: [ pragmatics ] [ RAG ] [ reasoning ] [ multi-hop retrieval ] [ LLM ]
We propose a simple, unsupervised method that injects pragmatic principles in retrieval-augmented generation (RAG) frameworks such as Dense Passage Retrieval (DPR). Our approach first identifies which sentences in a pool of documents retrieved by RAG are most relevant to the question at hand, cover all the topics addressed in the input question and no more, and then highlights these sentences in the documents before they are provided to the LLM. We show that this simple idea brings consistent improvements in experiments on three question answering tasks (ARC-Challenge, PubHealth and PopQA) using three different LLMs. It notably enhances accuracy by up to 19.7% compared to a conventional RAG system on PubHealth.
Live content is unavailable. Log in and register to view live content