基于预训练语言模型的可解释性多跳问答方法
Explainable Multi-hop Question Answering Based on Pretrained Language Models
-
摘要: 问答(Question Answering, QA)系统是自然语言处理(Natural Language Processing, NLP)领域中综合性很强的一个具有挑战性的任务,其旨在用自然语言回答用户提出的问题,可以按问题类型分为单跳问答和多跳问答(Multi-hop Question Answering, MHQA)两类,解决多跳问答问题是问答领域中的一个难点,而对多跳问答的结果进行解释更为困难。因此,该文针对HotpotQA可解释性多跳问答数据集提出了一种基于预训练语言模型(Pretrained Language Models, PLMs)的方法,首先采用分治策略按照简单的分解规则将复杂的多跳问题分解为单跳子问题,并使用无监督对比学习的预训练语言模型对其进行编码。在答案生成的过程中,使用窗口自注意力机制,并采取“两步筛选”法检索答案所在的支持事实句并获取答案。通过在HotpotQA distractor数据集上实验并与其他12种方法进行比较,所提方法的联合EM值达到48.10%,优于其他模型;消融实验表明,该文提出的各个模块都对模型整体性能的提高有所贡献。Abstract: Question Answering is a challenging task in Natural Language Processing, ‘which can be classified into single-hop Question Answering and multi-hop Question Answering. To address the more challenging multi-hop question answeringtask, this paper proposes a method based on pretrained language models for the HotpotQA explainable multi-hop question answering dataset. This method applies the classical Divide and Conquer strategy to split the multi-hop questions into simpler single-hop sub questions. These sub questions are encoded using a pretrained language model with unsupervised contrastive learning, and data augmentation is applied to improve the question decomposition accuracy. In the process of answer generation, we proposes a window self-attention mechanism and adopt a “two-step filtering” method to retrieve the supporting facts and the answers. Experiments on HotpotQA distractor dataset demonstrate that the proposed method outperformed other 12 alternatives by achieving 48.10% EM score.
下载: