高级检索

结构感知学习的表格到文本生成方法

Structure-aware Learning for Table-to-text Generation

  • 摘要: 表格到文本的生成任务是生成一段文本,使其能够重现表格中键与值所定义的语义事实,近年该任务成为文本生成中的研究热点。已有工作在预训练模型的支撑下,能够生成流畅度尚好的文本,但是大多采用序列编码形式,会使表中键值对中的键(值)与其他键值对中的值(键)发生语义关联,导致生成错误的语义事实。由此,表格中键与值之间的语义关系建模成为其主要问题。该文提出一种基于结构感知学习的表格到文本生成模型,其中包括:①可定义的掩码矩阵及自动生成算法,用于表格键值语义关系的定义;②引入掩码矩阵的多头自注意力机制,用于表格结构关系的学习;③文本重建任务的训练方法,用于增强表格语义结构表示学习。在国际公开表格到文本生成数据集E2E和WikiBio上进行评测实验,发现该文所提方法在BLEU值上比T5强基线模型分别提升1.17和0.63,表明该方法可以有效学习表格中的结构关系,改进生成文本的质量。

     

    Abstract: The task of table-to-text generation is to generate the text describing the semantic facts defined by key-value pairs in a table. The existing work based on pre-trained models are challenged by the semantic relationships between keys and values in tables. In this paper, we propose a structure-aware learning-based table-to-text generation model. The method includes (1) a definable mask matrix and an automatic generation algorithm for the definition of semantic relations of table keys and values; (2) a structure-aware multi-headed self-attention mechanism introducing the mask matrix for the learning of table structural relations; (3) a training method for the text reconstruction task to enhance the learning of semantic structural representation of tables. Experimental results on the E2E and WikiBio datasets show that the proposed method improves 1.17 and 0.63 BLEU values, respectively, compared with the strong baseline model T5.

     

/

返回文章
返回