高级检索

面向小样本工艺文本关系抽取的最近邻提示学习方法

Nearest Neighbor Prompt Learning Method for Few-shot Relation Extraction from Process Text

  • 摘要: 工艺文本关系抽取任务有着较强的应用需求。但工艺文本中繁多而复杂的关系使得其关系类数量较大,从而引发了两个主要问题:一方面,部分关系类下的实例数量十分有限,加之工艺文本标注任务难度较高,使得该任务面临着小样本问题;另一方面,关系类数量较大,意味着关系类划分较为细致,导致部分关系类之间的差异微小,产生了混淆类问题。为解决以上问题,该文提出了最近邻提示学习模型K-PTR。首先,该模型在提示学习阶段为每个关系类设定了标签字集合,概括了工艺文本中关系的实体类型和关系内容并引导模型学习,帮助模型有效提高小样本情况下的样本利用率。然后,利用KNN方法结合实例的相似度完成待测实例关系类的推理和预测,进一步改善模型预测效果。最后,在工艺文本关系抽取数据集上进行实验,在4个小样本实验上K-PTR的F1值分别提升了1.2%、1.9%、1.8%、2.5%。此外,在4-shot数据集上,最优情况下K-PTR使得混淆类的混淆率下降了11.15%。

     

    Abstract: The process text relationship extraction task is of strong application value. To deal with the numerous and complex relationships in process texts, this paper proposes the nearest neighbor prompt learning model K-PTR. Firstly, the model sets a label set for each relationship class in the prompt learning stage and summarizes the entity types and relationship contents of the relationship in the process text, which helps the model effectively improve the sample utilization rate in the case of few-shot. Then the KNN method is used to combine the similarity of instances to complete the reasoning and prediction of the relationship categories of the instances to be tested Experiments indicate that the F1 values of K-PTR are increased by 1.2%, 1.9%, 1.8% and 2.5% in four -shot experiments, respectively.

     

/

返回文章
返回