高级检索

面向工艺规范文本的误写术语预检特征矩阵增强检错模型

Error Detection Model with Miswritten Terminology Feature Matrix for Process Specification Texts

  • 摘要: 文本检错是缩减工艺规范审校时间与节约成本的有效途径。工艺规范是一种专业技术文件,包含大量术语,使得通用领域检错方法在工艺规范文本上效果不佳。现有检错方法对术语词典资源利用不足,难点在于无法判断未在术语词典内的词是未登录词还是被误写词。针对该难点,该文提出了误写术语预检特征矩阵增强检错模型,用n-gram相似性匹配的方法对可能误写术语进行预检,基于预检特征构造误写术语预检特征矩阵指导神经网络模型训练与检错,并针对工艺领域缺乏检错语料的问题,构建了工艺规范文本检错语料(PS-TEDC),含冗余、缺失、替换与语序不当4类错误共12157句。该语料是首个面向工艺领域的中文文本检错语料。实验表明,加入误写术语预检矩阵后所有基模型F1值都有所提升,最高F1值达到75.11%,术语检错的F1值提升了4.42%。

     

    Abstract: Text error detection is an effective approach to reduce the time and cost of reviewing process specification texts. As a specialized technical document, process specification texts contain a large amount of terminology, which makes general domain error detection methods ineffective for process specification texts. To tackle this challenge, this paper proposes an error detection model with miswritten terminology feature matrix, which utilizes the n-gram similarity matching method to pre-check potential miswritten terminology. Meanwhile, this paper constructs a process specification text error detection corpus (PS-TEDC), which includes four types of errors: redundant words, missing words, word selection errors, and word ordering errors, totaling 12157 sentences. Experimental results demonstrate the F1 value of all baseline models has improved after adding the miswritten terminology pre-check matrix, with the highest F1 value of 75.11%.

     

/

返回文章
返回