高级检索

基于渐进动态掩码及自适应掩码损失函数的中文拼写纠错方法

Chinese Spelling Check Based on Progressive Dynamic Masks and Adaptive Mask Loss Function

  • 摘要: 中文拼写纠错是一项检测和纠正中文文本中错误字符的任务,这些错误通常是由于许多汉字字符在字形或发音上具有相似性所引起。由于目前存在缺乏大规模标注数据的问题,因此该文提出一种基于由易到难的动态掩码的数据增强方法,通过在训练过程中向源句由易到难地动态添加掩码,生成了更多样的纠错句子对。同时,该文提出了一种自适应掩码损失函数,给予不同难度掩码的样本不同的关注度。在SIGHAN 2013、SIGHAN 2014、SIGHAN 2015数据集上的 F_1 值分别为85.1%、70.7%、81.0%。结果证明,该文所提出的方法性能优于基线模型,能够有效缓解缺乏大规模标注句子的问题,显著提高了中文拼写纠错模型的准确率。

     

    Abstract: Chinese Spelling Correction is a task aimed at detecting and correcting misspelled characters in Chinese texts. Due to the current challenge of lacking large-scale annotated sentences, this paper proposes a data augmentation method based on dynamic masking from easy to hard. This method dynamically adds masks to source sentences from easy to hard during the training process, generating a more diversified set of correction sentence pairs. Additionally, this paper introduces an adaptive masking loss function that assigns different levels of attention to samples with different difficulty masks. On the SIGHAN 13, SIGHAN 14, and SIGHAN 15 datasets, experiments demonstrate the proposed method out-perform baselines with F1 scores of 85.1%, 70.7%, and 81.0%, respectively.

     

/

返回文章
返回