高级检索

基于CINO预训练模型与上下文理解的藏文事件检测

Tibetan Event Detection Based on CINO Pre-trained Language Model and Contextual Understanding

  • 摘要: 针对藏文事件检测任务中标注数据匮乏、形态结构复杂等挑战,该文提出了一种基于CINO预训练模型与融合多层级注意力机制的端到端事件检测方法。通过构建藏文政务评论事件数据集(包含2 012条数据、10类事件类型),结合动态分词边界优化策略,融合句子级语义特征与词级语义特征,使用CRF进行解码约束,有效解决了藏文触发词歧义与分词错误传导问题,最后通过损失函数联合优化提升模型性能。实验表明,该模型在低资源场景下显著优于主流基线模型,分类任务F1值达85.07%,事件检测任务F1值达77.79%,验证了其在藏文语义理解与事件检测任务中的鲁棒性。

     

    Abstract: To address the challenges of scarce annotated data and complex morphological structures in Tibetan event detection tasks, this paper proposes an end-to-end event detection method based on the CINO pre-trained model and a multi-level attention fusion mechanism. We construct a Tibetan government-comment event dataset of 2,012 samples with 10 event types. To effectively resolving Tibetan trigger word ambiguity and error propagation caused by word segmentation, we employ dynamic word segmentation boundary optimization strategies, fuse sentence-level and word-level semantic features and adopt a Conditional Random Field (CRF) for decoding constraints. Experiments demonstrate that our model significantly outperforms mainstream baseline models in Tibetan, achieving an F1-score of 85.07% in classification tasks and 77.79% in event detection tasks.

     

/

返回文章
返回