高级检索

基于预训练模型的文本常识合理性估计研究综述

Commonsense Plausibility Estimation Based on Pretrained Models: A Survey

  • 摘要: 文本常识合理性估计旨在评估文本内容是否符合人类日常经验与普遍认知,是提升自然语言处理系统可靠性的关键技术。相较于早期依赖规则和知识库的方法,基于预训练模型的方法通过自监督学习隐式编码常识知识,在泛化性和灵活性上实现突破,成为当前主流。该文针对基于预训练模型的常识合理性估计方法,从知识来源和是否依赖微调两个维度对现有方法进行系统梳理:前者聚焦模型推理时的知识获取路径,后者衡量方法对标注数据与训练资源的依赖性。此外,该文从任务类型和常识知识类型两方面回顾了常用的48个评测数据集,涵盖从普遍常识到特定知识类型的多样化任务场景。最后,总结了该领域的突破路径:零样本下的复杂推理优化;异构知识的融合机制和多模态常识知识的挖掘、表征和利用,为后续研究提供方向。

     

    Abstract: Commonsense Plausibility Estimation evaluates whether textual content aligns with human daily experience and general knowledge. Compared with early methods that relied on rules and knowledge bases, methods based on pre-trained models implicitly encode commonsense knowledge through self-supervised learning and achieve breakthroughs in the generalization and flexibility. This paper systematically reviews these mainstream methods from two perspectives: the knowledge source(the knowledge acquisition path during inference) and the fine-tuning dependency(the sensitivity of methods to labeled data and computational resources during training). Additionally, 48 benchmark datasets are reviewed based on task types and commonsense knowledge categories. Finally, three breakthroughs are highlighted: complex reasoning optimization for zero-shot inference, fusion mechanism of heterogeneous knowledge, and representation and utilization of multi-modal commonsense knowledge.

     

/

返回文章
返回