高级检索

CCKB:面向中文泛领域的大规模因果知识库构建与评价

CCKB: Constructing and Evaluating a Large-Scale Causal Knowledge Base for Chinese

  • 摘要: 因果知识是刻画自然与社会发展变化的逻辑性知识,对于支撑智能问答、文本理解等任务性能提升具有重要价值。但是,由于因果关系的稀疏性和复杂性,大规模因果知识库的构建代价极高。当前,仅英文因果知识库构建研究较为成熟,中文领域研究很少,尤其是缺少实际可用的大规模泛领域中文因果知识库。为此,该文首先提出一种基于双语对照的高效中文因果模式发现算法,该方法以成熟的英文因果表达模式为基础,利用中英文平行语料的对齐性,自动识别中文文本中的原因事件、结果事件以及因果提示词,捕获稳定的中文因果表达模式。进而,从约500 GB的中文语料中高效匹配因果事件,经过去重、过滤、脱敏以及向量化等操作后构成规模达到千万级的因果知识库(CCKB)。随后,对该中文因果知识库展开了系统的质量评价,包括人工评价、大语言模型评价以及应用评价,结果表明,该知识库的综合准确率约88.6%,且具有支持实际应用的能力。此外,对该因果知识库知识来源、因果模式分布等进行统计分析,并在与典型英文因果知识库的比较中探究中文因果知识表达的特点。该研究所得中文因果知识库及评测数据等附加数据集均开放获取:https://github.com/Ewillingfly/ ChineseCausalityKB。

     

    Abstract: Causal knowledge outlines the logical progression of events in nature and society, which is crucial for AI applications like intelligent Q&A and text comprehension. Currently, the research on the construction of a causal knowledge base is relatively mature only in English, and there are few studies in the Chinese field, especially the lack of practical large-scale Chinese causal knowledge bases. This paper introduces a novel algorithm for Chinese causal pattern discovery, which leverages bilingual alignment and the identified English causal patterns to identify the causes, effects, and causality indicators in Chinese text. We then collects causal events from a Chinese corpus of about 500GB and perform operations such as deduplication, filtering, desensitization, and vectorization to form a Chinese causal knowledge base (CCKB) of 10 million pieces. Evaluations indicate the constructed CCKB reaches an accuracy of 88.6%, which is available for public access via https://github.com/Ewillingfly/ChineseCausalityKB.

     

/

返回文章
返回