高级检索

基于正负例思维链的表格-文本混合金融数据自动问答方法

Positive and Negative Chain-of-Thoughts Based Question Answering Method for Table-Text Financial Data

  • 摘要: 金融领域表格-文本混合数据的自动问答面临复杂数值推理等挑战。针对这一挑战,该文提出了正负例思维链方法。思维链技术通过选取演示样本,搭配提示指令,能有效提升大语言模型的多步骤推理能力。但思维链的演示样本多为人工制作,费时费力,且影响大模型推理。受正例和负例对学习效果影响的启发,该文从大模型的推理结果中抽取样本,构建正例样本池和负例样本池。采用静态和动态相结合的策略选取不同类型的演示样本: 选择最佳正例能够保障大语言模型输出的准确率,选择相似负例能够指导大语言模型规避错误推理。实验结果显示,该方法在FinQA数据集上的准确率提高了3.6%,在FinQA-fix数据集上的准确率提高了12.73%,显著提升了大模型的数值推理能力。

     

    Abstract: Auestion answering for table-text hybrid data in the financial domain is a challenging task. This paper proposes a positive-negative chain-of-thoughts method. Inspired by the influence of positive and negative examples on modeling, chain of thought (COT) samples are extracted from the reasoning results of large language models to construct positive and negative sample pools. A combination of static and dynamic strategies is employed to select different types of demonstration samples: choosing the best positive examples ensures the accuracy of the large language model's output, while selecting similar negative examples guides the model in avoiding incorrect reasoning. The experimental results show that the method improves the accuracy on the FinQA dataset by 3.6%, and on the FinQA-fix dataset by 12.73%.

     

/

返回文章
返回