高级检索

Self-Guide:一种基于自我规划的大语言模型推理增强方法

Self-Guide: Enhancing LLM Reasoning Ability via Self-Planning

  • 摘要: 尽管大语言模型在自然语言处理任务中取得显著进展,但其在复杂问题推理等领域还面临着认知负荷问题,即大语言模型在推理过程中需要记忆并处理大量信息。因此,如何有效地减少大语言模型推理过程中的认知负荷,缓解推理过程中可能出现的认知过载,是一个亟待解决的问题。对此该文提出了Self-Guide方法,用于增强语言模型的推理能力。该方法通过指引大语言模型生成常识知识和推理指导,让大语言模型基于自我规划来增强其推理能力,并通过与推理链结合的方式对模型的推理过程进行校准。与现有方法不同的是,该文在不对大语言模型进行微调或使用外部工具的情况下,显著提升了大语言模型的推理性能。实验结果表明,Self-Guide方法在四种常见推理任务上性能显著优于基线方法,同时相比传统的推理链模型,Self-Guide方法在推理能力较弱的模型上也具有良好的泛化性能。通过结合大语言模型的自我规划和推理能力,Self-Guide方法为提升语言模型的推理能力提供了一种新的有效途径。

     

    Abstract: Large language models (LLMs) now is challenged by cognitive overload in complex reasoning tasks due to its storage and processing of large amounts of information during reasoning. To address this issue, this paper introduces the self-guide method to guide LLMs to generate common sense knowledge and reasoning cues, allowing self-planning to improve performance. This method is integrated into the chain-of-thought (CoT) process, improving reasoning without requiring model fine-tuning or external tools. Experimental results demonstrate that the proposed method significantly outperforms baseline methods across four reasoning tasks and generalizes effectively in models with weaker reasoning capabilities.

     

/

返回文章
返回