面向小规模大语言模型推理优化的推理路径排序方法
A Reasoning Path Ranking Method for Reasoning Optimization of Small-scale Large Language Models
-
摘要: 尽管大语言模型(LLM)在自然语言处理领域取得巨大成功,但是伴随其千亿级参数规模的训练也产生了巨大的计算成本。小规模大语言模型(SLLM)作为低资源场景下实现LLM部署的可替代方案,但任务处理能力与LLM尚存在明显差距。尽管上下文学习(ICL)等提示方法在一定程度上提升了SLLM的问题处理能力,但基于人工构建的提示往往需要参与者具备特定的专业领域知识,这给LLM的普适推广带来了挑战。针对以上问题,该文提出了一个基于SLLM的问题推理框架,通过在推理路径生成和答案生成两个阶段之间引入基于逐步语义验证器(SSVRP)的推理路径排序选择机制,在无人干预情况下实现SLLM推理能力提升。实验结果表明,SSVRP有效地增强了SLLM的推理性能,在4个推理任务中的平均准确率分别达到了54.3%,90.6%,64.3%和63.7%,并在其中的3个推理任务中都取得了最新的SOTA结果。Abstract: As an alternative to LLM deployment in low-resource scenarios, Small-scale Large Language Models (SLLM) still have a significant gap in task processing capabilities compared to LLM. This paper proposes a question reasoning framework for SLLM. By introducing a reasoning path ranking selection mechanism based on Step-Semantic Verifier on Reasoning Paths (SSVRP) between the two stages of reasoning path generation and answering generation, the reasoning capability of SLLM is improved without human intervention. Experimental results show that SSVRP effectively enhances the reasoning performance of SLLM, with average accuracy of 54.3%, 90.6%, 64.3% and 63.7% in four reasoning tasks, respectively, which are the latest SOTA results in three of the reasoning tasks.
下载: