高级检索

推理型大语言模型角色扮演能力评估与优化

Enhancing the Role-playing Capabilities of Reasoning-optimized Large Language Models

  • 摘要: 随着角色扮演大语言模型应用价值凸显及推理技术的进步,一个核心科学问题应运而生:先进推理技术能否增益模型的角色扮演能力?为系统性探究该问题,该文基于6个主流基准与26个代表性模型,全面评估了零样本、基于思维链及基于推理模型三种角色扮演范式的性能。研究的核心发现与普遍认知相悖:推理能力的引入(无论是显式的思维链,还是内化的推理模型)非但未能使模型的角色扮演能力稳定提升,反而时常损害角色扮演性能,并破坏其性能随模型规模增长的缩放定律。此外,当前模型在处理高级、细致的角色扮演任务时仍存在显著短板,且在跨语言对比中中文性能普遍优于英文性能。据此,该文提出“角色感知思维链”与“面向角色扮演的强化学习”两个未来研究方向,并进一步深化为“细粒度角色奖励驱动的强化学习”框架。通过实验验证,这些方向共同为提升下一代角色扮演代理的适应性、一致性与有效性提供了新的理论视角与实证支持。

     

    Abstract: Currently, advancements in reasoning techniques are constantly pushing the performance boundaries of LLMs. This confluence motivates a pivotal research question: can advanced reasoning capabilities enhance the role-playing performance of LLMs? To systematically investigate this question, this paper conducts a large-scale empirical study across 6 mainstream benchmarks and 26 representative models, evaluating three distinct role-playing paradigms based on zero-shot, Chain-of-Thought, and reasoning model, respectively. Our core findings reveal two counter-intuitive conclusions. First, introducing reasoning capabilities, whether explicit or internalized, often impairs role-playing performance and disrupts its scaling laws. Secondly, current models exhibit significant shortcomings in advanced role-playing tasks, and their performance in Chinese is generally superior to English. Based on these findings, this paper proposes two promising future research directions, "Role-aware Chain-of-Thought" and "Reinforcement Learning for Role-Playing", and further refines the latter into a "Fine-grained Character Reward-driven Reinforcement Learning" framework. By validating these directions through experiments, this work provides new perspectives and empirical evidences to enhance the adaptability, consistency, and effectiveness of next-generation role-playing agents.

     

/

返回文章
返回