高级检索

基于柯西核粒化粗糙集Transformer的多模态对话情感分析

Multimodal Emotion Recognition in Conversation Based on Cauchy Kernel Granulation Rough Set Transformer

  • 摘要: Transformer在多模态对话情感分析任务中应用广泛。然而,对于数据中的不一致表达,现有注意力将不确定性特征直接相乘进行特征引导,最终导致Transformer引导混乱。对于不确定性问题,粗糙集通过集合角度度量特征间的关系进行容忍,因此粗糙集是有效解决不确定性特征的数学工具。基于以上问题,该文提出了一种基于柯西核粒化粗糙集的注意力机制,首先使用柯西核函数对特征进行粒化形成信息粒,然后对信息粒执行下近似计算进行特征引导。最后将构建的柯西核粒化粗糙集注意力集成到Transformer网络中并应用在多模态对话情感分析任务中。该文在IEMOCAP、CMU-MOSEI和MELD数据集上进行实验验证并分析,结果表明,该文提出的方法超过了大多数前沿模型的性能,其中在IEMOCAP数据集上W_F1值达到84.71%,实现了当前最佳性能。

     

    Abstract: Transformer is widely used in multimodal conversation sentiment analysis tasks. However, for inconsistent expressions in the data, existing attention mechanisms directly multiply uncertain features for feature guidance, which ultimately leads to confusion in the guidance of the Transformer. To address the uncertainty problem, rough sets provide tolerance by measuring the relationships between features from a set-theoretic perspective, making them an effective mathematical tool for handling uncertain features. To alleviate the uncertain features, this paper proposes an attention mechanism based on Cauchy kernel granulation rough set. Firstly, the Cauchy kernel function is used to granulate the features to form an information granule, and then the lower approximation is performed on the information granule for feature guidance. Finally, the constructed Cauchy kernel granulation rough set attention is integrated into the Transformer network for the multimodal conversation sentiment analysis task. Experiments and analysis on the IEMOCAP, CMU-MOSEI and MELD datasets show that the proposed method outperforms most of the state-of-the-art models, ranking top in on the IEMOCAP dataset with 84.71% W_F1 score, achieving current state-of-the-art performance.

     

/

返回文章
返回