高级搜索

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

面向方面情感分析的多通道增强图卷积网络

韩虎 范雅婷 徐学锋

韩虎, 范雅婷, 徐学锋. 面向方面情感分析的多通道增强图卷积网络[J]. 电子与信息学报, 2024, 46(3): 1022-1032. doi: 10.11999/JEIT230353
引用本文: 韩虎, 范雅婷, 徐学锋. 面向方面情感分析的多通道增强图卷积网络[J]. 电子与信息学报, 2024, 46(3): 1022-1032. doi: 10.11999/JEIT230353
HAN Hu, FAN Yating, XU Xuefeng. Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis[J]. Journal of Electronics & Information Technology, 2024, 46(3): 1022-1032. doi: 10.11999/JEIT230353
Citation: HAN Hu, FAN Yating, XU Xuefeng. Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis[J]. Journal of Electronics & Information Technology, 2024, 46(3): 1022-1032. doi: 10.11999/JEIT230353

面向方面情感分析的多通道增强图卷积网络

doi: 10.11999/JEIT230353
基金项目: 国家自然科学基金(62166024)
详细信息
    作者简介:

    韩虎:男,教授,研究方向为神经网络与深度学习、数据挖掘与自然语言处理

    范雅婷:女,硕士生,研究方向为深度学习与自然语言处理

    徐学锋:男,硕士生,研究方向为深度学习与自然语言处理

    通讯作者:

    范雅婷 1660296291@qq.com

  • 中图分类号: TN911.7; TP391.1

Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis

Funds: The National Natural Science Foundation of China (62166024)
  • 摘要: 传统的基于单通道的特征提取方式,仅使用单一的依赖关系捕获特征,忽略单词间的语义相似性与依赖关系类型信息。尽管基于图卷积网络进行方面情感分析的方法已经取得一定成效,但始终难以同时聚合节点的语义信息和句法结构特征,在整个迭代训练过程中最初的语义特征会逐渐遗失,影响句子最终的情感分类效果。由于缺乏先验知识会导致模型对相关情感词的误解,因此需要引入外部知识来丰富文本信息。目前,如何利用图神经网络(GNN)融合句法和语义特征的方式仍值得深入研究。针对上述问题,该文提出一种多通道增强图卷积网络模型。首先,通过对情感知识和依赖类型增强的句法图进行图卷积操作,得到基于语法的两种表示,与经过多头注意力和图卷积学习到的语义表示进行融合,使多通道的特征能够互补学习。实验结果表明,在5个公开数据集上,准确率和宏F1值优于基准模型。由此可见,依赖类型和情感知识均对增强句法图有重要影响,表明融合语义信息与句法结构的有效性。
  • 图  1  KSD-GCN模型结构示意图

    图  2  语义图卷积示意图

    图  3  GCN网络层数与准确率和宏F1值的关系

    图  4  自注意力头数与准确率和宏F1值的关系

    图  5  Top-k选择个数与准确率和宏F1值的关系

    图  6  方面词“mountain lion”的多通道注意力可视化

    图  7  方面词“milkshakes”的多通道注意力可视化

    表  1  SenticNet 6中情感词汇示例

    词汇极性-标签SenticNet情感得分语义相关词汇
    Great积极0.999'adore', 'glory', 'devote', 'admire', 'fairly'
    Excellent积极0.795'well_done', 'great', 'excelent', 'good_quality', 'good'
    Hard 消极 –0.291'hard_nail', 'disturb', 'upset', 'perturb', 'frustrate'
    Belittlement消极–0.693'revile', 'rude', 'vituperation', 'scurrility', 'billingsgate'
    Unsalable 消极–0.934'sorry', 'trash', 'rubbish', 'superfluous', 'otiose'
    下载: 导出CSV

    表  2  数据集统计

    数据集积极中性消极
    训练集测试集训练集测试集训练集测试集
    Twitter156117331273461560173
    Lap14994341464169870128
    Rest142164728637196807196
    Rest159123263634256182
    Rest1612404696930439117
    下载: 导出CSV

    表  3  模型的超参数设置

    超参数GloVe参数设置BERT参数设置
    批量训练样本数Batch size1616
    训练迭代次数Epoch100100
    优化器OptimizerAdamAdam
    学习率Learning rate10–32×10–5
    丢失率Dropout rate0.30.2
    L2正则化系数10–510–3
    下载: 导出CSV

    表  4  不同模型的结果对比(%)

    类别模型TwitterLap 14Rest 14Rest 15Rest16
    Acc宏F1Acc宏F1Acc宏F1Acc宏F1Acc宏F1
    基线LSTM69.5667.7069.2863.0978.1367.4777.3755.1786.8063.88
    ATAE-LSTM69.6567.4069.1463.1877.3266.5775.4356.3483.2563.85
    IAN72.5070.8172.0567.3879.2670.0978.5452.6584.7455.21
    AF-LSTM69.2168.2469.9763.4977.4665.1876.1256.2985.6166.15
    GCN模型TD-GAT72.7070.4575.6370.6481.3271.7280.3860.5087.7167.87
    ASGCN72.1570.4075.5571.0580.7772.0279.8961.8988.9967.48
    BiGCN74.1673.3574.4971.8481.9773.4881.1664.7988.9670.84
    GL-GCN73.2671.2676.9172.7682.1173.4680.8164.9988.4769.64
    MIGCN73.3172.1276.5972.4482.3274.3180.8164.2189.5071.97
    DA-GCN72.7870.9375.5871.2081.4274.6279.7061.8889.7667.81
    MSD-GCN74.5273.6877.5974.1882.6775.4480.4467.7489.0371.95
    SGAN74.9573.3776.7572.9081.8074.2881.2865.3188.4972.83
    KSD-GCN75.0073.3878.3775.1884.1176.7882.4764.2090.4273.81
    BERTDA-GCN-BERT75.4373.6778.8275.2883.4374.3582.9764.5689.6971.86
    SK-GCN-BERT75.0073.0179.0075.5783.4875.1983.2066.7887.1972.02
    KSD-GCN-BERT76.7375.7680.7276.5886.0780.0084.5068.8391.8874.09
    下载: 导出CSV

    表  5  消融实验结果(%)

    模型TwitterLap 14Rest 14Rest 15Rest16
    Acc宏F1Acc宏F1Acc宏F1Acc宏F1Acc宏F1
    本文75.0073.3878.3775.1884.1176.7882.4764.2090.4273.81
    w/o sem72.2570.5875.7071.2881.3371.5981.3662.1288.3168.10
    w/o dsyn73.5571.5074.6070.1081.5171.4780.8161.6187.6667.73
    w/o ksyn73.1271.9274.6170.2381.6072.0880.2563.7788.9668.51
    w/o sem-dsyn72.5470.7875.3970.7381.1671.1280.9962.4488.3170.11
    w/o dsyn-ksyn72.9771.4475.5470.4881.0770.2180.4462.0387.6668.54
    w/o sem-ksyn72.5470.7974.6071.2280.9871.1979.7062.0188.1469.46
    下载: 导出CSV
  • [1] TANG Duyu, QIN Bing, FENG Xiaocheng, et al. Effective LSTMs for target-dependent sentiment classification[C]. The 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan, 2016: 3298–3307.
    [2] WANG Yequan, HUANG Minlie, ZHU Xiaoyan, et al. Attention-based LSTM for aspect-level sentiment classification[C]. The 2016 Conference on Empirical Methods in Natural Language Processing, Austin, USA, 2016: 606–615.
    [3] MA Dehong, LI Sujian, ZHANG Xiaodong, et al. Interactive attention networks for aspect-level sentiment classification[C]. The Twenty-Sixth International Joint Conference on Artificial Intelligence, Melbourne, Australia, 2017: 4068–4074.
    [4] MIAO Yuqing, LUO Ronghai, ZHU Lin, et al. Contextual graph attention network for aspect-level sentiment classification[J]. Mathematics, 2022, 10(14): 2473. doi: 10.3390/math10142473.
    [5] ZHANG Chen, LI Qiuchi, and SONG Dawei. Aspect-based sentiment classification with aspect-specific graph convolutional networks[C]. The 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, 2019: 4568–4578.
    [6] ZHANG Mi and QIAN Tieyun. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]. The 2020 Conference on Empirical Methods in Natural Language Processing, 2020: 3540–3549.
    [7] YUAN Li, WANG Jin, YU L C, et al. Syntactic graph attention network for aspect-level sentiment analysis[J]. IEEE Transactions on Artificial Intelligence, 2022: 1–15.
    [8] ZHAO Zefang, LIU Yuyang, GAO Junruo, et al. Multi-grained syntactic dependency-aware graph convolution for aspect-based sentiment analysis[C]. The 2022 Conference on International Joint Conference on Neural Networks, Padua, Italy, 2022: 1–8.
    [9] DAI Anan, HU Xiaohui, NIE Jianyun, et al. Learning from word semantics to sentence syntax by graph convolutional networks for aspect-based sentiment analysis[J]. International Journal of Data Science and Analytics, 2022, 14(1): 17–26. doi: 10.1007/s41060-022-00315-2.
    [10] 王汝言, 陶中原, 赵容剑, 等. 多交互图卷积网络用于方面情感分析[J]. 电子与信息学报, 2022, 44(3): 1111–1118. doi: 10.11999/JEIT210459.

    WANG Ruyan, TAO Zhongyuan, ZHAO Rongjian, et al. Multi-interaction graph convolutional networks for aspect-level sentiment analysis[J]. Journal of Electronics &Information Technology, 2022, 44(3): 1111–1118. doi: 10.11999/JEIT210459.
    [11] WANG Kai, SHEN Weizhou, YANG Yunyi, et al. Relational graph attention network for aspect-based sentiment analysis[C]. The 58th Annual Meeting of the Association for Computational Linguistics, 2020: 3229–3238.
    [12] LIANG Bin, SU Hang, GUI Lin, et al. Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks[J]. Knowledge-Based Systems, 2022, 235: 107643. doi: 10.1016/j.knosys.2021.107643.
    [13] ZHOU Jie, HUANG J X, HU Q V, et al. SK-GCN: Modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification[J]. Knowledge-Based Systems, 2020, 205: 106292. doi: 10.1016/j.knosys.2020.106292.
    [14] XU Junjie, YANG Shuwen, XIAO Luwei, et al. Graph convolution over the semantic-syntactic hybrid graph enhanced by affective knowledge for aspect-level sentiment classification[C]. International Joint Conference on Neural Networks, Padua, Italy, 2022: 1–8.
    [15] PENNINGTON J, SOCHER R, and MANNING C. GloVe: Global vectors for word representation[C]. The 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar, 2014: 1532–1543.
    [16] DEVLIN J, CHANG M W, LEE K, et al. BERT: Pre-training of deep bidirectional transformers for language understanding[C]. The 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota, 2019: 4171–4186.
    [17] CAMBRIA E, LI Yang, XING F Z, et al. SenticNet 6: Ensemble application of symbolic and subsymbolic AI for sentiment analysis[C]. The 29th ACM International Conference on Information and Knowledge Management, Ireland, 2020: 105–114.
    [18] HUANG Binxuan and CARLEY K M. Syntax-aware aspect level sentiment classification with graph attention networks[C]. The 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, 2019: 5469–5477.
    [19] LI Dong, WEI Furu, TAN Chuanqi, et al. Adaptive recursive neural network for target-dependent twitter sentiment classification[C]. The 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, USA, 2014: 49–54.
    [20] PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. SemEval-2014 task 4: Aspect based sentiment analysis[C]. The 8th International Workshop on Semantic Evaluation, Dublin, Ireland, 2014: 27–35.
    [21] PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. SemEval-2015 task 12: Aspect based sentiment analysis[C]. The 9th International Workshop on Semantic Evaluation, Denver, USA, 2015: 486–495.
    [22] PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. SemEval-2016 task 5: Aspect based sentiment analysis[C]. The 10th International Workshop on Semantic Evaluation, San Diego, USA, 2016: 19–30.
    [23] WANG Xin, LIU Yuanchao, SUN Chengjie, et al. Predicting polarities of tweets by composing word embeddings with long short-term memory[C]. The 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, 2015: 1343–1353.
    [24] TAY Y, TUAN L A, and HUI S C. Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis[C]. The Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, USA, 2018: 5956–5963.
    [25] ZHU Xiaofei, ZHU Ling, GUO Jiafeng, et al. GL-GCN: Global and local dependency guided graph convolutional networks for aspect-based sentiment classification[J]. Expert Systems with Applications, 2021, 186: 115712. doi: 10.1016/j.eswa.2021.115712.
    [26] WANG Xue, LIU Peiyu, ZHU Zhenfang, et al. Aspect-based sentiment analysis with graph convolutional networks over dependency awareness[C]. The 26th International Conference on Pattern Recognition, Montreal, Canada, 2022: 2238–2245.
  • 加载中
图(7) / 表(5)
计量
  • 文章访问数:  533
  • HTML全文浏览量:  243
  • PDF下载量:  87
  • 被引次数: 0
出版历程
  • 收稿日期:  2023-05-04
  • 修回日期:  2023-09-24
  • 网络出版日期:  2023-09-28
  • 刊出日期:  2024-03-27

目录

    /

    返回文章
    返回