Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis

HAN Hu; FAN Yating; XU Xuefeng

doi:10.11999/JEIT230353

Volume 46 Issue 3

Mar. 2024

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2024 > 46(3): 1022-1032

HAN Hu, FAN Yating, XU Xuefeng. Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis[J]. Journal of Electronics & Information Technology, 2024, 46(3): 1022-1032. doi: 10.11999/JEIT230353

Citation:

HAN Hu, FAN Yating, XU Xuefeng. Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis[J]. Journal of Electronics & Information Technology, 2024, 46(3): 1022-1032. doi: 10.11999/JEIT230353

Citation:

PDF( 4029 KB)

Multi-channel Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis

doi: 10.11999/JEIT230353

School of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China

Funds: The National Natural Science Foundation of China (62166024)

Received Date: 2023-05-04
Rev Recd Date: 2023-09-24

Available Online: 2023-09-28

Publish Date: 2024-03-27

Abstract

Abstract

In traditional single-channel-based feature extraction approaches, features are captured solely based on dependency, while semantic similarity and dependency types between words are ignored. Although some success has been achieved through the graph convolutional network-based approach for sentiment analysis, aggregating both semantic information and syntactic structure features remains challenging, and the gradual loss of semantic features throughout the training process affects the final sentiment classification effect. To prevent the model from misinterpreting relevant sentiment words due to the absence of prior knowledge, the inclusion of external knowledge is recommended to enrich the text. Presently, how to utilize Graph Neural Networks(GNN) to fuse syntactic and semantic features still deserves further research. A multi-channel enhanced graph convolutional network model is proposed in this paper to address the above issues. First, graph convolution operations on syntactic graphs enhanced with sentiment knowledge and dependency types are performed to obtain two syntax-based representations, which are fused with the semantic representations learned through multi-head attention and graph convolution, so that the multi-channel features can be learned complementarily. It is observed from the experimental results that both the accuracy and macro F1 of our model surpass those of the benchmark model on five publicly available datasets. These findings indicate the importance of dependency types and affective knowledge to enhance syntactic graphs and highlight the effectiveness of combining semantic information with syntactic structure.
- Aspect-based sentiment analysis,
- Graph Convolutional Network(GCN),
- Affective knowledge,
- Dependency relation embedded,
- Multi-head attention

FullText(HTML)

References(26)

References

[1]	TANG Duyu, QIN Bing, FENG Xiaocheng, et al. Effective LSTMs for target-dependent sentiment classification[C]. The 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan, 2016: 3298–3307.
[2]	WANG Yequan, HUANG Minlie, ZHU Xiaoyan, et al. Attention-based LSTM for aspect-level sentiment classification[C]. The 2016 Conference on Empirical Methods in Natural Language Processing, Austin, USA, 2016: 606–615.
[3]	MA Dehong, LI Sujian, ZHANG Xiaodong, et al. Interactive attention networks for aspect-level sentiment classification[C]. The Twenty-Sixth International Joint Conference on Artificial Intelligence, Melbourne, Australia, 2017: 4068–4074.
[4]	MIAO Yuqing, LUO Ronghai, ZHU Lin, et al. Contextual graph attention network for aspect-level sentiment classification[J]. Mathematics, 2022, 10(14): 2473. doi: 10.3390/math10142473.
[5]	ZHANG Chen, LI Qiuchi, and SONG Dawei. Aspect-based sentiment classification with aspect-specific graph convolutional networks[C]. The 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, 2019: 4568–4578.
[6]	ZHANG Mi and QIAN Tieyun. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]. The 2020 Conference on Empirical Methods in Natural Language Processing, 2020: 3540–3549.
[7]	YUAN Li, WANG Jin, YU L C, et al. Syntactic graph attention network for aspect-level sentiment analysis[J]. IEEE Transactions on Artificial Intelligence, 2022: 1–15.
[8]	ZHAO Zefang, LIU Yuyang, GAO Junruo, et al. Multi-grained syntactic dependency-aware graph convolution for aspect-based sentiment analysis[C]. The 2022 Conference on International Joint Conference on Neural Networks, Padua, Italy, 2022: 1–8.
[9]	DAI Anan, HU Xiaohui, NIE Jianyun, et al. Learning from word semantics to sentence syntax by graph convolutional networks for aspect-based sentiment analysis[J]. International Journal of Data Science and Analytics, 2022, 14(1): 17–26. doi: 10.1007/s41060-022-00315-2.
[10]	王汝言, 陶中原, 赵容剑, 等. 多交互图卷积网络用于方面情感分析[J]. 电子与信息学报, 2022, 44(3): 1111–1118. doi: 10.11999/JEIT210459. WANG Ruyan, TAO Zhongyuan, ZHAO Rongjian, et al. Multi-interaction graph convolutional networks for aspect-level sentiment analysis[J]. Journal of Electronics &Information Technology, 2022, 44(3): 1111–1118. doi: 10.11999/JEIT210459.
[11]	WANG Kai, SHEN Weizhou, YANG Yunyi, et al. Relational graph attention network for aspect-based sentiment analysis[C]. The 58th Annual Meeting of the Association for Computational Linguistics, 2020: 3229–3238.
[12]	LIANG Bin, SU Hang, GUI Lin, et al. Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks[J]. Knowledge-Based Systems, 2022, 235: 107643. doi: 10.1016/j.knosys.2021.107643.
[13]	ZHOU Jie, HUANG J X, HU Q V, et al. SK-GCN: Modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification[J]. Knowledge-Based Systems, 2020, 205: 106292. doi: 10.1016/j.knosys.2020.106292.
[14]	XU Junjie, YANG Shuwen, XIAO Luwei, et al. Graph convolution over the semantic-syntactic hybrid graph enhanced by affective knowledge for aspect-level sentiment classification[C]. International Joint Conference on Neural Networks, Padua, Italy, 2022: 1–8.
[15]	PENNINGTON J, SOCHER R, and MANNING C. GloVe: Global vectors for word representation[C]. The 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar, 2014: 1532–1543.
[16]	DEVLIN J, CHANG M W, LEE K, et al. BERT: Pre-training of deep bidirectional transformers for language understanding[C]. The 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota, 2019: 4171–4186.
[17]	CAMBRIA E, LI Yang, XING F Z, et al. SenticNet 6: Ensemble application of symbolic and subsymbolic AI for sentiment analysis[C]. The 29th ACM International Conference on Information and Knowledge Management, Ireland, 2020: 105–114.
[18]	HUANG Binxuan and CARLEY K M. Syntax-aware aspect level sentiment classification with graph attention networks[C]. The 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, 2019: 5469–5477.
[19]	LI Dong, WEI Furu, TAN Chuanqi, et al. Adaptive recursive neural network for target-dependent twitter sentiment classification[C]. The 52nd Annual Meeting of the Association for Computational Linguistics, Baltimore, USA, 2014: 49–54.
[20]	PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. SemEval-2014 task 4: Aspect based sentiment analysis[C]. The 8th International Workshop on Semantic Evaluation, Dublin, Ireland, 2014: 27–35.
[21]	PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. SemEval-2015 task 12: Aspect based sentiment analysis[C]. The 9th International Workshop on Semantic Evaluation, Denver, USA, 2015: 486–495.
[22]	PONTIKI M, GALANIS D, PAPAGEORGIOU H, et al. SemEval-2016 task 5: Aspect based sentiment analysis[C]. The 10th International Workshop on Semantic Evaluation, San Diego, USA, 2016: 19–30.
[23]	WANG Xin, LIU Yuanchao, SUN Chengjie, et al. Predicting polarities of tweets by composing word embeddings with long short-term memory[C]. The 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, 2015: 1343–1353.
[24]	TAY Y, TUAN L A, and HUI S C. Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis[C]. The Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, USA, 2018: 5956–5963.
[25]	ZHU Xiaofei, ZHU Ling, GUO Jiafeng, et al. GL-GCN: Global and local dependency guided graph convolutional networks for aspect-based sentiment classification[J]. Expert Systems with Applications, 2021, 186: 115712. doi: 10.1016/j.eswa.2021.115712.
[26]	WANG Xue, LIU Peiyu, ZHU Zhenfang, et al. Aspect-based sentiment analysis with graph convolutional networks over dependency awareness[C]. The 26th International Conference on Pattern Recognition, Montreal, Canada, 2022: 2238–2245.