logo
Volume 22, Issue 3 (12-2025)                   JSDP 2025, 22(3): 91-102 | Back to browse issues page


XML Persian Abstract Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Balouchi A, Bagmohmmadi M, Karmi M. Using Majority Voting in Graph Neural Networks for Aspect-Based Sentiment Analysis. JSDP 2025; 22 (3) : 6
URL: http://jsdp.rcisp.ac.ir/article-1-1431-en.html
M.Sc in Computer Engineering, Ilam University, Ilam, Iran
Abstract:   (2695 Views)

Aspect-Based Sentiment Analysis (ABSA) is a detailed subdomain of sentiment analysis that focuses on detecting sentiments toward specific aspects of entities, such as product features or service attributes, rather than providing a general sentiment polarity. This granular understanding is essential in domains such as customer feedback evaluation, social media opinion mining, and intelligent recommendation systems. However, capturing the syntactic and semantic dependencies required for accurate ABSA remains a challenge for conventional models. In this study, we propose an ensemble-based approach utilizing Graph Convolutional Networks (GCNs), which are particularly effective in learning structural relationships from sentence-level dependency trees. Our methodology involves the integration of four advanced GCN-based models: DualGCN, RDGCN, SSEGCN, and R-GAT. Each model offers distinct strengths, ranging from dual-graph encoding and reinforcement-driven attention mechanisms to syntax-aware semantic enhancements. These models are trained individually and then aggregated through a majority voting mechanism to create a robust ensemble capable of improved sentiment prediction at the aspect level. The models were evaluated on benchmark datasets including SemEval-2014 (Rest14 and Laptops subsets) and Twitter, covering both formal and informal texts. Extensive preprocessing was conducted to standardize input formats and ensure fair comparison across models. Moreover, training was performed using both GLoVE and BERT embeddings, allowing the ensemble to benefit from a diverse range of semantic features. The proposed majority voting strategy aggregates the predictions of individual models and determines the final sentiment class based on the most frequent output. In case of a tie, the model with the highest validation accuracy takes precedence. This strategy effectively combines the complementary capabilities of multiple GCN variants, leading to improved performance and stability across diverse datasets. Experimental results show that the proposed ensemble method significantly outperforms both baseline models and recent state-of-the-art methods. On the Rest14 dataset, the ensemble achieved an accuracy of 88.47%, improving upon the best recent model (SAGCN + BERT) by +1.34%. On the Laptops dataset, it attained 85.44%, exceeding SAGCN’s 85.12% by +0.32%. Similarly, on the Twitter dataset, our model reached 82.12%, surpassing SAGCN’s 81.45% by +0.67%. Additionally, compared to individual baseline models, the proposed method improved accuracy by 2.15% and F1-score by 2.8% on Rest14, 9.2% and 11.74% on Laptops, and 7.8% and 8.7% on Twitter, respectively. These improvements highlight the robustness of the ensemble in handling varying linguistic structures and domains. We also explored alternative ensemble strategies including weighted voting, neural fusion, and combined embedding approaches, yet none outperformed the majority voting strategy in consistency or accuracy. This further reinforces the effectiveness and simplicity of our proposed method .In conclusion, this research introduces a novel and practical ensemble technique for ABSA using multiple GCN models and a majority voting strategy. The method achieves state-of-the-art accuracy across multiple benchmarks and demonstrates strong generalization, making it a valuable contribution to aspect-level sentiment analysis. Future work may extend this approach to multilingual and domain-specific contexts or integrate large pretrained language models such as RoBERTa or GPT to further enhance contextual understanding.

Article number: 6
Full-Text [PDF 744 kb]   (1773 Downloads)    
Type of Study: Applicable | Subject: Paper
Received: 2024/07/8 | Accepted: 2025/07/21 | Published: 2025/12/19 | ePublished: 2025/12/19

References
0. http://jsdp.rcisp.ac.ir/article-1-1385-fa.html.
1. W. Medhat, A. Hassan, and H. Korashy, "Sentiment analysis algorithms and applications: A survey," Ain Shams Engineering Journal, vol. 5, no. 4, pp. 1093-1113, Dec. 2014, doi: 10.1016/j.asej.2014.04.011. [DOI:10.1016/j.asej.2014.04.011]
2. H. H. Do, P. W. Prasad, A. Maag, and A. Alsadoon, "Deep learning for aspect-based sentiment analysis: a comparative review," Expert Systems with Applications, vol. 118, pp. 272-299, 2019. [DOI:10.1016/j.eswa.2018.10.003]
3. کریمی، سمیه و جعفری‌نژاد، فاطمه، «تحلیل احساسات مبتنی بر جنبه با استفاده از شبکه رمزگذار توجه»، نشریه پردازش علائم و داده‌ها، دوره 20، شماره 4، صص. 121-128، اسفند 1402.
3. S. Karimi and F. Jafarinejad, "Aspect-Based Sentiment Analysis using the Attentional Encoder Network," Journal of Scientific Development and Planning (JSDP), vol. 20, no. 4, p. 8, 2024. [Online]. Available: http://jsdp.rcisp.ac.ir/article-1-1321-fa.html. [DOI:10.61186/jsdp.20.4.121]
4. میر، مرضیه و نوفرستی، سمیرا، «به‌کارگیری روش‌های داده‌افزایی برای تحلیل احساسات کاربران درباره بازگشایی مدارس در دوران همه‌گیری کووید-19»، نشریه پردازش علائم و داده‌ها، دوره 21، شماره 2، صص. 3-14، آبان 1403.
4. M. Mir and S. Noferesti, "Using Data Augmentation Techniques for Sentiment Analysis of Users' Opinions on Reopening of Schools During the Covid-19 Epidemic," Journal of Scientific Development and Planning (JSDP), vol. 21, no. 2, p. 1, 2024. [Online]. Available: http://jsdp.rcisp.ac.ir/article-1-1385-fa.html. [DOI:10.61186/jsdp.21.2.3]
5. H. Liu, I. Chatterjee, M. Zhou, X. S. Lu, and A. Abusorrah, "Aspect-Based Sentiment Analysis: A Survey of Deep Learning Methods," IEEE Transactions on Computational Social Systems, vol. 7, no. 6, pp. 1358-1375, Dec. 2020, doi: 10.1109/TCSS.2020.3033302. [DOI:10.1109/TCSS.2020.3033302]
6. J. Zhou et al., "Graph neural networks: A review of methods and applications," AI Open, vol. 1, pp. 57-81, 2020. [DOI:10.1016/j.aiopen.2021.01.001]
7. W. Liao, B. Zeng, J. Liu, P. Wei, X. Cheng, and W. Zhang, "Multi-level graph neural network for text sentiment analysis," Computers & Electrical Engineering, vol. 92, p. 107096, Jun. 2021, doi: 10.1016/j.compeleceng.2021.107096. [DOI:10.1016/j.compeleceng.2021.107096]
8. H. T. Phan, N. T. Nguyen, and D. Hwang, "Aspect-level sentiment analysis: A survey of graph convolutional network methods," Information Fusion, vol. 91, pp. 149-172, Mar. 2023, doi: 10.1016/j.inffus.2022.10.004. [DOI:10.1016/j.inffus.2022.10.004]
9. K. Sun, R. Zhang, S. Mensah, Y. Mao, and X. Liu, "Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree," in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V. Ng, and X. Wan, Eds., Hong Kong, China, Nov. 2019, pp. 5679-5688, doi: 10.18653/v1/D19-1569. [DOI:10.18653/v1/D19-1569]
10. B. Huang and K. Carley, "Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks," in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V. Ng, and X. Wan, Eds., Hong Kong, China, Nov. 2019, pp. 5469-5477, doi: 10.18653/v1/D19-1549. [DOI:10.18653/v1/D19-1549]
11. C. Zhang, Q. Li, and D. Song, "Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks," in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V. Ng, and X. Wan, Eds., Hong Kong, China, Nov. 2019, pp. 4568-4578, doi: 10.18653/v1/D19-1464. [DOI:10.18653/v1/D19-1464]
12. M. Zhang and T. Qian, "Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis," in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), B. Webber, T. Cohn, Y. He, and Y. Liu, Eds., Online, Nov. 2020, pp. 3540-3549, doi: 10.18653/v1/2020.emnlp-main.286. [DOI:10.18653/v1/2020.emnlp-main.286]
13. B. Liang, R. Yin, L. Gui, J. Du, and R. Xu, "Jointly Learning Aspect-Focused and Inter-Aspect Relations with Graph Convolutional Networks for Aspect Sentiment Analysis," in Proceedings of the 28th International Conference on Computational Linguistics, D. Scott, N. Bel, and C. Zong, Eds., Barcelona, Spain (Online), Dec. 2020, pp. 150-161, doi: 10.18653/v1/2020.coling-main.13. [DOI:10.18653/v1/2020.coling-main.13]
14. R. Li, H. Chen, F. Feng, Z. Ma, X. Wang, and E. Hovy, "Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis," in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP), C. Zong, F. Xia, W. Li, and R. Navigli, Eds., Online, Aug. 2021, pp. 6319-6329, doi: 10.18653/v1/2021.acl-long.494. [DOI:10.18653/v1/2021.acl-long.494]
15. K. Wang, W. Shen, Y. Yang, X. Quan, and R. Wang, "Relational Graph Attention Network for Aspect-based Sentiment Analysis," in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), D. Jurafsky, J. Chai, N. Schluter, and J. Tetreault, Eds., Online, Jul. 2020, pp. 3229-3238, doi: 10.18653/v1/2020.acl-main.295. [DOI:10.18653/v1/2020.acl-main.295]
16. Z. Zhang, Z. Zhou, and Y. Wang, "SSEGCN: Syntactic and Semantic Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis," in Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), M. Carpuat, M.-C. de Marneffe, and I. V. Meza Ruiz, Eds., Seattle, United States, Jul. 2022, pp. 4916-4925, doi: 10.18653/v1/2022.naacl-main.362. [DOI:10.18653/v1/2022.naacl-main.362]
17. S. Liang, W. Wei, X.-L. Mao, F. Wang, and Z. He, "BiSyn-GAT+: Bi-Syntax Aware Graph Attention Network for Aspect-based Sentiment Analysis," in Findings of the Association for Computational Linguistics: ACL 2022, 2022, pp. 1835-1848, doi: 10.18653/v1/2022.findings-acl.144. [DOI:10.18653/v1/2022.findings-acl.144]
18. X. Zhao et al., "RDGCN: Reinforced Dependency Graph Convolutional Network for Aspect-based Sentiment Analysis," arXiv, Nov. 08, 2023, doi: 10.48550/arXiv.2311.04467.
19. Q. Gu, Z. Wang, H. Zhang, S. Sui, and R. Wang, "Aspect-Level Sentiment Analysis Based on Syntax-Aware and Graph Convolutional Networks," Applied Sciences, vol. 14, no. 2, p. 729, Jan. 2024, doi: 10.3390/app14020729. [DOI:10.3390/app14020729]
20. M. Pontiki, D. Galanis, J. Pavlopoulos, H. Papageorgiou, I. Androutsopoulos, and S. Manandhar, "SemEval-2014 Task 4: Aspect Based Sentiment Analysis," in Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), P. Nakov and T. Zesch, Eds., Dublin, Ireland, Aug. 2014, pp. 27-35, doi: 10.3115/v1/S14-2004. [DOI:10.3115/v1/S14-2004]
21. L. Dong, F. Wei, C. Tan, D. Tang, M. Zhou, and K. Xu, "Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification," in Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL) (Volume 2: Short Papers), 2014. [DOI:10.3115/v1/P14-2009]

Add your comments about this article : Your username or Email:
CAPTCHA

Send email to the article author


Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.