A Model of Continual and Deep Learning for Aspect Based in Sentiment Analysis

Authors

  • Dionis López Ramos Faculty of Engineering in Telecommunications, Informatics and Biomedical, Universidad de Oriente, Ave. Patricio Lumumba s/n, Santiago de Cuba, Cuba
  • Fernando J. Artigas Fuentes Center for Neuroscience Studies and Image and Signal Processing, Faculty of Engineering in Telecommunications, Informatics and Biomedical, Universidad de Oriente, Ave. Patricio Lumumba s/n, Santiago de Cuba, Cuba
Keywords: Continual Learning, Deep Learning, Catastrophic Forgetting, Sentiment Analysis

Abstract

Sentiment Analysis is a useful tool in several social and business contexts. Aspect Sentiment Classification is a subtask in Sentiment Analysis that gives information about features or aspects of people, entities, products, or services present in reviews. Different Deep Learning models have been proposed to solve Aspect Sentiment Classification focus on a specific domain such as restaurant,
hotel, or laptop reviews. However, there are few proposals for creating a single model with high performance in multiple domains. The Continual Learning approach with neural networks has been used to solve aspect classification in multiple domains. However, avoid low aspect classification performance in Continual Learning is challenging. As a consequence, potential neural network
weight shifts in the learning process in different domains or datasets.
In this paper, a novel Aspect Sentiment Classification approach is proposed. Our approach combines a Transformer Deep Learning technique with a Continual Learning algorithm in different domains. The input layer used is the pre‐trained model Bidirectional Encoder Representations from Transformers. The experiments show the efficacy of our proposal with 78 .

Downloads

Published
21.12.2023
Issue
Section
Articles

How to Cite

López Ramos, D. ., & Artigas Fuentes, F. J. . (2023). A Model of Continual and Deep Learning for Aspect Based in Sentiment Analysis. Journal of Automation, Mobile Robotics and Intelligent Systems, 17(1), 3-12. https://doi.org/10.14313/JAMRIS/1-2023/1