Representation of Words over Vectors in Recurrent Convolutional Attention Architecture for Sentiment Analysis

Fazeel Abid, Chenli, Muhammad Alam, Adnan Abid

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

4 Citations (Scopus)

Abstract

Subjectivity in the text concerns to sentiment analysis, which entails Natural language processing (NLP) techniques to detain the casual way of communication. Many NLP undertakings used to capture the sentimental contextual information through distributed representations. Neural networks (NNs) like recurrent and convolutional neural networks have productively attained the remarkable outcomes in text classification. However, few of architectures learning through vector representation of words in the recurrent network for capturing long-term dependencies while in the convolutional for feature extraction along with pooling layer; a max-pooling task for dimensional reduction has been proposed, still, unable to seizure enough syntactic and semantic regularities for sentiment analysis. This paper empowers sentiment analysis by exploring unsupervised learning of vectors representation such as Word2Vec and GloVe, then acquired word vectors is input to the proposed architecture which is composed of RNN and CNN engaging with attention-mechanism referred to Recurrent Convolutional Attention Architecture 'RCAA.' Experimentations show that through unsupervised learning of representation of words into qualified vectors in interpreting the similarities related to syntactic and semantic context and the sentiments at adequate computational cost along with the combination neural architecture by succeeding accuracy on word2vec by 83.62%, GloVe by 85.72% as compared with Random initialization by 79.97% on rotten tomatoes test dataset respectively.

Original languageEnglish
Title of host publication3rd International Conference on Innovative Computing, ICIC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728146829
DOIs
Publication statusPublished - Nov 2019
Event3rd International Conference on Innovative Computing, ICIC 2019 - Lahore, Pakistan
Duration: 1 Nov 20192 Nov 2019

Publication series

Name3rd International Conference on Innovative Computing, ICIC 2019

Conference

Conference3rd International Conference on Innovative Computing, ICIC 2019
Country/TerritoryPakistan
CityLahore
Period1/11/192/11/19

Keywords

  • Distributed Representation
  • GloVe
  • RCAA
  • Recurrent
  • Sentiment Analysis
  • Word2Vec
  • and Convolutional Neural Network

Fingerprint

Dive into the research topics of 'Representation of Words over Vectors in Recurrent Convolutional Attention Architecture for Sentiment Analysis'. Together they form a unique fingerprint.

Cite this