Show simple item record

AuthorHamad, Omama
AuthorHamdi, Ali
AuthorShaban, Khaled
Available date2022-12-21T10:01:46Z
Publication Date2022
Publication NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ResourceScopus
URIhttp://dx.doi.org/10.1007/978-3-031-16270-1_18
URIhttp://hdl.handle.net/10576/37491
AbstractEffective representation learning is an essential building block for achieving many natural language processing tasks such as stance detection as performed implicitly by humans. Stance detection can assist in understanding how individuals react to certain information by revealing the user's stance on a particular topic. In this work, we propose a new attention-based model for learning feature representations and show its effectiveness in the task of stance detection. The proposed model is based on transfer learning and multi-head attention mechanisms. Specifically, we use BERT and word2vec models to learn text representation vectors from the data and pass both of them simultaneously to the multi-head attention layer to help focus on the best learning features. We present five variations of the model, each with a different combination of BERT and word2vec embeddings for the query and value parameters of the attention layer. The performance of the proposed model is evaluated against multiple baseline and state-of-the-art models. The best of the five proposed variations of the model improved the accuracy on average by 0.4% and achieved 68.4% accuracy for multi-classification, while the best accuracy for binary classification is 86.1% with a 1.3% improvement. 2022, Springer Nature Switzerland AG.
Languageen
PublisherSpringer Science and Business Media Deutschland GmbH
SubjectCOVID-19 pandemic
Deep learning
Multi-head attention
Stance detection
Text classification
Transfer learning
TitleAttention-Based Model for Accurate Stance Detection
TypeConference Paper
Pagination212-224
Volume Number13502 LNAI


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record