Research of methods based on neural networks for the analysis of the tonality of the corps of the texts

Authors

  • Ostrovska Kateryna
  • Stovpchenko Ivan
  • Pechenyi Denys

DOI:

https://doi.org/10.34185/1562-9945-4-147-2023-14

Keywords:

artificial neural networks, DEEP neural networks. networks, tutored learning, deep learning, recurrent neural network, LSTM, convolutional neural network, text tonality analysis, bag of words, Word2vec.

Abstract

The object of the study is methods based on neural networks for analyzing the tonality of a corpus of texts. To achieve the goal set in the work, it is necessary to solve the following tasks: study the theoretical material for learning deep neural networks and their features in relation to natural language processing; study the documentation of the Tensorflow library; develop models of convolutional and recurrent neural networks; to develop the implementation of linear and non-linear classification methods on bag of words and Word2Vec models; to compare the accuracy and other quality indicators of implemented neural network models with classical methods. Tensorboard is used for learning visualization. The work shows the superiority of classifiers based on deep neural networks over classical classification methods, even if the Word2Vec model is used for vector representations of words. The model of recurrent neural network with LSTM blocks has the highest accuracy for this corpus of texts.

References

B. Pang and L. Lee. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval archive, 2008.

Данные рецензий, используемых в работе, sentence polarity dataset v1.0. http://www.cs.cornell.edu/people/pabo/movie-review-data/

Y.Kim. Convolutional neural networks for sentence classification.arXiv:1408.5882 [cs.CL], 2014.

K.S. Tai et al. Improved semantic representations from tree-structured long short-term memory network. arXiv:1503.00075 [cs.CL], 2015.

Q. Le and T. Mikolov. Distributed representations of sentences anddocuments. arXiv:1405.4053 [cs.CL], 2014.

K.Tran et al. Evaluation of deep learning toolkits. https://github. com/zer0n/deepframeworks/blob/master/README.md

Published

2023-11-13