Formulaic language identification model based on GCN fusing associated information

PeerJ Comput Sci. 2022 Jun 3:8:e984. doi: 10.7717/peerj-cs.984. eCollection 2022.

Abstract

Formulaic language is a general term for ready-made structures in a language. It usually has fixed grammatical structure, stable language expression meaning and specific use context. The use of formulaic language can coordinate sentence generation in the process of writing and communication, and can significantly improve the idiomaticity and logic of machine translation, intelligent question answering and so on. New formulaic language is generated almost every day, and how to accurately identify them is a topic worthy of research. To this end, this article proposes a formulaic language identification model based on GCN fusing associated information. The innovation is that each sentence is constructed into a graph in which the nodes are part-of-speech features and semantic features of the words in the sentence and the edges between nodes are constructed according to mutual information and dependency syntactic relation. On this basis, the graph convolutional neural network is adopted to extract the associated information between words to mine deeper grammatical features. Therefore, it can improve the accuracy of formulaic language identification. The experimental results show that the model in this article is superior to the classical formulaic language identification model in terms of accuracy, recall and F1-score. It lays a foundation for the follow-up research of formulaic language identification tasks.

Keywords: Associated information; Dependency syntactic relation; Formulaic language; Graph convolutional neural network; Mutual information.

Grants and funding

This article is supported by the 2020 Jilin Provincial Social Science Fund Project ”Recognition and Application of English and Chinese Academic Formulaic Language” (No. 2020B206), the National Key R&D Program of China ”The Framework Design and Verification of Data Space Management Engine and Management Service Based on Multi-value Chain Collaboration” (No. 2020YFB1707804), and the Jilin City Science and Technology Innovation Development Project ”Study on the Emotion Classification of Jilin Tourism Online Review Text” (No. 20200104108). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.