Move Recognition in Academic Abstract via ERNIE-BiGRU Model
WEN Hao1, HE Qianru1, WANG Jie1, QIAO Xiaodong2, ZHANG Peng3
1.School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an, Shaanxi 710311, China; 2.Beijing Wanfang Data Co., Ltd, Beijing 100038, China; 3.School of Arts, Xi'an University of Architecture and Technology, Xi'an, Shaanxi 710311, China
Abstract：The academic abstract summarizes key points in a research paper, with a series of moves conveying different information. The automatic recognition and extraction of moves could provide a valuable foundation for other tasks related with the academic abstract. This paper proposed a move recognition algorithm for academic abstract based on ERNIE-BiGRU model. Firstly, a multi-move structure splitting method based on dependency structure is proposed, identifying the multiple single-move structure in the academic abstract. Secondly, a single-move structure corpus is constructed, and a pre-training model of knowledge-enhanced semantic representation is employed to train sentence-level word vectors. Finally, the trained word vector with single move structure information is input into BiGRU for automatic recognition of moves. The experimental results show that the algorithm has good robustness and high recognition accuracy, achieving 96.57% and 93.75% recognition accuracy for structured and unstructured abstracts, respectively.
[1] 沈思,胡昊天,叶文豪,等.基于全字语义的摘要结构功能自动识别研究[J].情报学报,2019.38(1): 79-88. [2] 王末,崔运鹏,陈丽,等.基于深度学习的学术论文语步结构分类方法研究[J].数据分析与知识发现,2020.4(6): 60-68. [3] LISTED N.A proposal for more informative abstracts of clinical articales. Ad Hoc working group for critical appraisal of the medical literature[J].Annals of Internal Medicine,1987,106(4): 598-604. [4] HARTLEY J. Current findings from research on struct abstract[J].Med Libr Assoc,2014,92(3): 368-371. [5] 白光祖,何远标,马建霞,等.利用小样本量机器学习实现学术文摘结构的自动识别[J].现代图书情报,2014.30(7): 34-40. [6] ZHANG Z X,LIU H,DING L P,et al.Moves recognition in abstract of research paper based on deep learning[C]//Proceeding of ACM/IEEE Joint Conference on Digital Libraries, Champaign(US),2019: 390-391. [7] 岳增营,叶霞,刘睿珩.基于语言模型的预训练技术研究综述[J] .中文信息学报,2021,35(09): 15-29. [8] CHENG X,ZHANG C,LI Q X.Improved Chinese short text classification based on ERNIE—BiGRU Model[J].Journal of Physics: Conference Series, 2021(6): 1-11. [9] 叶娜,黎天宇,蔡东风,等.利用依存句法关系改进神经译文质量估计[J].中文信息学报,2021,35(09): 46-57. [10] SUN Y,WANG S H,LI Y K, et al. ERNIE: Enhanced representation through knowledge integration[EB/OL].https://arxiv.org/abs/1904.09223[2019-12-23]. [11] YU G,ZHANG Z,LIU H,et al.Masked sentence model based on BERT for move recognition in medical scientific abstracts[J]. Journal of Data and Information Science, 2019(04): 42-55. [12] JACOB D, CHANG M W, KENTON L, et al. BERT: Pre-training of deep bidirectional transformers for language understanding[C]//Proceeding of Conference on the North American Chapter of the Association for Computational Linguisitcs: Human Language Technologies. Minneapolis, Minnesota: Association for Computational Linguistics,2019: 4171-4186. [13] DAI J, CHEN C. Text classification system of academic papers based on hybrid Bert-BiGRU model[C]//Proceeding of International Conference on Intelligent Human-Machine Systems and Cybernetics. Hangzhou, China: IEEE,2020: 40-44. [14] 屠可伟,李俊.句法分析前沿动态综述[J].中文信息学报,2020,34(07): 30-41. [15] 黄彤,李斌,闫培艺,等.基于抽象语义表示的汉语构式标注与分析[J].中文信息学报,2020,34(10): 1-9. [16] 贾延延,程学旗,冯键.基于LSTM的层次化篇章依存分析方法[J].中文信息学报,2021,35(01): 1-8. [17] 许晨彬.基于BERT的深层语义特征提取在复句层次结构分析中的应用[D].武汉: 华中师范大学硕士学位论文,2020. [18] 郑梦悦,秦春秀,马续补,等.面向中文科技文献非结构化摘要的知识元表示与抽取研究[J].情报理论与实践,2020,43(2): 157-163. [19] WANG R P,ZHANG C Z,ZHANG Y Y,et al.Extracting methodological sentences from unstructured abstracts of academic articles[C]//Proceeding of International Conference on Sustainable Digital Communities.2020: 790-798. [20] 周志超.中文图情期刊摘要的核心要素与逻辑结构分析[J].情报科学,2018,36(3): 8-12.
2022, Vol. 36 
