李丽双,钱爽,周安桥,刘阳,郭元凯. 融合依存信息Attention机制的药物关系抽取研究[J]. 中文信息学报, 2019, 33(2): 89-96.
LI Lishuang, QIAN Shuang, ZHOU Anqiao, LIU Yang, GUO Yuankai. Drug-Drug Interaction Extraction with the Attention Mechanism Over the Dependency. , 2019, 33(2): 89-96.
融合依存信息Attention机制的药物关系抽取研究
李丽双,钱爽,周安桥,刘阳,郭元凯
大连理工大学 计算机科学与技术学院,辽宁 大连 116024
Drug-Drug Interaction Extraction with the Attention Mechanism Over the Dependency
LI Lishuang, QIAN Shuang, ZHOU Anqiao, LIU Yang, GUO Yuankai
School of Computer Science and Technology, Dalian University of Technology, Dalian, Liaoning 116024, China
Abstract:Drug-Drug Interaction (DDI) extraction is an important issue in biomedical relationship extraction. Most of existing methods emphasize the key information such as entities and positions in the sentences. To further exploit the sentence structure, this paper proposes a Drug-Drug interaction extraction model based on the attention mechanism over the dependency. The correlation between the shortest dependency path and the sentence is measured to capture the useful information. Firstly, this model uses BiGRU network to learn the semantic information and context information of the original sentence and the Shortest Dependency Path (SDP) respectively. Secondly, the SDP information is incorporated into the original sentence information through the Attention mechanism. Finally, the final sentence representation is used to classify and predict DDI. This approach is evaluated on DDIExtraction 2013 corpus, yielding a micro F-scores of 73.72%.
[1] Chowdhury M, et al. FBK-irst: A multi-phase kernel based approach for Drug-Drug interaction detection and classification that exploits linguistic information[C]//Proceedings of the 7th International Workshop on Semantic Evaluation, Atlanta, Georgia, USA, 2013:351-355. [2] Segura Bedmar I, Martinez P, Herrero Zazo M. Semeval-2013 task 9: Extraction of Drug-Drug interactions from biomedical texts (DDIextraction 2013)[J].Proceeding of Semeval, 2013 ,2(SemEval):341-350. [3] Kim S, et al. Extracting Drug-Drug interactions from literature using a rich feature-based linear kernel approach[J].Journal of Biomedical Informatics, 2015(55):23-30. [4] Liu S, et al. Drug-Drug interaction extraction via convolutional neural networks[J].Comput Math Methods Med, 2016:6918381. [5] Quan C, et al. Multichannel convolutional neural network for biological relation extraction[J]. BioMed Research International, 2016(2-1):1-10. [6] Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate[J]. arXiv:1409.0473.2014. [7] Asada M, Miwa M, Sasaki Y. Extracting Drug-Drug interactions with attention CNNs[C]//Proceedings of the BioNLP 2017 Workshop, Vancouver, Canada, 2017:9-18. [8] Sahu SK, Anand A. Drug-Drug interaction extraction from biomedical text using long short term memory network[J]. arXiv:1701.08303.2017. [9] Zhou D, Miao L, He Y. Position-aware deep multi-task learning for Drug-Drug interaction extraction[J]. Artificial Intelligence in Medicine, 2018,87:1-8. [10] Liu Y, et al. A dependency-based neural network for relation classification[J]. arXiv: 1507.04646.2015. [11] Yan X, et al. Classifying relations via long short term memory networks along shortest dependency path[C]//Proceedings of EMULP,2015: 1785-1794. [12] Miwa M, Bansal M. End-to-end relation extraction using lstms on sequences and tree structures[J]. arXiv: 1601.00770.2016. [13] Zhang Y, Zheng W, Lin H, et al. Drug-Drug interaction extraction via hierarchical RNNs on sequence and shortest dependency paths[J].Bioinformatics, 2017(34):828-835. [14] Kyunghyun Cho, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing(EMNLP), Doha, Qatar, 2014:1724-1734. [15] Herrerozazo M, Segurabedmar I, Declerck T. The DDI corpus: an annotated corpus with pharmacological substances and Drug-Drug interactions[J].Journal of Biomedical Informatics, 2013(46):914-920. [16] Segurabedmar I, Herrerozazo M. Lessons learnt from the DDIExtraction-2013 Shared Task[J].Journal of Biomedical Informatics, 2014(51):152-164. [17] Yi Z, et al. Drug-Drug interaction extraction via recurrent neural network with multiple attention layers[C]//Proceedings of the arXiv:1705.03261.2017. [18] Zheng W, et al. A graph kernel based on context vectors for extracting Drug-Drug interactions[J].Journal of Biomedical Informatics, 2016(61):34-43. [19] Raihani A, Laachfoubi N. Extracting Drug-Drug interactions from biomedical text using a feature-based kernel approach[J].Journal of Theoretical and Applied Information Technology, 2016(92):109-120. [20] Zhao Z, et al. Drug drug interaction extraction from biomedical literature using syntax convolutional neural network[J].Bioinformatics, 2016, 32(22):3444-3453.