Implementation of Dependency Parser Using Artificial Neural Network Methods
DOI:
https://doi.org/10.34818/INDOJC.2020.5.3.504Abstract
In recent years, parsing has become very popular within the scope of NLP (Natural Language Processing) with the presence of Dependency Parser. However, almost all existing Dependency Parser do classifications based on millions of sparse indicator features. This feature is not only bad in drawing conclusions, but also significantly limits the speed of parsing so that the resulting parsing is not optimal. To overcome these problems, changing the use of sparse features becomes dense features to reduce sparsity between words. The Artificial Neural Network classification method is used to produce fast and concise parsing in the Transition-Based Dependency Parser by using 2 hyperparameters. The dataset used in this study is Arabic, Chinese, English, and Indonesian. Based on the evaluation that has been done, it shows a higher result using the second hyperparameter. In testing with English test data, the accuracy value of LAS (Labeled Attachment Score) is 80.4% and UAS (Unlabelled Attachment Score) is 83%, Then with dev data obtained an accuracy value of LAS 81.1% and UAS 83.7%, and parsing speed of 98 sentences per second (sent/s).
Keywords: Parsing, dependency parser, transition-based dependency parsing.
Downloads
References
Giuseppe Attardi. Experiments with a multilanguage non-projective dependency parser. pages 166–170, 2006.
Danqi Chen and Christopher D Manning. A fast and accurate dependency parser using neural networks. pages 740–750,2014.
Filip Ginter, Yoav Goldberg, and Jan Haji Ìc. Universal dependency. https://universaldependencies.org/, 2014. Online; Accessed 9 June 2020.
Spence Green and Christopher D Manning. Better arabic parsing: Baselines, evaluations, and analysis. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 394–402, 2010.
He He, Hal Daumé III, and Jason Eisner. Dynamic feature selection for dependency parsing. In Proceedings of the 2013 conference on empirical methods in natural language processing, pages 1455–1464, 2013.
Daniel Jurafsky and James H Martin. Dependency parsing. Speech and Language Processing, 2009.
Dan Klein and Christopher D Manning. Accurate unlexicalized parsing. pages 423–430, 2003.
Terry Koo, Xavier Carreras, and Michael Collins. Simple semi-supervised dependency parsing. In Proceedings of ACL-08:HLT, pages 595–603, 2008.
Sandra Kübler, Ryan McDonald, and Joakim Nivre. Dependency parsing.Synthesis lectures on human language technologies, 1(1):1–127, 2009.
Tetsuya Nasukawa. Parsing method and system for natural language processing, June 2 1998. US Patent 5,761,631.
D. Nasution, T. H. F. Harumy, E. Haryanto, F. Fachrizal, Julham, and A. Turnip. A classification method for prediction of qualitative properties of multivariate eeg-p300 signals. In 2015 International Conference on Automation, Cognitive Science,Optics, Micro Electro-Mechanical System, and Information Technology (ICACOMIT), pages 82–86, 2015.
Joakim Nivre. An efficient algorithm for projective dependency parsing. In Proceedings of the Eighth International Conference on Parsing Technologies, pages 149–160, 2003.
Joakim Nivre, Johan Hall, and Jens Nilsson. Maltparser: A data-driven parser-generator for dependency parsing. 6:2216–2219,2006.
Chuan Wang, Bin Li, and Nianwen Xue. Transition-based chinese amr parsing. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 247–252, 2018.
David Weiss, Chris Alberti, Michael Collins, and Slav Petrov. Structured training for neural network transition-based parsing.arXiv preprint arXiv:1506.06158, 2015.
Downloads
Published
How to Cite
Issue
Section
License
- Manuscript submitted to IndoJC has to be an original work of the author(s), contains no element of plagiarism, and has never been published or is not being considered for publication in other journals.Â
- Copyright on any article is retained by the author(s). Regarding copyright transfers please see below.
- Authors grant IndoJC a license to publish the article and identify itself as the original publisher.
- Authors grant IndoJC commercial rights to produce hardcopy volumes of the journal for sale to libraries and individuals.
- Authors grant any third party the right to use the article freely as long as its original authors and citation details are identified.
- The article and any associated published material is distributed under the Creative Commons Attribution 4.0License
