A Reranking Model for Korean Morphological Analysis Based on Sequence-to-Sequence Model

KIPS Transactions on Software and Data Engineering, Vol. 7, No.4, pp.121-128, April 2018
10.3745/KTSDE.2018.7.4.121, Full Text

Abstract

A Korean morphological analyzer adopts sequence-to-sequence (seq2seq) model, which can generate an output sequence of different length from an input. In general, a seq2seq based Korean morphological analyzer takes a syllable-unit based sequence as an input, and output a syllable-unit based sequence. Syllable-based morphological analysis has the advantage that unknown words can be easily handled, but has the disadvantages that morpheme-based information is ignored. In this paper, we propose a reranking model as a post-processor of seq2seq model that can improve the accuracy of morphological analysis. The seq2seq based morphological analyzer can generate K results by using a beam-search method. The reranking model exploits morpheme-unit embedding information as well as n-gram of morphemes in order to reorder K results. The experimental results show that the reranking model can improve 1.17% F1 score comparing with the original seq2seq model.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from October 15, 2016)

Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


Cite this paper

[KIPS Transactions Style]
Y. Choi and K. J. Lee, "A Reranking Model for Korean Morphological Analysis Based on Sequence-to-Sequence Model," KIPS Transactions on Software and Data Engineering, Vol.7, No.4, pp.121-128, 2018, DOI: 10.3745/KTSDE.2018.7.4.121.

[IEEE Style]
Yong-Seok Choi and Kong Joo Lee, "A Reranking Model for Korean Morphological Analysis Based on Sequence-to-Sequence Model," KIPS Transactions on Software and Data Engineering, vol. 7, no. 4, pp. 121-128, 2018. DOI: 10.3745/KTSDE.2018.7.4.121.

[ACM Style]
Choi, Y. and Lee, K. J. 2018. A Reranking Model for Korean Morphological Analysis Based on Sequence-to-Sequence Model. KIPS Transactions on Software and Data Engineering, 7, 4, (2018), 121-128. DOI: 10.3745/KTSDE.2018.7.4.121.