JSAI2020

JSAI2020

Jun 9 - Jun 12, 2020Virtual Meetings
The Japanese Society for Artificial Intelligence
JSAI2020

JSAI2020

Jun 9 - Jun 12, 2020Virtual Meetings

[1D5-GS-9-03]A method of learning word embeddings considering Japanese character types

〇Satoshi Hirade1, Eiichi Tanaka1, Takeshi Onishi1(1. Fuji Xerox, Co., Ltd.)

Keywords:

Word Embeddings,Japanese,Character type

In this paper, we present a novel method for learning word embeddings. However, several word embedding approaches with extracting subwords from target word have been proposed, those methods have the problem of leaving subwords without meaning associated with the target word. These subwords have negative effects on obtaining better performance of word embeddings. To solve this problem, we adopted switching subword extraction rules based on Japanese character types. With this contrivance, the appearence of the subwords are surpressed. As a result, our method achieved better results on word similarity task than Word2Vec and FastText.