arXiv · 1906.09719
On the Definition of Japanese Word
Abstract
The annotation guidelines for Universal Dependencies (UD) stipulate that the basic units of dependency annotation are syntactic words, but it is not clear what are syntactic words in Japanese. Departing from the long tradition of using phrasal units called bunsetsu for dependency parsing, the current UD Japanese treebanks adopt the Short Unit Words. However, we argue that they are not syntactic word as specified by the annotation guidelines. Although we find non-mainstream attempts to linguistically define Japanese words, such definitions have never been applied to corpus annotation. We discuss the costs and benefits of adopting the rather unfamiliar criteria.
Explore related subjects
Keep this discovery
Yugo Murawaki. 2019-06-24. On the Definition of Japanese Word. https://arxiv.org/abs/1906.09719
Cite the original work for its findings. Save a collection to share your selection of sources.