A Universal Dependencies Corpora Maintenance Methodology Using Downstream Application

Abstract:

This paper investigates updates of Universal Dependencies (UD) treebanks in 23 languages and their impact on a downstream application. Numerous people are involved in updating UD’s annotation guidelines and treebanks in various languages. However, it is not easy to verify whether the updated resources maintain universality with other language resources. Thus, validity and consistency of multilingual corpora should be tested through application tasks involving syntactic structures with PoS tags, dependency labels, and universal features. We apply the syntactic parsers trained on UD treebanks from multiple versions (2.0 to 2.7) to a clause-level sentiment extractor. We then analyze the relationships between attachment scores of dependency parsers and performance in application tasks. For future UD developments, we show examples of outputs that differ depending on version.

Downloads:

• No text available
• No slides available

BibTeX:

@inproceedings{iwamoto-etal-2021-universal,
  title = {A {U}niversal {D}ependencies Corpora Maintenance Methodology Using Downstream Application},
  author = {Iwamoto, Ran and Kanayama, Hiroshi and Rademaker, Alexandre and Ohko, Takuya},
  booktitle = {Proceedings of the Third Workshop on Computational Typology and Multilingual NLP},
  month = jun,
  year = {2021},
  address = {Online},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/2021.sigtyp-1.3},
  doi = {10.18653/v1/2021.sigtyp-1.3},
  pages = {23--31}
}