Technical term recognition with semi-supervised learning using hierarchical bayesian language models

Ryo Fujii, Akito Sakurai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To recognize technical term, term dictionaries or tagged corpora are required, but it will take much cost to compile them. Moreover, the terms may have several representations and new terms may be developed, which complicates the problem further, that is, a simple dictionary building can't solve the problem. In this research, to reduce the cost of creating dictionaries, we aimed at building a system that learns to recognize terminology from small tagged corpus using semi-supervised learning. We solved the problem by combining a tag level language model and a character level language model based on HPYLM. We performed experiments on recognition of biomedical terms. In supervised learning, we achived 65% F-measure which is 8% points behind the best existing system that utilizes many domain specific heuristics. In semi-supervised learning, we could keep the accuracy against reduction of supervised data better than exisiting methods.

Original languageEnglish
Title of host publicationNatural Language Processing and Information Systems - 17th International Conference on Applications of Natural Language to Information Systems, NLDB 2012, Proceedings
Pages327-332
Number of pages6
DOIs
Publication statusPublished - 2012 Jul 24
Event17th International Conference on Applications of Natural Language to Information Systems, NLDB 2012 - Groningen, Netherlands
Duration: 2012 Jun 262012 Jun 28

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7337 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other17th International Conference on Applications of Natural Language to Information Systems, NLDB 2012
CountryNetherlands
CityGroningen
Period12/6/2612/6/28

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Technical term recognition with semi-supervised learning using hierarchical bayesian language models'. Together they form a unique fingerprint.

Cite this