A Hybrid Approach t Word Segmentation

Dimitar Kazakov; Suresh Manandhar

doi:10.1007/BFb0027316

A Hybrid Approach t Word Segmentation

Dimitar Kazakov, Suresh Manandhar

Computer Science

Research output: Contribution to conference › Paper

Abstract

This article presents a combination of unsupervised and supervised learning techniques for generation of word segmentation rules from a list of words. First, a bias for word segmentation is introduced and a simple genetic algorithm is used for the search of segmentation that corresponds to the best bias value. In the second phase, the segmentation obtained from the genetic algorithm is used as an input for two inductive logic programming algorithms, namely FoIDL and CLOG. The result is a logic program that can be used for segmentation of unseen words. The learnt program contains affixes which are characteristic for the given language and can be used in other morphology tasks.

Original language	Undefined/Unknown
Pages	125-134
DOIs	https://doi.org/10.1007/BFb0027316
Publication status	Published - 1998

Access to Document

10.1007/BFb0027316

http://www.springerlink.com/content/d6764838212184v8/

Cite this

@conference{7f5eeca4b18244e3a119a80b7e491d9b,

title = "A Hybrid Approach t Word Segmentation",

abstract = "This article presents a combination of unsupervised and supervised learning techniques for generation of word segmentation rules from a list of words. First, a bias for word segmentation is introduced and a simple genetic algorithm is used for the search of segmentation that corresponds to the best bias value. In the second phase, the segmentation obtained from the genetic algorithm is used as an input for two inductive logic programming algorithms, namely FoIDL and CLOG. The result is a logic program that can be used for segmentation of unseen words. The learnt program contains affixes which are characteristic for the given language and can be used in other morphology tasks.",

author = "Dimitar Kazakov and Suresh Manandhar",

year = "1998",

doi = "10.1007/BFb0027316",

language = "Undefined/Unknown",

pages = "125--134",

}

TY - CONF

T1 - A Hybrid Approach t Word Segmentation

AU - Kazakov, Dimitar

AU - Manandhar, Suresh

PY - 1998

Y1 - 1998

N2 - This article presents a combination of unsupervised and supervised learning techniques for generation of word segmentation rules from a list of words. First, a bias for word segmentation is introduced and a simple genetic algorithm is used for the search of segmentation that corresponds to the best bias value. In the second phase, the segmentation obtained from the genetic algorithm is used as an input for two inductive logic programming algorithms, namely FoIDL and CLOG. The result is a logic program that can be used for segmentation of unseen words. The learnt program contains affixes which are characteristic for the given language and can be used in other morphology tasks.

AB - This article presents a combination of unsupervised and supervised learning techniques for generation of word segmentation rules from a list of words. First, a bias for word segmentation is introduced and a simple genetic algorithm is used for the search of segmentation that corresponds to the best bias value. In the second phase, the segmentation obtained from the genetic algorithm is used as an input for two inductive logic programming algorithms, namely FoIDL and CLOG. The result is a logic program that can be used for segmentation of unseen words. The learnt program contains affixes which are characteristic for the given language and can be used in other morphology tasks.

U2 - 10.1007/BFb0027316

DO - 10.1007/BFb0027316

M3 - Paper

SP - 125

EP - 134

ER -