Uses of Package
opennlp.tools.tokenize.uax29

Packages that use opennlp.tools.tokenize.uax29

Package	Description
opennlp.tools.tokenize.uax29
opennlp.tools.util.normalizer

Classes in opennlp.tools.tokenize.uax29 used by opennlp.tools.tokenize.uax29

Class	Description
WordBreak	The Unicode Word_Break property values, used by the UAX #29 word boundary algorithm.
WordSegmenter.SegmentConsumer	Receives each word segment as the half-open character range [start, end).
WordToken	A word token produced by WordTokenizer: the character Span into the source text together with its WordType.
WordTokenizer.TokenHandler	Receives each word token as a character range and its type, with no allocation.
WordType	The category of a word token.

Classes in opennlp.tools.tokenize.uax29 used by opennlp.tools.util.normalizer

Class	Description
WordTokenizer	A word tokenizer built on the Unicode Text Segmentation algorithm (UAX #29).