Package opennlp.tools.tokenize
Class TokenizerCrossValidator
java.lang.Object
opennlp.tools.tokenize.TokenizerCrossValidator
A cross validator for
tokenizers.-
Constructor Summary
ConstructorsConstructorDescriptionTokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners) Creates aTokenizerCrossValidatorusing the givenTokenizerFactory. -
Method Summary
Modifier and TypeMethodDescriptionvoidevaluate(ObjectStream<TokenSample> samples, int nFolds) Starts the evaluation.
-
Constructor Details
-
TokenizerCrossValidator
public TokenizerCrossValidator(TrainingParameters params, TokenizerFactory factory, TokenizerEvaluationMonitor... listeners) Creates aTokenizerCrossValidatorusing the givenTokenizerFactory.- Parameters:
params- TheTrainingParametersfor the context of cross validation.factory- TheTokenizerFactoryto be used.listeners- Theevaluation listeners.
-
-
Method Details
-
evaluate
Starts the evaluation.- Parameters:
samples- TheObjectStreamofsamplesto train and test with.nFolds- Number of folds. It must be greater than zero.- Throws:
IOException- Thrown if IO errors occurred during evaluation.
-
getFMeasure
-