Uses of Class
org.apache.sysds.runtime.transform.tokenize.DocumentRepresentation
Packages that use DocumentRepresentation
Package
Description
-
Uses of DocumentRepresentation in org.apache.sysds.runtime.transform.tokenize.applier
Methods in org.apache.sysds.runtime.transform.tokenize.applier with parameters of type DocumentRepresentationModifier and TypeMethodDescriptionintTokenizerApplier.applyInternalRepresentation(DocumentRepresentation[] internalRepresentation, FrameBlock out) intTokenizerApplierCount.applyInternalRepresentation(DocumentRepresentation[] internalRepresentation, FrameBlock out, int inputRowStart, int blk) intTokenizerApplierHash.applyInternalRepresentation(DocumentRepresentation[] internalRepresentation, FrameBlock out, int inputRowStart, int blk) intTokenizerApplierPosition.applyInternalRepresentation(DocumentRepresentation[] internalRepresentation, FrameBlock out, int inputRowStart, int blk) voidTokenizerApplier.build(DocumentRepresentation[] internalRepresentation, int inputRowStart, int blk) voidTokenizerApplierCount.build(DocumentRepresentation[] internalRepresentation, int inputRowStart, int blk) voidTokenizerApplierHash.build(DocumentRepresentation[] internalRepresentation, int inputRowStart, int blk) List<DependencyTask<?>>TokenizerApplier.getApplyTasks(DocumentRepresentation[] internalRepresentation, FrameBlock out) List<DependencyTask<?>>TokenizerApplier.getBuildTasks(DocumentRepresentation[] internalRepresentation) abstract intTokenizerApplier.getNumRows(DocumentRepresentation[] internalRepresentation) intTokenizerApplierCount.getNumRows(DocumentRepresentation[] internalRepresentation) intTokenizerApplierHash.getNumRows(DocumentRepresentation[] internalRepresentation) intTokenizerApplierPosition.getNumRows(DocumentRepresentation[] internalRepresentation) intTokenizerApplier.getOutputRow(int inputRowStart, DocumentRepresentation[] internalData) -
Uses of DocumentRepresentation in org.apache.sysds.runtime.transform.tokenize.builder
Methods in org.apache.sysds.runtime.transform.tokenize.builder with parameters of type DocumentRepresentationModifier and TypeMethodDescriptionvoidTokenizerBuilder.createInternalRepresentation(FrameBlock in, DocumentRepresentation[] internalRepresentation) abstract voidTokenizerBuilder.createInternalRepresentation(FrameBlock in, DocumentRepresentation[] internalRepresentation, int rowStart, int blk) voidTokenizerBuilderNgram.createInternalRepresentation(FrameBlock in, DocumentRepresentation[] internalRepresentation, int rowStart, int blk) voidTokenizerBuilderWhitespaceSplit.createInternalRepresentation(FrameBlock in, DocumentRepresentation[] internalRepresentation, int rowStart, int blk) List<DependencyTask<?>>TokenizerBuilder.getTasks(FrameBlock in, DocumentRepresentation[] internalRepresentation)