public class ColGroupDDC extends ColGroupValue
AColGroup.CompressionType| Modifier and Type | Method and Description |
|---|---|
AColGroup |
binaryRowOp(BinaryOperator op,
double[] v,
boolean sparseSafe,
boolean left)
Perform a binary row operation.
|
void |
countNonZerosPerRow(int[] rnnz,
int rl,
int ru)
Count the number of non-zeros per row
|
long |
estimateInMemorySize()
Get the upper bound estimate of in memory allocation for the column group.
|
double |
get(int r,
int c)
Get the value at a global row/column position.
|
org.apache.sysds.runtime.compress.colgroup.AColGroup.ColGroupType |
getColGroupType()
Internally get the specific type of ColGroup, this could be extracted from the object but that does not allow for
nice switches in the code.
|
AColGroup.CompressionType |
getCompType()
Obtain the compression type.
|
int[] |
getCounts(int[] counts) |
int[] |
getCounts(int rl,
int ru,
int[] counts) |
long |
getExactSizeOnDisk()
Returns the exact serialized size of column group.
|
int |
getIndexStructureHash() |
Dictionary |
preAggregateThatDDCStructure(ColGroupDDC that,
Dictionary ret) |
Dictionary |
preAggregateThatSDCSingleStructure(ColGroupSDCSingle that,
Dictionary ret,
boolean preModified) |
Dictionary |
preAggregateThatSDCSingleZerosStructure(ColGroupSDCSingleZeros that,
Dictionary ret) |
Dictionary |
preAggregateThatSDCStructure(ColGroupSDC that,
Dictionary ret,
boolean preModified) |
Dictionary |
preAggregateThatSDCZerosStructure(ColGroupSDCZeros that,
Dictionary ret) |
void |
readFields(DataInput in)
Deserialize column group from data input.
|
boolean |
sameIndexStructure(ColGroupCompressed that) |
AColGroup |
scalarOperation(ScalarOperator op)
Perform the specified scalar operation directly on the compressed column group, without decompressing individual
cells if possible.
|
String |
toString() |
void |
write(DataOutput out)
Serializes column group to data output.
|
addMinMax, cleanupThreadLocalMemory, containsValue, copy, copyAndSet, copyAndSet, copyAndSet, copyAndSet, decompressToBlockSafe, decompressToBlockUnSafe, getCachedCounts, getCounts, getCounts, getDictionary, getIfCountsType, getNumberNonZeros, getNumValues, getValues, getValuesAsBlock, isDense, isLossy, leftMultByAColGroup, leftMultByMatrix, preAggregateThatIndexStructure, replace, rightMultByMatrix, setupThreadLocalMemory, tsmm, tsmmgetMax, getMin, getNumRows, unaryAggregateOperations, unaryAggregateOperationsdecompressColumnToBlockUnSafe, decompressToBlockUnSafe, getColIndices, getNumCols, leftMultByMatrix, shiftColIndices, sliceColumn, sliceColumnspublic AColGroup.CompressionType getCompType()
AColGroupgetCompType in class AColGrouppublic double get(int r,
int c)
AColGrouppublic void countNonZerosPerRow(int[] rnnz,
int rl,
int ru)
AColGroupcountNonZerosPerRow in class AColGrouprnnz - non-zeros per rowrl - row lower bound, inclusiveru - row upper bound, exclusivepublic int[] getCounts(int[] counts)
getCounts in class ColGroupValuepublic int[] getCounts(int rl,
int ru,
int[] counts)
getCounts in class ColGroupValuepublic Dictionary preAggregateThatDDCStructure(ColGroupDDC that, Dictionary ret)
public Dictionary preAggregateThatSDCStructure(ColGroupSDC that, Dictionary ret, boolean preModified)
public Dictionary preAggregateThatSDCZerosStructure(ColGroupSDCZeros that, Dictionary ret)
public Dictionary preAggregateThatSDCSingleZerosStructure(ColGroupSDCSingleZeros that, Dictionary ret)
public Dictionary preAggregateThatSDCSingleStructure(ColGroupSDCSingle that, Dictionary ret, boolean preModified)
public boolean sameIndexStructure(ColGroupCompressed that)
public int getIndexStructureHash()
public org.apache.sysds.runtime.compress.colgroup.AColGroup.ColGroupType getColGroupType()
AColGrouppublic long estimateInMemorySize()
AColGroupestimateInMemorySize in class ColGroupValuepublic AColGroup scalarOperation(ScalarOperator op)
AColGroupscalarOperation in class AColGroupop - operation to performpublic AColGroup binaryRowOp(BinaryOperator op, double[] v, boolean sparseSafe, boolean left)
AColGroupbinaryRowOp in class AColGroupop - The operation to executev - The vector of values to apply, should be same length as dictionary length.sparseSafe - True if the operation return 0 on all instances of values in v -- op(v[?], 0)left - Specifies if the operation is executed on the left or right side of the values contained.public void write(DataOutput out) throws IOException
AColGroupwrite in class ColGroupValueout - data outputIOException - if IOException occurspublic void readFields(DataInput in) throws IOException
AColGroupreadFields in class ColGroupValuein - data inputIOException - if IOException occurspublic long getExactSizeOnDisk()
AColGroupgetExactSizeOnDisk in class ColGroupValuepublic String toString()
toString in class ColGroupValueCopyright © 2021 The Apache Software Foundation. All rights reserved.