Uses of Interface
org.apache.sysds.runtime.controlprogram.caching.CacheBlock
-
-
Uses of CacheBlock in org.apache.sysds.runtime.compress
Classes in org.apache.sysds.runtime.compress that implement CacheBlock Modifier and Type Class Description classCompressedMatrixBlockMethods in org.apache.sysds.runtime.compress with parameters of type CacheBlock Modifier and Type Method Description MatrixBlockCompressedMatrixBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock ret) -
Uses of CacheBlock in org.apache.sysds.runtime.controlprogram.caching
Classes in org.apache.sysds.runtime.controlprogram.caching with type parameters of type CacheBlock Modifier and Type Class Description classCacheableData<T extends CacheBlock>Each object of this class is a cache envelope for some large piece of data called "cache block".Methods in org.apache.sysds.runtime.controlprogram.caching that return CacheBlock Modifier and Type Method Description CacheBlockByteBuffer. deserializeBlock()static CacheBlockCacheBlockFactory. newInstance(int code)static CacheBlockLazyWriteBuffer. readBlock(String fname, boolean matrix)static CacheBlockUnifiedMemoryManager. readBlock(String fname, boolean matrix)CacheBlockCacheBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock block)Slice a sub block out of the current block and write into the given output block.CacheBlockCacheBlock. slice(int rl, int ru, int cl, int cu, CacheBlock block)Slice a sub block out of the current block and write into the given output block.Methods in org.apache.sysds.runtime.controlprogram.caching with parameters of type CacheBlock Modifier and Type Method Description static longLazyWriteBuffer. getCacheBlockSize(CacheBlock cb)static longUnifiedMemoryManager. getCacheBlockSize(CacheBlock cb)static intCacheBlockFactory. getCode(CacheBlock block)static ArrayList<?>CacheBlockFactory. getPairList(CacheBlock block)static booleanCacheableData. isBelowCachingThreshold(CacheBlock data)static booleanByteBuffer. isValidCapacity(long size, CacheBlock cb)Determines if byte buffer can hold the given size given this specific cache block.voidCacheBlock. merge(CacheBlock that, boolean appendOnly)Merge the given block into the current block.voidByteBuffer. serializeBlock(CacheBlock cb)voidCacheMaintenanceService. serializeData(ByteBuffer bbuff, CacheBlock cb)CacheBlockCacheBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock block)Slice a sub block out of the current block and write into the given output block.CacheBlockCacheBlock. slice(int rl, int ru, int cl, int cu, CacheBlock block)Slice a sub block out of the current block and write into the given output block.static intLazyWriteBuffer. writeBlock(String fname, CacheBlock cb)static intUnifiedMemoryManager. writeBlock(String fname, CacheBlock cb) -
Uses of CacheBlock in org.apache.sysds.runtime.controlprogram.context
Methods in org.apache.sysds.runtime.controlprogram.context that return types with arguments of type CacheBlock Modifier and Type Method Description org.apache.spark.broadcast.Broadcast<CacheBlock>SparkExecutionContext. broadcastVariable(CacheableData<CacheBlock> cd)Methods in org.apache.sysds.runtime.controlprogram.context with parameters of type CacheBlock Modifier and Type Method Description static CacheableData<?>ExecutionContext. createCacheableData(CacheBlock cb)Method parameters in org.apache.sysds.runtime.controlprogram.context with type arguments of type CacheBlock Modifier and Type Method Description org.apache.spark.broadcast.Broadcast<CacheBlock>SparkExecutionContext. broadcastVariable(CacheableData<CacheBlock> cd) -
Uses of CacheBlock in org.apache.sysds.runtime.controlprogram.federated
Methods in org.apache.sysds.runtime.controlprogram.federated with parameters of type CacheBlock Modifier and Type Method Description static voidFederatedStatistics. incFedReuseReadBytesCount(CacheBlock cb)Future<FederatedResponse>FederatedData. initFederatedDataFromLocal(long id, CacheBlock block) -
Uses of CacheBlock in org.apache.sysds.runtime.controlprogram.parfor
Method parameters in org.apache.sysds.runtime.controlprogram.parfor with type arguments of type CacheBlock Modifier and Type Method Description voidCachedReuseVariables. reuseVariables(long pfid, LocalVariableMap vars, Collection<String> excludeList, Map<String,org.apache.spark.broadcast.Broadcast<CacheBlock>> _brInputs, boolean cleanCache)Constructor parameters in org.apache.sysds.runtime.controlprogram.parfor with type arguments of type CacheBlock Constructor Description RemoteParForSparkWorker(long jobid, String program, boolean isLocal, HashMap<String,byte[]> clsMap, boolean cpCaching, org.apache.spark.util.LongAccumulator atasks, org.apache.spark.util.LongAccumulator aiters, Map<String,org.apache.spark.broadcast.Broadcast<CacheBlock>> brInputs, boolean cleanCache, Map<String,String> lineage) -
Uses of CacheBlock in org.apache.sysds.runtime.data
Classes in org.apache.sysds.runtime.data that implement CacheBlock Modifier and Type Class Description classTensorBlockATensorBlockis the most top level representation of a tensor.Methods in org.apache.sysds.runtime.data that return CacheBlock Modifier and Type Method Description CacheBlockTensorBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock block)CacheBlockTensorBlock. slice(int rl, int ru, int cl, int cu, CacheBlock block)Methods in org.apache.sysds.runtime.data with parameters of type CacheBlock Modifier and Type Method Description voidTensorBlock. merge(CacheBlock that, boolean appendOnly)CacheBlockTensorBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock block)CacheBlockTensorBlock. slice(int rl, int ru, int cl, int cu, CacheBlock block) -
Uses of CacheBlock in org.apache.sysds.runtime.instructions.fed
Methods in org.apache.sysds.runtime.instructions.fed with parameters of type CacheBlock Modifier and Type Method Description static voidInitFEDInstruction. federateFrame(FrameObject output, List<org.apache.commons.lang3.tuple.Pair<FederatedRange,FederatedData>> workers, CacheBlock[] blocks)static voidInitFEDInstruction. federateMatrix(CacheableData<?> output, List<org.apache.commons.lang3.tuple.Pair<FederatedRange,FederatedData>> workers, CacheBlock[] blocks) -
Uses of CacheBlock in org.apache.sysds.runtime.instructions.spark.data
Classes in org.apache.sysds.runtime.instructions.spark.data with type parameters of type CacheBlock Modifier and Type Class Description classBroadcastObject<T extends CacheBlock>classPartitionedBlock<T extends CacheBlock>This class is for partitioned matrix/frame blocks, to be used as broadcasts.classPartitionedBroadcast<T extends CacheBlock>This class is a wrapper around an array of broadcasts of partitioned matrix/frame blocks, which is required due to 2GB limitations of Spark's broadcast handling. -
Uses of CacheBlock in org.apache.sysds.runtime.matrix.data
Classes in org.apache.sysds.runtime.matrix.data that implement CacheBlock Modifier and Type Class Description classFrameBlockclassMatrixBlockMethods in org.apache.sysds.runtime.matrix.data with parameters of type CacheBlock Modifier and Type Method Description voidFrameBlock. merge(CacheBlock that, boolean bDummy)voidMatrixBlock. merge(CacheBlock that, boolean appendOnly)static ListOperationsOnMatrixValues. performSlice(IndexRange ixrange, int blen, int iix, int jix, CacheBlock in)Slice used in broadcasting matrix blocks for spark, since this slice up a given matrix into blocks.FrameBlockFrameBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock retCache)Right indexing operations to slice a subframe out of this frame block.FrameBlockFrameBlock. slice(int rl, int ru, int cl, int cu, CacheBlock retCache)MatrixBlockMatrixBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock ret)Method to perform rightIndex operation for a given lower and upper bounds in row and column dimensions.MatrixBlockMatrixBlock. slice(int rl, int ru, int cl, int cu, CacheBlock ret) -
Uses of CacheBlock in org.apache.sysds.runtime.transform.encode
Methods in org.apache.sysds.runtime.transform.encode with parameters of type CacheBlock Modifier and Type Method Description MatrixBlockColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)Apply Functions are only used in Single Threaded or Multi-Threaded Dense context.MatrixBlockColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockColumnEncoderComposite. apply(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)Apply the generated metadata to the FrameBlock and saved the result in out.MatrixBlockMultiColumnEncoder. apply(CacheBlock in)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, int k)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol, int k)voidColumnEncoderUDF. applyDense(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)voidColumnEncoder. build(CacheBlock in, double[] equiHeightMaxs)voidColumnEncoder. build(CacheBlock in, Map<Integer,double[]> equiHeightMaxs)voidColumnEncoderBin. build(CacheBlock in)voidColumnEncoderBin. build(CacheBlock in, double[] equiHeightMaxs)voidColumnEncoderComposite. build(CacheBlock in)voidColumnEncoderComposite. build(CacheBlock in, Map<Integer,double[]> equiHeightMaxs)voidColumnEncoderDummycode. build(CacheBlock in)voidColumnEncoderFeatureHash. build(CacheBlock in)voidColumnEncoderPassThrough. build(CacheBlock in)voidColumnEncoderRecode. build(CacheBlock in)voidColumnEncoderUDF. build(CacheBlock in)voidEncoder. build(CacheBlock in)Build the transform meta data for the given block input.voidMultiColumnEncoder. build(CacheBlock in)voidMultiColumnEncoder. build(CacheBlock in, int k)voidMultiColumnEncoder. build(CacheBlock in, int k, Map<Integer,double[]> equiHeightBinMaxs)voidColumnEncoderComposite. computeRCDMapSizeEstimate(CacheBlock in, int[] sampleIndices)voidColumnEncoderRecode. computeRCDMapSizeEstimate(CacheBlock in, int[] sampleIndices)MatrixBlockMultiColumnEncoder. encode(CacheBlock in)MatrixBlockMultiColumnEncoder. encode(CacheBlock in, int k)List<DependencyTask<?>>ColumnEncoder. getApplyTasks(CacheBlock in, MatrixBlock out, int outputCol)List<DependencyTask<?>>ColumnEncoderComposite. getApplyTasks(CacheBlock in, MatrixBlock out, int outputCol)Callable<Object>ColumnEncoder. getBuildTask(CacheBlock in)Callable<Object>ColumnEncoderBin. getBuildTask(CacheBlock in)Callable<Object>ColumnEncoderRecode. getBuildTask(CacheBlock in)List<DependencyTask<?>>ColumnEncoder. getBuildTasks(CacheBlock in)List<DependencyTask<?>>ColumnEncoderComposite. getBuildTasks(CacheBlock in)List<DependencyTask<?>>ColumnEncoderDummycode. getBuildTasks(CacheBlock in)List<DependencyTask<?>>ColumnEncoderFeatureHash. getBuildTasks(CacheBlock in)List<DependencyTask<?>>ColumnEncoderPassThrough. getBuildTasks(CacheBlock in)List<DependencyTask<?>>ColumnEncoderUDF. getBuildTasks(CacheBlock in)Callable<Object>ColumnEncoder. getPartialBuildTask(CacheBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret)Callable<Object>ColumnEncoderBin. getPartialBuildTask(CacheBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret)Callable<Object>ColumnEncoderRecode. getPartialBuildTask(CacheBlock in, int startRow, int blockSize, HashMap<Integer,Object> ret)Constructors in org.apache.sysds.runtime.transform.encode with parameters of type CacheBlock Constructor Description FeatureHashSparseApplyTask(ColumnEncoderFeatureHash encoder, CacheBlock input, MatrixBlock out, int outputCol)FeatureHashSparseApplyTask(ColumnEncoderFeatureHash encoder, CacheBlock input, MatrixBlock out, int outputCol, int startRow, int blk) -
Uses of CacheBlock in org.apache.sysds.runtime.util
Methods in org.apache.sysds.runtime.util that return CacheBlock Modifier and Type Method Description static CacheBlockLocalFileUtils. readCacheBlockFromLocal(String fname, boolean matrix)Reads a matrix/frame block from local file system.Methods in org.apache.sysds.runtime.util with parameters of type CacheBlock Modifier and Type Method Description static voidLocalFileUtils. writeCacheBlockToLocal(String fname, CacheBlock cb)Writes a matrix/frame block to local file system.
-