Package org.apache.sysds.runtime.io
package org.apache.sysds.runtime.io
-
ClassDescriptionThis custom serialization class can be used via job.set(MRConfigurationNames.IO_SERIALIZATIONS, "org.apache.sysds.runtime.io.BinaryBlockSerialization");Shared helpers for the native (Spark-free) Delta Lake read/write paths used by both the matrix and frame readers/writers.Consumes a whole columnar batch.Opened latest snapshot of a Delta table: the logical schema plus everything needed to (re)read its data files, including the list of per-data-file scan rows.Thrown when a data file's parquet layout cannot be decoded directly into the typed output columns, e.g.Base class for all format-specific frame readers.Single-threaded frame binary block reader.Multi-threaded frame binary block reader.Single-threaded native Delta Lake reader for frames, built on the Spark-free Delta Kernel library.Parallel native Delta Lake frame reader.Single-threaded frame parquet reader.Multi-threaded frame parquet reader.Single-threaded frame textcell reader.Multi-threaded frame textcell reader.Single-threaded frame text csv reader.Multi-threaded frame text csv reader.Base class for all format-specific frame writers.Single-threaded frame binary block writer.Multi-threaded frame binary block writer.Single-threaded native Delta Lake writer for frames, built on the Spark-free Delta Kernel library.Single-threaded frame parquet writer.Multi-threaded frame parquet reader.Single-threaded frame text cell writer.Multi-threaded frame text cell writer.Single-threaded frame text csv writer.Single-threaded frame text csv writer.Base class for all format-specific matrix readers.Base class for all format-specific matrix writers.Single-threaded native Delta Lake reader for matrices, built on the Spark-free Delta Kernel library.Parallel native Delta Lake matrix reader.Parallel version of ReaderTextCell.java.Useful class for buffering unordered cells before locking target onces and appending all buffered cells.Parallel version of ReaderTextCSV.java.This class serves as the reader for federated objects.Single-threaded native Delta Lake writer for matrices, built on the Spark-free Delta Kernel library.