Spark 2.4.7 ScalaDoc

AFTSurvivalRegression

regression

AFTSurvivalRegressionModel

regression

ALS

recommendation recommendation

ALSModel

ANY

AbsoluteError

AbstractLauncher

~~Accumulable~~

~~spark~~

AccumulableInfo

scheduler v1

~~AccumulableParam~~

~~spark~~

~~Accumulator~~

~~spark~~

~~AccumulatorParam~~

~~spark~~

AccumulatorV2

util

Aggregator

spark expressions

Algo

configuration Algo

AnalysisException

sql

And

sources

AnyDataType

types

ApplicationAttemptInfo

v1

ApplicationEnvironmentInfo

v1

ApplicationInfo

v1

ApplicationStatus

v1

ApproxHist

QuantileStrategy

ArrayType

types

ArrowColumnVector

vectorized

Assignment

PowerIterationClustering

AssociationRules

fpm

AsyncRDDActions

rdd

AtomicType

Attribute

AttributeGroup

AttributeType

abort

DataSourceWriter DataWriter StreamWriter

abortJob

FileCommitProtocol HadoopMapReduceCommitProtocol

abortTask

FileCommitProtocol HadoopMapReduceCommitProtocol

abs

functions Decimal

acceptsType

ObjectType

accumUpdates

ExceptionFailure TaskKilled SparkListenerExecutorMetricsUpdate

~~accumulable~~

~~SparkContext~~ ~~JavaSparkContext~~

~~accumulableCollection~~

~~SparkContext~~

accumulables

StageInfo TaskInfo

~~accumulator~~

~~SparkContext~~ ~~JavaSparkContext~~

accumulatorUpdates

StageData TaskData

accuracy

LogisticRegressionSummary MulticlassMetrics MultilabelMetrics

acos

functions

active

SparkSession StreamingQueryManager ReceiverInfo

activeTasks

ExecutorSummary

add

Accumulable BlockMatrix MultivariateOnlineSummarizer StructType AccumulatorV2 CollectionAccumulator DoubleAccumulator LegacyAccumulatorWrapper LongAccumulator CountMinSketch

addAccumulator

AccumulableParam AccumulatorParam

addAppArgs

AbstractLauncher SparkLauncher

addBinary

CountMinSketch

addFile

SparkContext JavaSparkContext AbstractLauncher SparkLauncher

addGrid

ParamGridBuilder

addInPlace

AccumulableParam DoubleAccumulatorParam FloatAccumulatorParam IntAccumulatorParam LongAccumulatorParam

addIntercept

GeneralizedLinearAlgorithm

addJar

SparkContext JavaSparkContext AbstractLauncher SparkLauncher HiveSessionResourceLoader

addListener

SparkAppHandle StreamingQueryManager

addLong

CountMinSketch

addPyFile

AbstractLauncher SparkLauncher

addSparkArg

AbstractLauncher SparkLauncher

addSparkListener

SparkContext

addStreamingListener

StreamingContext JavaStreamingContext

addString

CountMinSketch

addTaskCompletionListener

BarrierTaskContext TaskContext

addTaskFailureListener

BarrierTaskContext TaskContext

addTime

ExecutorSummary

addURL

MutableURLClassLoader

add_months

functions

address

BarrierTaskInfo RDDDataDistribution

agg

Dataset KeyValueGroupedDataset RelationalGroupedDataset

aggUntyped

KeyValueGroupedDataset

aggregate

JavaRDDLike RDD

aggregateByKey

JavaPairRDD PairRDDFunctions

aggregateMessages

Graph

aggregateMessagesWithActiveSet

GraphImpl

aggregateUsingIndex

VertexRDD VertexRDDImpl

aggregationDepth

HasAggregationDepth

aggregator

ShuffleDependency

aic

GeneralizedLinearRegressionSummary

algo

Strategy DecisionTreeModel GradientBoostedTreesModel RandomForestModel

algorithm

StreamingLogisticRegressionWithSGD StreamingLinearAlgorithm StreamingLinearRegressionWithSGD

alias

Column Dataset

alpha

WeibullGenerator

analyzer

HiveSessionStateBuilder

and

Column

antecedent

Rule

anyNull

Row ColumnarRow

apache

org

api

spark sql status streaming

appAttemptId

SparkListenerApplicationStart

appId

SparkListenerApplicationStart

appName

SparkContext JavaSparkContext SparkListenerApplicationStart Builder

appSparkVersion

ApplicationAttemptInfo

appendBias

MLUtils

applicationAttemptId

SparkContext

applicationId

SparkContext

apply

~~applySchema~~

~~SQLContext~~

~~approxCountDistinct~~

~~functions~~

approxQuantile

DataFrameStatFunctions

approx_count_distinct

functions

areaUnderPR

BinaryClassificationMetrics

areaUnderROC

BinaryLogisticRegressionSummary BinaryClassificationMetrics

argString

CreateHiveTableAsSelectCommand

argmax

DenseVector SparseVector Vector DenseVector SparseVector Vector

array

ColumnName functions ColumnarArray

arrayLengthGt

array_contains

array_distinct

array_except

array_intersect

array_join

array_max

array_min

array_position

array_remove

array_repeat

array_sort

array_union

arrays_overlap

arrays_zip

as

asBinary

LogisticRegressionSummary

asIterator

DeserializationStream

asKeyValueIterator

DeserializationStream

asML

DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector

asMap

asNonNullable

asNondeterministic

asNullable

asRDDId

asc

asc_nulls_first

asc_nulls_last

ascii

asin

assertConf

HadoopWriteConfigUtil

assertValid

Broadcast

assignClusters

PowerIterationClustering

assignments

PowerIterationClusteringModel

associationRules

atan

atan2

attempt

attemptId

~~StageInfo~~ ApplicationAttemptInfo StageData

attemptNumber

BarrierTaskContext TaskCommitDenied TaskContext StageInfo TaskInfo

attempts

ApplicationInfo

attr

Edge EdgeContext

attrType

Attribute BinaryAttribute NominalAttribute NumericAttribute UnresolvedAttribute

attribute

ml EqualNullSafe EqualTo GreaterThan GreaterThanOrEqual In IsNotNull IsNull LessThan LessThanOrEqual StringContains StringEndsWith StringStartsWith

attributes

AttributeGroup

available

NioBufferedFileInputStream ReadAheadInputStream

avg

RelationalGroupedDataset typed functions DoubleAccumulator LongAccumulator

avgEventRate

avgInputRate

avgMetrics

avgProcessingTime

avgSchedulingDelay

avgTotalDelay

awaitAnyTermination

StreamingQueryManager

awaitTermination

StreamingQuery StreamingContext JavaStreamingContext

awaitTerminationOrTimeout

StreamingContext JavaStreamingContext