AFTSurvivalRegression
regression
AFTSurvivalRegressionModel
regression
ALS
recommendation recommendation
ALSModel
recommendation
ANY
TaskLocality
AbsoluteError
loss
Accumulable
spark
AccumulableInfo
scheduler v1
AccumulableParam
spark
Accumulator
spark
AccumulatorParam
spark
AccumulatorV2
util
Aggregator
spark expressions
Algo
configuration Algo
AnalysisException
sql
And
sources
AnyDataType
types
ApplicationAttemptInfo
v1
ApplicationEnvironmentInfo
v1
ApplicationInfo
v1
ApplicationStatus
v1
ApproxHist
QuantileStrategy
ArrayType
types
Assignment
PowerIterationClustering
AssociationRules
fpm
AsyncRDDActions
rdd
AtomicType
types
Attribute
attribute
AttributeGroup
attribute
AttributeType
attribute
abortJob
FileCommitProtocol HadoopMapReduceCommitProtocol
abortTask
FileCommitProtocol HadoopMapReduceCommitProtocol
abs
functions Decimal
acceptsType
ObjectType
accumUpdates
ExceptionFailure SparkListenerExecutorMetricsUpdate
accumulable
SparkContext JavaSparkContext
accumulableCollection
SparkContext
accumulables
StageInfo TaskInfo
accumulator
SparkContext JavaSparkContext
accumulatorUpdates
StageData TaskData
accuracy
MulticlassMetrics MultilabelMetrics
acos
functions
active
StreamingQueryManager ReceiverInfo
activeJobs
JobProgressListener
activeStages
JobProgressListener
activeStorageStatusList
ExecutorsListener StorageListener
activeTasks
ExecutorSummary
add
Accumulable BlockMatrix MultivariateOnlineSummarizer StructType AccumulatorV2 CollectionAccumulator DoubleAccumulator LegacyAccumulatorWrapper LongAccumulator CountMinSketch
addAccumulator
AccumulableParam AccumulatorParam
addAppArgs
SparkLauncher
addBinary
CountMinSketch
addFile
SparkContext JavaSparkContext SparkLauncher
addGrid
ParamGridBuilder
addInPlace
AccumulableParam DoubleAccumulatorParam FloatAccumulatorParam IntAccumulatorParam LongAccumulatorParam
addIntercept
GeneralizedLinearAlgorithm
addJar
SparkContext JavaSparkContext SparkLauncher HiveSessionResourceLoader
addListener
SparkAppHandle StreamingQueryManager
addLong
CountMinSketch
addPyFile
SparkLauncher
addSparkArg
SparkLauncher
addSparkListener
SparkContext
addStreamingListener
StreamingContext JavaStreamingContext
addString
CountMinSketch
addTaskCompletionListener
TaskContext
addTaskFailureListener
TaskContext
add_months
functions
address
RDDDataDistribution
agg
Dataset KeyValueGroupedDataset RelationalGroupedDataset
aggUntyped
KeyValueGroupedDataset
aggregate
JavaRDDLike RDD
aggregateByKey
JavaPairRDD PairRDDFunctions
aggregateMessages
Graph
aggregateMessagesWithActiveSet
GraphImpl
aggregateUsingIndex
VertexRDD VertexRDDImpl
aggregator
ShuffleDependency
aic
GeneralizedLinearRegressionSummary
algo
Strategy DecisionTreeModel GradientBoostedTreesModel RandomForestModel
algorithm
StreamingLogisticRegressionWithSGD StreamingLinearAlgorithm StreamingLinearRegressionWithSGD
alias
Column Dataset
alpha
WeibullGenerator
analyzer
HiveSessionStateBuilder
and
Column
antecedent
Rule
anyNull
Row
apache
org
api
spark sql status streaming
appAttemptId
SparkListenerApplicationStart
appId
SparkListenerApplicationStart
appName
SparkContext JavaSparkContext SparkListenerApplicationStart Builder
appendBias
MLUtils
applicationAttemptId
SparkContext
applicationId
SparkContext
apply
Graph Pregel VertexRDD GraphImpl AttributeGroup DenseMatrix DenseVector Matrix SparseMatrix Vector ParamMap DenseMatrix DenseVector Matrix SparseMatrix Vector AccumulableInfo Column Dataset Row UserDefinedAggregateFunction UserDefinedFunction DetermineTableStats HiveAnalysis RelationConversions ResolveHiveSerdeTable HiveScriptIOSchema ProcessingTime ArrayType Decimal MapType StructType BlockId StorageLevel Milliseconds Minutes Seconds Broker SimpleConsumerConfig OffsetRange StatCounter
applySchema
SQLContext
approxCountDistinct
functions
approxQuantile
DataFrameStatFunctions
approx_count_distinct
functions
areaUnderPR
BinaryClassificationMetrics
areaUnderROC
BinaryLogisticRegressionSummary BinaryClassificationMetrics
argString
CreateHiveTableAsSelectCommand
argmax
DenseVector SparseVector Vector DenseVector SparseVector Vector
array
ColumnName functions
arrayLengthGt
ParamValidators
array_contains
functions
as
Column Dataset
asIterator
DeserializationStream
asKeyValueIterator
DeserializationStream
asML
DenseMatrix DenseVector Matrix SparseMatrix SparseVector Vector
asNullable
ObjectType
asRDDId
BlockId
asc
Column functions
asc_nulls_first
Column functions
asc_nulls_last
Column functions
ascii
functions
asin
functions
assertValid
Broadcast
assignments
PowerIterationClusteringModel
associationRules
FPGrowthModel
atan
functions
atan2
functions
attempt
TaskData
attemptId
StageInfo ApplicationAttemptInfo StageData
attemptNumber
TaskCommitDenied TaskContext TaskInfo
attempts
ApplicationInfo
attr
Edge EdgeContext
attrType
Attribute BinaryAttribute NominalAttribute NumericAttribute UnresolvedAttribute
attribute
ml EqualNullSafe EqualTo GreaterThan GreaterThanOrEqual In IsNotNull IsNull LessThan LessThanOrEqual StringContains StringEndsWith StringStartsWith
attributes
AttributeGroup
available
LZ4BlockInputStream NioBufferedFileInputStream
avg
RelationalGroupedDataset typed functions DoubleAccumulator LongAccumulator
avgEventRate
ReceiverInfo
avgInputRate
StreamingStatistics
avgMetrics
CrossValidatorModel
avgProcessingTime
StreamingStatistics
avgSchedulingDelay
StreamingStatistics
avgTotalDelay
StreamingStatistics
awaitAnyTermination
StreamingQueryManager
awaitTermination
StreamingQuery StreamingContext JavaStreamingContext
awaitTerminationOrTimeout
StreamingContext JavaStreamingContext