DataFrame.
na
Returns a DataFrameNaFunctions for handling missing values.
DataFrameNaFunctions
New in version 1.3.1.
Changed in version 3.4.0: Supports Spark Connect.
Examples
>>> df = spark.sql("SELECT 1 AS c1, int(NULL) AS c2") >>> type(df.na) <class '...dataframe.DataFrameNaFunctions'>
Replace the missing values as 2.
>>> df.na.fill(2).show() +---+---+ | c1| c2| +---+---+ | 1| 2| +---+---+