pyspark.sql.DataFrame.isLocal

DataFrame.isLocal() → bool

Returns True if the collect() and take() methods can be run locally (without any Spark executors).

New in version 1.3.0.

Changed in version 3.4.0: Supports Spark Connect.

Returns

bool

Examples

>>> df = spark.sql("SHOW TABLES")
>>> df.isLocal()
True

previous

pyspark.sql.DataFrame.isEmpty

next

pyspark.sql.DataFrame.isStreaming