pyspark.sql.SparkSession.profile

property SparkSession.profile

Returns a pyspark.sql.profile.Profile for performance/memory profiling.

New in version 4.0.0.

Returns

pyspark.sql.profile.Profile

Notes

Supports Spark Connect.