pyspark.sql.streaming.StreamingQuery.recentProgress

property StreamingQuery.recentProgress

Returns an array of the most recent [[StreamingQueryProgress]] updates for this query. The number of progress updates retained for each stream is configured by Spark session configuration spark.sql.streaming.numRecentProgressUpdates.

New in version 2.1.

pyspark.sql.streaming.StreamingQuery.processAllAvailable pyspark.sql.streaming.StreamingQuery.runId