pyspark.sql.functions.years

pyspark.sql.functions.years(col)

Partition transform function: A transform for timestamps and dates to partition data into years.

New in version 3.1.0.

Notes

This function can be used only in combination with partitionedBy() method of the DataFrameWriterV2.

Examples

>>> df.writeTo("catalog.db.table").partitionedBy(  
...     years("ts")
... ).createOrReplace()

previous

pyspark.sql.functions.year

next

pyspark.sql.functions.zip_with