pyspark.SparkFiles

class pyspark.SparkFiles[source]

Resolves paths to files added through SparkContext.addFile().

SparkFiles contains only classmethods; users should not create SparkFiles instances.

Methods

get(filename)

Get the absolute path of a file added through SparkContext.addFile() or SparkContext.addPyFile().

getRootDirectory()

Get the root directory that contains files added through SparkContext.addFile() or SparkContext.addPyFile().

previous

pyspark.SparkConf

next

pyspark.StorageLevel