pyspark.
SparkFiles
Resolves paths to files added through SparkContext.addFile().
SparkContext.addFile()
SparkFiles contains only classmethods; users should not create SparkFiles instances.
Methods
get(filename)
get
Get the absolute path of a file added through SparkContext.addFile() or SparkContext.addPyFile().
SparkContext.addPyFile()
getRootDirectory()
getRootDirectory
Get the root directory that contains files added through SparkContext.addFile() or SparkContext.addPyFile().