spark.lapply {SparkR}R Documentation

Run a function over a list of elements, distributing the computations with Spark

Description

Run a function over a list of elements, distributing the computations with Spark. Applies a function in a manner that is similar to doParallel or lapply to elements of a list. The computations are distributed using Spark. It is conceptually the same as the following code: lapply(list, func)

Usage

spark.lapply(list, func)

Arguments

list

the list of elements

func

a function that takes one argument.

Details

Known limitations:

Value

a list of results (the exact type being determined by the function)

Note

spark.lapply since 2.0.0

Examples

## Not run: 
##D sparkR.session()
##D doubled <- spark.lapply(1:10, function(x) {2 * x})
## End(Not run)

[Package SparkR version 3.2.1 Index]