pyspark.streaming.StreamingContext.transform

StreamingContext.transform(dstreams: List[DStream[Any]], transformFunc: Callable[[…], pyspark.rdd.RDD[T]]) → pyspark.streaming.dstream.DStream[T]

Create a new DStream in which each RDD is generated by applying a function on RDDs of the DStreams. The order of the JavaRDDs in the transform function parameter will be the same as the order of corresponding DStreams in the list.

pyspark.streaming.StreamingContext.stop pyspark.streaming.StreamingContext.union