pyspark.streaming.DStream.join¶
-
DStream.join(other: pyspark.streaming.dstream.DStream[Tuple[K, U]], numPartitions: Optional[int] = None) → pyspark.streaming.dstream.DStream[Tuple[K, Tuple[V, U]]][source]¶ Return a new DStream by applying ‘join’ between RDDs of this DStream and other DStream.
Hash partitioning is used to generate the RDDs with numPartitions partitions.