spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ram Sriharsha <sriharsha....@gmail.com>
Subject Re: Examples of flatMap in dataFrame
Date Mon, 08 Jun 2015 06:31:58 GMT
Hi

You are looking for the explode method (in Dataframe API starting 1.3 I
believe)
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala#L1002

Ram

On Sun, Jun 7, 2015 at 9:22 PM, Dimp Bhat <dimp2011us@gmail.com> wrote:

> Hi,
> I'm trying to write a custom transformer in Spark ML and since that uses
> DataFrames, am trying to use flatMap function in DataFrame class in Java.
> Can you share a simple example of how to use the flatMap function to do
> word count on single column of the DataFrame. Thanks
>
>
> Dimple
>

Mime
View raw message