spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: How to deal with context dependent computing?
Date Thu, 23 Aug 2018 10:14:54 GMT
Hi Junfeng,

Can you please show by means of an example what you are trying to achieve?

Thanks,
Sonal
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>



On Thu, Aug 23, 2018 at 8:22 AM, JF Chen <darouwan@gmail.com> wrote:

> For example, I have some data with timstamp marked as category A and B,
> and ordered by time. Now I want to calculate each duration from A to B. In
> normal program, I can use the  flag bit to record the preview data if it is
> A or B, and then calculate the duration. But in Spark Dataframe, how to do
> it?
>
> Thanks!
>
> Regard,
> Junfeng Chen
>

Mime
View raw message