spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <>
Subject Re: How to deal with context dependent computing?
Date Thu, 23 Aug 2018 10:14:54 GMT
Hi Junfeng,

Can you please show by means of an example what you are trying to achieve?

Nube Technologies <>


On Thu, Aug 23, 2018 at 8:22 AM, JF Chen <> wrote:

> For example, I have some data with timstamp marked as category A and B,
> and ordered by time. Now I want to calculate each duration from A to B. In
> normal program, I can use the  flag bit to record the preview data if it is
> A or B, and then calculate the duration. But in Spark Dataframe, how to do
> it?
> Thanks!
> Regard,
> Junfeng Chen

View raw message