spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrés Ivaldi <iaiva...@gmail.com>
Subject Re: Fill Gaps between rows
Date Tue, 26 Apr 2016 17:03:15 GMT
Thanks Sebastian, I've never understood that part of Hive Context, so It's
possible to use HiveContext then use the window functions and save
dataFrame into another source like MSSQL, Oracle, or any with JDBC ?

Regards.

On Tue, Apr 26, 2016 at 1:22 PM, Sebastian Piu <sebastian.piu@gmail.com>
wrote:

> Yes you need hive Context for the window functions, but you don't need
> hive for it to work
>
> On Tue, 26 Apr 2016, 14:15 Andrés Ivaldi, <iaivaldi@gmail.com> wrote:
>
>> Hello, do exists an Out Of the box for fill in gaps between rows with a
>> given  condition?
>> As example: I have a source table with data and a column with the day
>> number, but the record only register a event and no necessary all days have
>> events, so the table no necessary has all days. But I want a resultant
>> Table with all days, filled in the data with 0 o same as row before.
>>
>> I'm using SQLContext. I think window function will do that, but I cant
>> use it without hive context, Is that right?
>>
>> regards
>>
>>
>> --
>> Ing. Ivaldi Andres
>>
>


-- 
Ing. Ivaldi Andres

Mime
View raw message