drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jinfeng Ni <...@apache.org>
Subject Re: Parquet Date Format Problem
Date Tue, 01 Nov 2016 20:07:12 GMT
Subtracting 4881176 seems to be the right approach to correct date
fields generated using Drill prior to the fix in DRILL-4203, according
to code [1]. However, such parquet files would produce wrong query
result, if you query the files using Drill 1.8.0 or earlier release.

I would recommend you re-create your parquet files using Drill 1.9.0
SNAPSHOT which contains DRILL-4203 fix.


[1] https://github.com/apache/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetReaderUtility.java#L58-L63

On Tue, Nov 1, 2016 at 12:50 PM, Ted Dunning <ted.dunning@gmail.com> wrote:
>
> Nice.
>
> Perverse.
>
> Not a bad motive for using a view.
>
> Sent from my iPhone
>
>> On Nov 1, 2016, at 19:00, "Lee, David" <David.Lee@blackrock.com> wrote:
>>
>> Found a work around by subtracting 4881176 days when generating parquet files and
verified the correct dates in Spark..

Mime
View raw message