drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: Querying Parquet files in 2.0 format
Date Mon, 25 Sep 2017 13:11:46 GMT
Oscar,

Is parquet 2.0 required? Is there a particular feature that makes 2.0
especially attractive in spite of the inter operability difficulties it
will cause?

The answer to these questions are important for the community to prioritize
support for 2.0.

On Sep 25, 2017 2:40 AM, "Oscar Torreño" <otorreno@itrsgroup.com> wrote:

> Do you know if there are any plans to have it fixed? If yes, is there any
> planned release date for it?
>
> Thank you in advance
>
> Oscar Torreno ● Software Engineer ● ITRS (Spain) S.L.
>
>
> On 21/09/2017, 20:08, "Chun Chang" <cchang@mapr.com> wrote:
>
>     This is a known issue. Drill currently has trouble reading Parquet
> files written in 2.0 format.
>
>     ________________________________
>     From: Oscar Torreño <otorreno@itrsgroup.com>
>     Sent: Thursday, September 21, 2017 12:32:58 AM
>     To: user@drill.apache.org
>     Subject: Querying Parquet files in 2.0 format
>
>     Hi everyone,
>
>     I am trying to query Parquet files written in the 2.0 format but I am
> getting the following error:
>     org.apache.drill.common.exceptions.UserRemoteException: DATA_READ
> ERROR: Exception occurred while reading from disk. File:
> /performance/ParquetFooData2.parquet Column: constantString Row Group
> Start: 15780070 File: /performance/ParquetFooData2.parquet Column:
> constantString Row Group Start: 15780070 Fragment 0:0 [Error Id:
> f41d39a1-6983-47f4-9834-3068017a28bd on drill_1:31010]
>
>     However, if I just change the code which is generating the Parquet
> file to write it in 1.0 format it works like a charm. Does Drill
> understands Parquet files in 2.0 version? Or am I doing something wrong?
>
>     Best regards,
>     Oscar
>
>     [RS]<http://www.itrsgroup.com/>
>
>     Oscar Torreno
>     Software Engineer
>
>     ITRS (Spain) S.L.
>     Parque Tecnológico de Andalucia,
>     Calle Severo Ochoa 21,
>     Edificio Norte Planta Baja,
>     29590 Campanillas,
>     Málaga - Spain
>
>     t:+34 951 255 080 | f:+34 951 255 081 | e:otorreno@itrsgroup.com<
> mailto:otorreno@itrsgroup.com> | w:http://www.itrsgroup.com<htt
> p://www.itrsgroup.com/> |
>
>
>     Internet communications are not secure and therefore the ITRS Group
> does not accept legal
>     responsibility for the contents of this message. Any view or opinions
> presented are solely those
>     of the author and do not necessarily represent those of the ITRS Group
> unless otherwise
>     specifically stated.
>
>
>
>
>     Disclaimer
>
>     The information contained in this communication from the sender is
> confidential. It is intended solely for use by the recipient and others
> authorized to receive it. If you are not the recipient, you are hereby
> notified that any disclosure, copying, distribution or taking action in
> relation of the contents of this information is strictly prohibited and may
> be unlawful.
>
>     This email has been scanned for viruses and malware, and may have been
> automatically archived by Mimecast Ltd, an innovator in Software as a
> Service (SaaS) for business. Providing a safer and more useful place for
> your human generated data. Specializing in; Security, archiving and
> compliance. To find out more Click Here<http://www.mimecast.com/products/
> >.
>
>
> Disclaimer
>
> The information contained in this communication from the sender is
> confidential. It is intended solely for use by the recipient and others
> authorized to receive it. If you are not the recipient, you are hereby
> notified that any disclosure, copying, distribution or taking action in
> relation of the contents of this information is strictly prohibited and may
> be unlawful.
>
> This email has been scanned for viruses and malware, and may have been
> automatically archived by Mimecast Ltd, an innovator in Software as a
> Service (SaaS) for business. Providing a safer and more useful place for
> your human generated data. Specializing in; Security, archiving and
> compliance. To find out more visit the Mimecast website.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message