drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kunal Khatua <kkha...@mapr.com>
Subject RE: Querying Parquet files in 2.0 format
Date Thu, 21 Sep 2017 17:44:14 GMT
Drill currently is supporting Parquet 1.8.1

AFAIK a lot of major projects are still on Parquet 1.x versions.

Is there something specific in 2.0 that you need? Else, Parquet 1.8.1 should suffice. You
needn’t downgrade all the way down to 1.0

From: Oscar Torreño [mailto:otorreno@itrsgroup.com]
Sent: Thursday, September 21, 2017 12:26 AM
To: user@drill.apache.org
Subject: Querying Parquet files in 2.0 format

Hi everyone,

I am trying to query Parquet files written in the 2.0 format but I am getting the following
org.apache.drill.common.exceptions.UserRemoteException: DATA_READ ERROR: Exception occurred
while reading from disk. File: /performance/ParquetFooData2.parquet Column: constantString
Row Group Start: 15780070 File: /performance/ParquetFooData2.parquet Column: constantString
Row Group Start: 15780070 Fragment 0:0 [Error Id: f41d39a1-6983-47f4-9834-3068017a28bd on

However, if I just change the code which is generating the Parquet file to write it in 1.0
format it works like a charm. Does Drill understands Parquet files in 2.0 version? Or am I
doing something wrong?

Best regards,


Oscar Torreno
Software Engineer

ITRS (Spain) S.L.
Parque Tecnológico de Andalucia,
Calle Severo Ochoa 21,
Edificio Norte Planta Baja,
29590 Campanillas,
Málaga - Spain

t:+34 951 255 080 | f:+34 951 255 081 | e:otorreno@itrsgroup.com<mailto:otorreno@itrsgroup.com>
| w:http://www.itrsgroup.com<http://www.itrsgroup.com/> |

Internet communications are not secure and therefore the ITRS Group does not accept legal
responsibility for the contents of this message. Any view or opinions presented are solely
of the author and do not necessarily represent those of the ITRS Group unless otherwise
specifically stated.


The information contained in this communication from the sender is confidential. It is intended
solely for use by the recipient and others authorized to receive it. If you are not the recipient,
you are hereby notified that any disclosure, copying, distribution or taking action in relation
of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived
by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer
and more useful place for your human generated data. Specializing in; Security, archiving
and compliance. To find out more Click Here<http://www.mimecast.com/products/>.
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message