drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Raj <rahul....@option3.io>
Subject Creating/reading empty Parquet files
Date Thu, 04 Jul 2019 06:54:39 GMT
We have a use case involving a union across multiple parquet files. One of
the source parquet files used in union was generated using an empty CTAS
(query didn't select any record) and resulted in creating no output files.
The union query failed in this case because of the absence of the source
parquet.

Is there any way to generate an empty parquet on an empty CTAS?
There is already a reported issue -
https://issues.apache.org/jira/browse/DRILL-6885

Drill also fails to read empty parquet files generated using Apache Spark.
Drill 16 fails to read Meta information from an empty parquet. Drill 1.15
can read the meta and succeeds in reading a directory with some empty files.

Regards,
Rahul

-- 
_*** This email and any files transmitted with it are confidential and 
intended solely for the use of the individual or entity to whom it is 
addressed. If you are not the named addressee then you should not 
disseminate, distribute or copy this e-mail. Please notify the sender 
immediately and delete this e-mail from your system.***_

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message