sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandish Kumar HN <sanysand...@gmail.com>
Subject Re: Review Request 61522: SQOOP-2907 : Export parquet files to RDBMS: don't require .metadata for parquet files
Date Wed, 09 Aug 2017 10:48:30 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Aug. 9, 2017, 10:48 a.m.)

Review request for Sqoop, AnnaTW AnnaTW and Anna Szonyi.

Bugs: SQOOP-2907

Repository: sqoop-trunk


Kite currently requires .metadata.
Parquet files have their own metadata stored along data files.
It would be great for Export operation on parquet files to RDBMS not to require .metadata.
We have most of the files created by Spark and Hive, and they don't create .metadata, it only
Kite that does.
It makes sqoop export of parquet files usability very limited.


  src/java/org/apache/sqoop/avro/AvroUtil.java ee29f140 
  src/java/org/apache/sqoop/mapreduce/JdbcExportJob.java 6f9afaf9 
  src/test/com/cloudera/sqoop/TestParquetExport.java 680fd73b 

Diff: https://reviews.apache.org/r/61522/diff/1/



Sandish Kumar HN

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message