sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shashank Tandon" <stan...@expedia.com>
Subject Re: Review Request 39260: Review for issue SQOOP-2332: Support dynamic partitions while sqoop import. Also support partition key formats for date partitions
Date Wed, 04 Nov 2015 07:04:39 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Nov. 4, 2015, 7:04 a.m.)

Review request for Sqoop and Venkat Ranganathan.

Repository: sqoop-trunk


New Review request for support of Dynamic partitons while importing data. This is in addition
to the old review  https://reviews.apache.org/r/38400/ already exists, but in the review board
submitter cannot be changed so adding another review request to add a new patch for the code
review changes.
Functioanlity : Dynamic partition already exists in Sqoop in case of Hive partitioned table
already exists.The new changes will allow to support dynamic partition if Hive partitioned
table does not exists.
This has the list of column to be added as partitioning keys to the created table along with
the static partitioning keys and values provided.  For dynamic partitions keys, the data type
of the partition key will be forced to be string irrespective of the SQL datatype
Also added support for date formats if user wants to do partitioning based on a date column.

Diffs (updated)

  src/docs/user/hcatalog.txt 99ae4f5 
  src/java/org/apache/sqoop/SqoopOptions.java db92b30 
  src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatImportHelper.java aba2458 
  src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java 9d5a9ee 
  src/java/org/apache/sqoop/tool/BaseSqoopTool.java a7f6aec 
  src/java/org/apache/sqoop/tool/ImportTool.java 39af42c 
  src/test/org/apache/sqoop/hcat/HCatalogImportTest.java 8db06d1 

Diff: https://reviews.apache.org/r/39260/diff/




Shashank Tandon

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message