sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sowmya Ramesh <sram...@hortonworks.com>
Subject Re: Review Request 51854: Sqoop should not allow --as-parquetfile when job type is hcatalog
Date Wed, 14 Sep 2016 23:35:16 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated Sept. 14, 2016, 11:35 p.m.)

Review request for Sqoop and Venkat Ranganathan.


Added the fix to throw validation exception for create-hive and as-parquet options

Bugs: SQOOP-3010

Repository: sqoop-trunk


sqoop import ... --create-hcatalog-table --hcatalog-table --as-parquetfile

Error: java.lang.RuntimeException: Should never be used
       	at org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat.getRecordWriter(MapredParquetOutputFormat.java:76)
       	at org.apache.hive.hcatalog.mapreduce.FileOutputFormatContainer.getRecordWriter(FileOutputFormatContainer.java:103)
This should not run and should display a validation error as it does for both --as-sequencefile
and --as-avrodatafile but the job runs and fails later with RuntimeException

Diffs (updated)

  src/java/org/apache/sqoop/tool/BaseSqoopTool.java fecdf43 
  src/test/com/cloudera/sqoop/hive/TestHiveImport.java b626964 
  src/test/org/apache/sqoop/hcat/TestHCatalogBasic.java 5cd4c26 

Diff: https://reviews.apache.org/r/51854/diff/


UTs added


Sowmya Ramesh

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message