sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ankit Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-3150) issue with sqoop hive import with partitions
Date Fri, 10 Mar 2017 11:31:04 GMT
Ankit Kumar created SQOOP-3150:
----------------------------------

             Summary: issue with sqoop hive import with partitions
                 Key: SQOOP-3150
                 URL: https://issues.apache.org/jira/browse/SQOOP-3150
             Project: Sqoop
          Issue Type: Bug
          Components: hive-integration
    Affects Versions: 1.4.6
         Environment: Cent-Os
            Reporter: Ankit Kumar


Sqoop Command:

	sqoop import \
	...
  --hive-import  \
  --hive-overwrite  \
  --hive-table employees_p  \
  --hive-partition-key date  \
  --hive-partition-value 10-03-2017  \
  --target-dir ..\
  -m 1  
  
  hive-table script:
  employees_p is a partitioned table on date(string) column
  
  Issue:- 
  Case1: When  --target-dir /user/hdfs/landing/staging/Hive/partitioned/EMPLOYEES \
  while running above sqoop command, gets an error "directory already exissts".
  
  When : --target-dir /user/hdfs/landing/staging/Hive/partitioned/EMPLOYEES/anyname 
  2. Above sqoop command creates a hive partition (date=10-03-2017) and directory as
	'/user/hdfs/landing/staging/Hive/partitioned/EMPLOYEES/date=10-03-2017'
	
Expected Behaviour:- As in sqoop command  --hive-partition-key and  --hive-partition-value
is present, so it should auto create partioned directory inside EMPLOYEES.
ie. '/user/hdfs/landing/staging/Hive/partitioned/EMPLOYEES/date=10-03-2017'



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message