sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hui Cao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-3011) sqoop import to HIVE external table based on file system other than HDFS
Date Tue, 13 Sep 2016 09:04:20 GMT
Hui Cao created SQOOP-3011:
------------------------------

             Summary: sqoop import to HIVE external table based on file system other than
HDFS
                 Key: SQOOP-3011
                 URL: https://issues.apache.org/jira/browse/SQOOP-3011
             Project: Sqoop
          Issue Type: Bug
    Affects Versions: 1.4.6
            Reporter: Hui Cao


1, Create external Hive table using swift URI in Hive shell
	CREATE TABLE foo(id INT, msg STRING, INT) ROW FORMAT
	DELIMITED FIELDS TERMINATED BY ','
	LINES TERMINATED BY '\n' 
	STORED AS TEXTFILE
	LOCATION ’swift://swift.location/’;
  This table is created on an external file system instead of hdfs, in this case, I’m using
swift Object Store

2, Use sqoop to insert data to this table, 
$SQOOP_PATH/sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db://<dbhostname>:<port>/<db>
--username <username> --password <password> --table FOO --hive-import --hive-home
hive

the process shows following error:
FAILED: SemanticException [Error 10028]: Line 2:17 Path is not legal ''hdfs://<hostname>:8020/user/hdfs/FOO'':
Move from: hdfs://<hostname>:8020/user/hdfs/FOO to: swift://swift.location/ is not valid.
Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do
not conflict.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message