sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Kumar Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-3287) Import to HDFS not working in parquet not working for LDAP SQL Server
Date Thu, 15 Feb 2018 19:24:00 GMT
Ashish Kumar Sinha created SQOOP-3287:
-----------------------------------------

             Summary: Import to HDFS not working in parquet not working for LDAP SQL Server
                 Key: SQOOP-3287
                 URL: https://issues.apache.org/jira/browse/SQOOP-3287
             Project: Sqoop
          Issue Type: Bug
          Components: connectors/sqlserver, sqoop2-jdbc-connector
    Affects Versions: 1.4.6
            Reporter: Ashish Kumar Sinha


I am importing data from SQL Server to HDFS. Seems there is a bug when autnetication mode
is LDAP and format is parquet. Please let me know if this is a bug or I am doing incorrectly. I
am using Cloudera distribution.

Below different scenarios I have tested

Command Used are.

1) SQL Server (Native Connection) -> HDFS Text Format *(WORKS FINE)*

sqoop import \
--connect "jdbc:sqlserver://<<ServerName>>;databasename=<<DB_Name>>"

--username xxxx \
--password xxxx \
--table 'table1' \
--split-by col1 \
--target-dir /user/user1/01/


2) SQL Server (Native Connection) -> HDFS Parquet Format *(WORKS FINE)*

sqoop import \
--connect "jdbc:sqlserver://<<ServerName>>;databasename=<<DB_Name>>"

--username xxxx \
--password xxxx \
--table 'table1' \
--split-by col1 \
--target-dir /user/user1/01/ \
--as-parquetfile

 

3) SQL Server (LDAP Connection) -> HDFS Text format (*WORKS FINE*)

sqoop import \
--connect "jdbc:jtds:sqlserver://<<Server2>>;useNTLMv2=true;domain=XXXX;databaseName=<<DB_name>>"
\
--connection-manager org.apache.sqoop.manager.SQLServerManager --driver net.sourceforge.jtds.jdbc.Driver
\
--username xxxx \
--password xxxx \
--table table2 \
--target-dir /user/user1/02/ \ 
-- --schema=s1

4) SQL Server (LDAP Connection) -> HDFS Parquet format (*Executes successfully, but the
exported files are not parquet, they are in TEXT format*)

sqoop import \
--connect "jdbc:jtds:sqlserver://<<Server2>>;useNTLMv2=true;domain=XXXX;databaseName=<<DB_name>>"
\
--connection-manager org.apache.sqoop.manager.SQLServerManager --driver net.sourceforge.jtds.jdbc.Driver
\
--username xxxx \
--password xxxx \
--table table2 \
--target-dir /user/user1/02/ \ 
-- --schema=s1 \
--as-parquetfile



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message