sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Kumar Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3287) Import to HDFS not working in parquet not working for LDAP SQL Server
Date Fri, 16 Feb 2018 10:11:01 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366810#comment-16366810
] 

Ashish Kumar Sinha commented on SQOOP-3287:
-------------------------------------------

Thanks Szabolcs. After placing the option for --as-parquetfile has worked. I was not sure
if positioning of options makes this difference. :)

This is no longer a bug. Could you please guide me as how can I mark this as "Not a bug" or
"Resolved"

 

Thanks once again..

> Import to HDFS not working in parquet not working for LDAP SQL Server
> ---------------------------------------------------------------------
>
>                 Key: SQOOP-3287
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3287
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors/sqlserver, sqoop2-jdbc-connector
>    Affects Versions: 1.4.6
>            Reporter: Ashish Kumar Sinha
>            Priority: Minor
>              Labels: LDAP, Parquet, sqlserver
>
> I am importing data from SQL Server to HDFS. Seems there is a bug when autnetication
mode is LDAP and format is parquet. Please let me know if this is a bug or I am doing incorrectly. I
am using Cloudera distribution.
> Below different scenarios I have tested
> Command Used are.
> 1) SQL Server (Native Connection) -> HDFS Text Format *(WORKS FINE)*
> sqoop import \
> --connect "jdbc:sqlserver://<<ServerName>>;databasename=<<DB_Name>>"

> --username xxxx \
> --password xxxx \
> --table 'table1' \
> --split-by col1 \
> --target-dir /user/user1/01/
> 2) SQL Server (Native Connection) -> HDFS Parquet Format *(WORKS FINE)*
> sqoop import \
> --connect "jdbc:sqlserver://<<ServerName>>;databasename=<<DB_Name>>"

> --username xxxx \
> --password xxxx \
> --table 'table1' \
> --split-by col1 \
> --target-dir /user/user1/01/ \
> --as-parquetfile
>  
> 3) SQL Server (LDAP Connection) -> HDFS Text format (*WORKS FINE*)
> sqoop import \
> --connect "jdbc:jtds:sqlserver://<<Server2>>;useNTLMv2=true;domain=XXXX;databaseName=<<DB_name>>"
\
> --connection-manager org.apache.sqoop.manager.SQLServerManager --driver net.sourceforge.jtds.jdbc.Driver
\
> --username xxxx \
> --password xxxx \
> --table table2 \
> --target-dir /user/user1/02/ \ 
> -- --schema=s1
> 4) SQL Server (LDAP Connection) -> HDFS Parquet format (*Executes successfully,
but the exported files are not parquet, they are in TEXT format*)
> sqoop import \
> --connect "jdbc:jtds:sqlserver://<<Server2>>;useNTLMv2=true;domain=XXXX;databaseName=<<DB_name>>"
\
> --connection-manager org.apache.sqoop.manager.SQLServerManager --driver net.sourceforge.jtds.jdbc.Driver
\
> --username xxxx \
> --password xxxx \
> --table table2 \
> --target-dir /user/user1/02/ \ 
> -- --schema=s1 \
> --as-parquetfile



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message