sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raviteja Lokineni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2271) HCatalog ORC Null Pointer Exception
Date Tue, 28 Feb 2017 15:39:45 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15888259#comment-15888259
] 

Raviteja Lokineni commented on SQOOP-2271:
------------------------------------------

I figured out what the issue is. Looking at the source code: [SqoopHCatUtilities.java|https://github.com/apache/sqoop/blob/branch-1.4.6/src/java/org/apache/sqoop/mapreduce/hcat/SqoopHCatUtilities.java],
the --hcatalog-home should point to the hcatalog utilities installation home. The sqoop command
is trying to find this:
{noformat}<hcat-util-home>/bin/hcat.py{noformat}

Although this issue is not a blocker, this should be fixed with a proper message. This wasted
a lot of time for me.

> HCatalog ORC Null Pointer Exception
> -----------------------------------
>
>                 Key: SQOOP-2271
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2271
>             Project: Sqoop
>          Issue Type: Bug
>          Components: codegen, hive-integration
>    Affects Versions: 1.4.5
>         Environment: HDP 2.2
>            Reporter: Hari Sekhon
>            Priority: Blocker
>
> Hitting a Null Pointer Exception when importing a table via HCatalog to ORC. We do a
lot of SQL Server imports, the only additions are the hcatalog / orc options:{code}sqoop import
--connect "jdbc:sqlserver://host:1533;database=myDB" --username "myUser" --password "myPassword"
--verbose -m 1 --query "select * from [blah].[dbo].[blah2]" --mapreduce-job-name "sqoop-import-myJob"
--create-hcatalog-table --hcatalog-table "mydb.mytable" --hcatalog-storage-stanza "STORED
AS ORC"
> 15/03/27 12:32:12 INFO hcat.SqoopHCatUtilities: Executing external HCatalog CLI process
with args :-f,/tmp/hcat-script-1427459532585
> 15/03/27 12:32:12 DEBUG util.ClassLoaderStack: Restoring classloader: java.net.URLClassLoader@7640f42a
> 15/03/27 12:32:12 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
> java.lang.NullPointerException
>         at java.lang.ProcessBuilder.start(ProcessBuilder.java:1010)
>         at java.lang.Runtime.exec(Runtime.java:617)
>         at java.lang.Runtime.exec(Runtime.java:528)
>         at org.apache.sqoop.util.Executor.exec(Executor.java:76)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.executeExternalHCatProgram(SqoopHCatUtilities.java:1119)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.launchHCatCli(SqoopHCatUtilities.java:1071)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.createHCatTable(SqoopHCatUtilities.java:610)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.configureHCat(SqoopHCatUtilities.java:325)
>         at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.configureImportOutputFormat(SqoopHCatUtilities.java:768)
>         at org.apache.sqoop.mapreduce.ImportJobBase.configureOutputFormat(ImportJobBase.java:98)
>         at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:249)
>         at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:721)
>         at org.apache.sqoop.manager.SQLServerManager.importQuery(SQLServerManager.java:346)
>         at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:499)
>         at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
>         at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
>         at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
> {code}
> At first I thought this was SQOOP-1533 but the stack trace is different and we're on
Oracle Java 7.
> Hari Sekhon
> http://www.linkedin.com/in/harisekhon



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message