sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mark pasterkamp <markpasterk...@hotmail.com>
Subject sqoop 1.4.7 nullpointer during import
Date Tue, 05 Mar 2019 09:54:30 GMT
Hi all,

I have been having a lot of issues getting to import data from postgres into hive.
Using things like "--bindir ./" I have sometimes been able to get around the "Class {table_name}
not found exception"
I have been able to get a few runs of the import script without exceptions which resulted
in my hive metastore throwing exceptions which forced me to recreate the metastore.

However, my latest issue is a nullpointer while trying to run the script:

java.lang.NullPointerException
at java.util.Objects.requireNonNull(Objects.java:203)
at java.util.Arrays$ArrayList.<init>(Arrays.java:3813)
at java.util.Arrays.asList(Arrays.java:3800)
at org.apache.sqoop.util.FileListing.getFileListingNoSort(FileListing.java:76)
at org.apache.sqoop.util.FileListing.getFileListingNoSort(FileListing.java:82)
at org.apache.sqoop.util.FileListing.getFileListingNoSort(FileListing.java:82)
at org.apache.sqoop.util.FileListing.getFileListingNoSort(FileListing.java:82)
at org.apache.sqoop.util.FileListing.getFileListing(FileListing.java:67)
at com.cloudera.sqoop.util.FileListing.getFileListing(FileListing.java:39)
at org.apache.sqoop.orm.CompilationManager.addClassFilesFromDir(CompilationManager.java:293)
at org.apache.sqoop.orm.CompilationManager.jar(CompilationManager.java:378)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:108)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:501)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

and the import script:
sqoop import \
--bindir ./ \
--connect {database_string} \
--username {user} \
--password {password} \
--table {table_name} \
--hive-import \
--target-dir /user/hive/warehouse/{table_name}/ \
--delete-target-dir \

Looking online I have not found a cause or solution for my latest issue with sqoop. Would
any of you perhaps know the cause and the solution?


With kind regards,

Mark


Mime
View raw message