sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Silva João <joao.si...@altran.com>
Subject Re: kite-data-mapreduce missing?
Date Tue, 05 Apr 2016 16:25:16 GMT
I just realized that a file 
/usr/hdp/ exists. I 
copied it to HDFS and added it to the workflow.xml, e.g.:


I see it being used in the logs, but it does not change the result.

João M. S. Silva

On 05/04/2016 16:47, Silva João wrote:
> Hi,
> I'm running an oozie coordinator to periodically run an oozie workflow
> which runs an *incremental* sqoop import from Postgres to Parquet files.
> The coordinator was running OK, when no new data was added to the
> origin. But after I inserted a new line in the Postgres DB, oozie/sqoop
> failed with the following error:
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception,
> org/kitesdk/data/mapreduce/DatasetKeyOutputFormat
> java.lang.NoClassDefFoundError:
> org/kitesdk/data/mapreduce/DatasetKeyOutputFormat
> at
> org.apache.sqoop.mapreduce.DataDrivenImportJob.getOutputFormatClass(DataDrivenImportJob.java:190)
> I've read that the jar for kite-data-mapreduce is missing? Is this
> correct? How do I install such a package?
> Thanks.

View raw message