spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anton Kirillov <akirillov.mail...@gmail.com>
Subject Re: Spark 2.4.0 tests fail with hadoop-3.1 profile: NoClassDefFoundError org.apache.hadoop.hive.conf.HiveConf
Date Fri, 05 Apr 2019 18:13:44 GMT
Marcelo, Sean, thanks for the clarification. So in order to support Hadoop
3+ the preferred way would be to use Hadoop-free builds and provide Hadoop
dependencies in the classpath, is that correct?

On Fri, Apr 5, 2019 at 10:57 AM Marcelo Vanzin <vanzin@cloudera.com> wrote:

> The hadoop-3 profile doesn't really work yet, not even on master.
> That's being worked on still.
>
> On Fri, Apr 5, 2019 at 10:53 AM akirillov <akirillov.mailbox@gmail.com>
> wrote:
> >
> > Hi there! I'm trying to run Spark unit tests with the following profiles:
> >
> > And 'core' module fails with the following test failing with
> > NoClassDefFoundError:
> >
> > In the meantime building a distribution works fine when running:
> >
> > Also, there are no problems with running tests using Hadoop 2.7 profile.
> > Does this issue look familiar? Any help appreciated!
> >
> >
> >
> > --
> > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
> >
> > ---------------------------------------------------------------------
> > To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
> >
>
>
> --
> Marcelo
>

Mime
View raw message