nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Chaffelson <chaffel...@gmail.com>
Subject Re: Hive backward compatibily
Date Tue, 06 Mar 2018 09:07:46 GMT
Hi Milan,
Apologies for a link as an answer, but I'm currently traveling and
responding from mobile.

I worked through a similar problem in NiFi-1.1 and shared details of my
method which hopefully should help you.

https://stackoverflow.com/questions/39200903/apache-nifi-hive-processors-with-hive-1-1-cdh-5-7-1

Cheers,
Dan.

On Mon, 5 Mar 2018, 18:21 Matt Burgess, <mattyb149@apache.org> wrote:

> Milan,
>
> Unfortunately no, without code changes the Hive processors are not
> compatible with Hive 1.1.x.  There were API changes both to the Java code
> and the Thrift code (the latter adds the client_protocol field you
> mentioned), so you can't change the version of the Hive dependencies and
> get the NAR to compile. You'd have to make the code changes yourself and
> build with the appropriate version of Hive. There are some vendor-specific
> profiles (hortonworks, cloudera, mapr) that you can use when specifying
> vendor-specific Hive versions.
>
> Regards,
> Matt
>
>
> On Mon, Mar 5, 2018 at 12:29 PM, Milan Das <mdas@interset.com> wrote:
>
> > Hello NIFI Dev,
> >
> > I am trying to use SelectHiveQL with Hive version hive-1.1.0 (it is part
> > of the Cloudera 5.13.1)
> >
> > https://www.cloudera.com/documentation/enterprise/
> > release-notes/topics/cdh_vd_cdh_package_tarball_513.html#tarball_5131
> >
> >
> >
> > Seems like because SelectHiveQL uses hive-1.2.1 client library I am
> > getting following error. My NIFI version is 1.4.0
> >
> >
> >
> > Caused by: java.sql.SQLException: Could not establish connection to
> > jdbc:hive2://ip-NNN-NN-N-NNN.ec2.internal:10000/default;
> > principal=hive/_HOST@.INTERSET.COM: Required field 'client_protocol' is
> > unset! Struct:TOpenSessionReq(client_protocol:null,
> > configuration:{use:database=default})
> >
> >                 at org.apache.hive.jdbc.HiveConnection.openSession(
> > HiveConnection.java:594)
> >
> >                 at org.apache.hive.jdbc.HiveConnection.<init>(
> > HiveConnection.java:192)
> >
> >
> >
> > hive.version-> pom.xml
> >
> > https://github.com/apache/nifi/blob/rel/nifi-1.4.0/pom.xml#L105
> >
> >
> >
> >
> >
> >
> >
> > Wondering if there is a way for backward compatibility.
> >
> >
> >
> > Regards,
> >
> >
> >
> > [image: graph]
> >
> > *Milan Das*
> > Sr. System Architect
> >
> > email: mdas@interset.com
> > mobile: +1 678 216 5660
> >
> > [image: dIn icon] <https://www.linkedin.com/in/milandas/>
> >
> > www.interset.com
> >
> >
> >
> >
> >
> >
> >
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message