nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Milan Das <m...@interset.com>
Subject Re: Hive backward compatibily
Date Tue, 06 Mar 2018 10:55:49 GMT
Daniel,
This helps. I am to compile with CDH libraries. 
Thanks a lot.
~ Milan

On 3/6/18, 4:08 AM, "Daniel Chaffelson" <chaffelson@gmail.com> wrote:

    Hi Milan,
    Apologies for a link as an answer, but I'm currently traveling and
    responding from mobile.
    
    I worked through a similar problem in NiFi-1.1 and shared details of my
    method which hopefully should help you.
    
    https://stackoverflow.com/questions/39200903/apache-nifi-hive-processors-with-hive-1-1-cdh-5-7-1
    
    Cheers,
    Dan.
    
    On Mon, 5 Mar 2018, 18:21 Matt Burgess, <mattyb149@apache.org> wrote:
    
    > Milan,
    >
    > Unfortunately no, without code changes the Hive processors are not
    > compatible with Hive 1.1.x.  There were API changes both to the Java code
    > and the Thrift code (the latter adds the client_protocol field you
    > mentioned), so you can't change the version of the Hive dependencies and
    > get the NAR to compile. You'd have to make the code changes yourself and
    > build with the appropriate version of Hive. There are some vendor-specific
    > profiles (hortonworks, cloudera, mapr) that you can use when specifying
    > vendor-specific Hive versions.
    >
    > Regards,
    > Matt
    >
    >
    > On Mon, Mar 5, 2018 at 12:29 PM, Milan Das <mdas@interset.com> wrote:
    >
    > > Hello NIFI Dev,
    > >
    > > I am trying to use SelectHiveQL with Hive version hive-1.1.0 (it is part
    > > of the Cloudera 5.13.1)
    > >
    > > https://www.cloudera.com/documentation/enterprise/
    > > release-notes/topics/cdh_vd_cdh_package_tarball_513.html#tarball_5131
    > >
    > >
    > >
    > > Seems like because SelectHiveQL uses hive-1.2.1 client library I am
    > > getting following error. My NIFI version is 1.4.0
    > >
    > >
    > >
    > > Caused by: java.sql.SQLException: Could not establish connection to
    > > jdbc:hive2://ip-NNN-NN-N-NNN.ec2.internal:10000/default;
    > > principal=hive/_HOST@.INTERSET.COM: Required field 'client_protocol' is
    > > unset! Struct:TOpenSessionReq(client_protocol:null,
    > > configuration:{use:database=default})
    > >
    > >                 at org.apache.hive.jdbc.HiveConnection.openSession(
    > > HiveConnection.java:594)
    > >
    > >                 at org.apache.hive.jdbc.HiveConnection.<init>(
    > > HiveConnection.java:192)
    > >
    > >
    > >
    > > hive.version-> pom.xml
    > >
    > > https://github.com/apache/nifi/blob/rel/nifi-1.4.0/pom.xml#L105
    > >
    > >
    > >
    > >
    > >
    > >
    > >
    > > Wondering if there is a way for backward compatibility.
    > >
    > >
    > >
    > > Regards,
    > >
    > >
    > >
    > > [image: graph]
    > >
    > > *Milan Das*
    > > Sr. System Architect
    > >
    > > email: mdas@interset.com
    > > mobile: +1 678 216 5660
    > >
    > > [image: dIn icon] <https://www.linkedin.com/in/milandas/>
    > >
    > > www.interset.com
    > >
    > >
    > >
    > >
    > >
    > >
    > >
    > >
    > >
    >
    



Mime
View raw message