nifi-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Milan Das <m...@interset.com>
Subject Re: published by PublishKafkaRecord_0_10 doesn't embed schema.
Date Mon, 26 Mar 2018 15:28:58 GMT
Hi Bryan,
We are using NIFI 1.4.0. Can we backport this fix to NIFI 1.4?

Thanks,
Milan Das

On 3/26/18, 11:26 AM, "Bryan Bende" <bbende@gmail.com> wrote:

    Hello,
    
    What version of NiFi are you using?
    
    This should be fixed in 1.5.0:
    
    https://issues.apache.org/jira/browse/NIFI-4639
    
    Thanks,
    
    Bryan
    
    
    On Sun, Mar 25, 2018 at 6:45 PM, Milan Das <mdas@interset.com> wrote:
    > Hello Nifi Users,
    >
    > Apparently, it seems like PublishKafkaRecord_0_10 doesn't embed schema even if it
Avro Record writer is configured with “Embed Avro Schema”.
    >
    > I have seen the following post from Bryan Brende.  Wondering if it is a known issue
or if I am missing anything here.
    >
    >
    >
    > https://community.hortonworks.com/questions/110652/cant-consume-avro-messages-whcih-are-published-by.html
    >
    >
    >
    >
    >
    > This is how message looks in Kafka-console-consumer, when published using “PublishKafkaRecord_0_11”
    >
    >
    >
    >
    >
    >  $ bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
    >
    >
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$�zpA
    >
    >                                                                                 �=h*�p��l
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$+�=�ت��;�.Y7
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$�D�p��"B��
  r0
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$ekLl�;]�,Y�͙�
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$�z��klŤ�1�'�z�
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$���ξu��5�V}>�_
    >
    > �SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$��=%��V����bK�
    >
    > ��'~���X�controller1.ad.interset.com�H22018-03-15T09:07:04-04:00CONTROLLER1$��0
    >
    >
    >
    >
    >
    > When I publish the message using my java class output from console consumer prints
the avro schema.
    >
    >
    >
    > Objavro.schema�P{"type":"record","name":"ActiveDirectoryRecord","namespace":"com.xxxx.schema","doc":"for
more info, refer to http://docs.splunk.com/Documentation/CIM/4.2.0/User/Resource","fields":[{"name":"action","type":"string","doc":"The
action performed on the resource."},{"name":"dest","type":"string","doc":"The target involved
in the authentication. May be aliased from more specific fields, such as dest_host, dest_ip,
or dest_nt_host."},{"name":"signature_id","type":"int","doc":"Description of the change performed
(integer)"},{"name":"time","type":"string","doc":"ISO 8601 timestamp of the eventl <…………TRUNCATED……………..
 >,{"name":"privileges","type":["null",{"type":"array","items":"string"}],"doc":"The list
of privileges associated with a Privilege Escalation event","default":null},{"name":"subcode","type":["null","string"],"doc":"The
error subcode for auth;��d��g%�z�SUCCESS6controller1.ad.interset.com�H22018-03-15T09:07:04-04:00usedid1Pz��
    >
    >
    >
    >
    >
    > Regards,
    >
    > Milan Das
    >
    >
    



Mime
View raw message