metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Lyle <dlyle65...@gmail.com>
Subject Re: [VOTE] Release of Metron_0.1BETA_rc5
Date Wed, 23 Mar 2016 12:48:32 GMT
+1 (non-binding) to release.

Ran both singlenode vagrant and ec2.

I did notice the following:

pycapa needs to be restarted after initial startup- it seems to be timing
out on initial startup. On restart it stays up.

Here's the stack trace:

WARNING: No route found for IPv6 destination :: (no default route?)

No handlers could be found for logger "kafka"

Traceback (most recent call last):

  File "/usr/local/pycapa/pycapa/pycapa_cli.py", line 96, in <module>

    main()

  File "/usr/local/pycapa/pycapa/pycapa_cli.py", line 93, in main

    sniff(iface=args.interface, store=0, prn=produce_callback)

  File "/usr/lib/python2.6/site-packages/scapy/sendrecv.py", line 595, in
sniff

    r = prn(p)

  File "/usr/local/pycapa/pycapa/pycapa_cli.py", line 51, in
produce_callback

    res = producer.send(topic, packet_count, msg)

  File "/usr/lib/python2.6/site-packages/kafka/producer.py", line 311, in
send

    return self.send_messages(topic, partition, msg)

  File "/usr/lib/python2.6/site-packages/kafka/producer.py", line 188, in
send_messages

    timeout=self.ack_timeout)

  File "/usr/lib/python2.6/site-packages/kafka/client.py", line 312, in
send_produce_request

    resps = self._send_broker_aware_request(payloads, encoder, decoder)

  File "/usr/lib/python2.6/site-packages/kafka/client.py", line 179, in
_send_broker_aware_request

    raise FailedPayloadsError(failed_payloads)

kafka.common.FailedPayloadsError: [ProduceRequest(topic='pcap',
partition=0, messages=[Message(magic=0, attributes=0, key=None,
value='\xd4\xc3\xb2\xa1\x02\x00\x04\x00\x00\x00\x00\x00\x00\x00\x00\x00\xff\xff\x00\x00\x01\x00\x00\x00\xb4x\xf2V\x97$\x07\x00\x89\x00\x00\x00\x89\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00E\x00\x00{\x08\xc2\x00\x00\x80\x11\x9b\xbe\xc0\xa8\x8a\x9e\xc0\xa8\x8a\x02\xea\xae\x005\x00g\xf8\tG\xae\x01\x00\x00\x01\x00\x00\x00\x00\x00\x00\x06va872g\x06g90e1h\x02b8\x07642b63u\x06j985a2\x04v33e\x0237\x07pa269cc\x0ce8mfzdgrf7g0\rgroupprograms\x02in\x00\x00\x01\x00\x01')])]



On Tue, Mar 22, 2016 at 6:56 PM, James Sirota <jsirota@hortonworks.com>
wrote:

>
> A tag has been created for Metron_0.1BETA_RC5
>
> Github:
> https://github.com/apache/incubator-metron/releases/tag/Metron_0.1BETA_rc5
> Apache:
> https://git-wip-us.apache.org/repos/asf?p=incubator-metron.git;a=shortlog;h=refs/tags/Metron_0.1BETA_rc5
>
> With a Git hash:
> 443ad7baa2ce5c3127a9691c7d45b7a4a92e257b
>
> The code is staged at
> http://home.apache.org/~jsirota/metron/Metron_0.1BETA_RC/RC_5/
>
> The following are instructions for verifying the build.
>
> Step 1 – Build Metron
>
> cd incubator-metron/metron-streaming/
> mvn apache-rat:check && cd metron-streaming && mvn clean integration-test
> && cd ..
>
> Verify that all tests are passing
>
> Step 2 – Deploy metron as a single VM via vagrant and ansible
>
> cd deployment/vagrant/singlenode-vagrant
> vagrant plugin install vagrant-hostmanager
> vagrant up
>
> For a more complete set of instructions refer to:
> https://github.com/apache/incubator-metron/tree/master/deployment
>
> Verify metron is working:
> - Check Ambari to make sure all the services are up by going to ambari in
> a browser at http://node1:8080
> - Check Storm to make sure all the topologies are up
>       From Ambari navigate to Storm -> Quick Links -> Storm UI
> - Check that the enrichment topology has emitted some data (could take a
> few minutes to show up in the Storm UI)
> - Check indexes to make sure indexing is done correctly and data is
> visualized in Kibana in a browser at http://node1:5000
> - Check that some data is written into HDFS for at least one of the data
> sources
>       Look in HDFS under
> /apps/metron/enrichment/indexed/yaf_doc|bro_doc|snort_doc
>       This can be done from the browser by going to
> http://node:50070/explorer.html#/apps/metron/enrichment/indexed
>
> Step 3 (optional) – Verify AWS Multi-Node Deploy with Ansible
> cd deployment/amazon-ec2
> ansible-playbook -i ec2.py playbook.yml
>
> For a more complete set of instructions refer to:
> https://github.com/apache/incubator-metron/tree/master/deployment
>
> To verify the working build go through the same verifications as in Step2,
> but on AWS.  Reference playbook.yml for location of the services.
> Ambari-master contains Ambari, web contains Kibana and sensors.
>
> Please vote +1 if you approve and –1 if you do not approve.  Also, please
> indicate if your
> vote is binding
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message