metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JonZeolla <...@git.apache.org>
Subject [GitHub] incubator-metron issue #453: METRON-694: Index Errors from Topologies
Date Thu, 02 Mar 2017 16:16:34 GMT
Github user JonZeolla commented on the issue:

    https://github.com/apache/incubator-metron/pull/453
  
    I agree, I [recommended the same thing](https://lists.apache.org/thread.html/2a673bc97d975bc7e8e160228742c07a8cf45e43c1b1efb3fea83579@%3Cdev.metron.apache.org%3E)
on the dev list and in IRC in the past.  In the case where the TTL expires, we should do *something*.
 Maybe we attempt to place a standard, simple message to be indexed which has a very high
likelihood of successfully being stored and that is exempt from any sort of retries or TTLs.
    
    That said, there are no other specific looping scenarios that I'm currently able to envision,
which is why I wasn't pushing that concept further for this PR.  Given the one that we are
aware of, if we only took the TTL route, it would just loop and then fail the entire message,
where adding `"ignore_above": 8191` would never loop and only removes the bare minimum from
the message in order to get it to properly index, for the given known problem scenario.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message