metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From nickwallen <...@git.apache.org>
Subject [GitHub] incubator-metron pull request #252: METRON-419 Update Tuple to HBase Mapper/...
Date Wed, 14 Sep 2016 20:11:16 GMT
GitHub user nickwallen opened a pull request:

    https://github.com/apache/incubator-metron/pull/252

    METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL

    For METRON-417, the goal is to use HBase's TTL mechanism to expire or age-out Profile
data. This PR is another step toward that goal.
    
    This PR alters the mechanism that maps tuples to HBase so that a TTL can be specified
in a generic way. Each tuple is capable of being written to HBase with its own unique TTL
value.
    
    The dependency on the storm-hbase project, which is part of Apache Storm, has been removed.
 The storm-hbase code could not be enhanced to support a TTL without changing the underlying
implementation.  The HBaseMapper interface was altered so that implementation can specify
the TTL value for each tuple.
    
    Unit tests have been added to test writes with and without a TTL to HBase.
    
    Depends on the following existing PRs...
    - [ ] #246 
    - [ ] #251 


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/nickwallen/incubator-metron METRON-419

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-metron/pull/252.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #252
    
----
commit c2ffd4a94ed59da718ebc17d5d093bb2085e508e
Author: Nick Allen <nick@nickallen.org>
Date:   2016-09-10T02:10:03Z

    METRON-411 Support Greater Range of Profile Periods

commit a8e2da3b762bf3df99ab0ff27973ccc10c4a575d
Author: Nick Allen <nick@nickallen.org>
Date:   2016-09-14T18:04:23Z

    METRON-418 Set TTL on HBase Puts

commit 18d343dee87fc9497499acf38f9c774709cc4aaa
Author: Nick Allen <nick@nickallen.org>
Date:   2016-09-14T19:02:36Z

    METRON-419 Removed dependency on storm-hbase as this code will need to change to support
TTL.

commit 79859d8662de026a2ca1681ccefa3a64fe276d39
Author: Nick Allen <nick@nickallen.org>
Date:   2016-09-14T20:00:22Z

    METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message