samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From xinyuiscool <...@git.apache.org>
Subject [GitHub] samza pull request #492: SAMZA-1691: Support get iterable from KeyValueStore
Date Fri, 27 Apr 2018 19:26:29 GMT
GitHub user xinyuiscool opened a pull request:

    https://github.com/apache/samza/pull/492

    SAMZA-1691: Support get iterable from KeyValueStore

    Right now for KeyValueStore we have a range query to return an iterator. For usage in
BEAM, we need a iterable which will 1) create the snapshot when called, and 2) create an iterator
when needed. Add the iterate() function in KeyValueStore to support it. It's implemented as
follows:
    
    1) for rocksDb, it will create the iterator when it's called, which will has a snapshot
of the elements. Then every time when the iterator is needed, we will seek the iterator from
beginning;
    
    2) for inMemoryDb, it will create the snapshot submap when iterate() is called. The submap
is an iterable and it can return a new iterator when needed.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/xinyuiscool/samza SAMZA-1691

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/492.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #492
    
----
commit e3dd655ad09bbd6b2dc696e73ed0c2cb6bfc2e7f
Author: xinyuiscool <xiliu@...>
Date:   2018-04-27T19:24:07Z

    SAMZA-1691: Support get iterable from KeyValueStore

----


---

Mime
View raw message