flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aljoscha <...@git.apache.org>
Subject [GitHub] flink pull request: Enhance Partitioned State and use it in Window...
Date Thu, 03 Mar 2016 09:46:45 GMT
Github user aljoscha commented on the pull request:

    It is certainly possible to find some way of doing it but it is not straightforward. So
for now I wanted to keep it simple until we figure out a good way to do it.
    @StephanEwen The window operator cannot call the rich methods since it doesn't know that
there is one in there. The rich method lifecycle has to somehow be managed by the StateBackend/State.
So then you need to figure out when to call the methods. When creating the StateBackend it's
not possible since the state is not there yet. So you maybe call it when the state is first
created. Do you call close when you clean out the state for all keys, since then the state
is technically not there anymore. Then, do you call open again when it is created again? Also,
what about the state methods on RuntimeContext. I don't think you can use ordinary RichFunctions
there. (Same probably goes for most of the other methods on RuntimeContext.)
    I think we need to find another way for these methods to have some kind of lifecycle management
but it requires some thought.

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.

View raw message