flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tillrohrmann <...@git.apache.org>
Subject [GitHub] incubator-flink pull request: Integraion of Daniel's BLOB manager
Date Thu, 25 Sep 2014 17:19:53 GMT
GitHub user tillrohrmann opened a pull request:


    Integraion of Daniel's BLOB manager

    I rebased the pull request #107 of @warneke. Thanks for your work Daniel, the code looks
really good. Since the master evolved a little bit from the version of the pull request, I'd
like to have another pair of eyes looking over it. I tried to address the problem of old jar
files which are no longer used by introducing a clean up task which regularly looks for those
files. Due to this I had to extend the book keeping of the LibraryCacheManager a little bit.
    I tested WordCount and Kmeans on the cluster with this version.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tillrohrmann/incubator-flink blob_manager

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #126
commit 68474d2ac589c81332d79fb03fc0c258a4b3d20c
Author: Daniel Warneke <warneke@apache.org>
Date:   2014-09-24T13:00:58Z

    Integration of new BLOB service.

commit 80c023ac84cb91e6d53147c530b19736b1045e6c
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2014-09-24T15:47:26Z

    Looped through the user code class loader from the envrionment to the tasks.

commit defd8b9d394a77c5b49f6f0f2ccdcbe8fe5f9778
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2014-09-25T16:41:37Z

    Added timed cleanup task to LibraryCacheManager to remove automatically unreferenced jar
files. Moved registration logic out of the IOReadableWritable serialization logic. Updated


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.

View raw message