flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Warneke (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-939) Distribute required JAR files with seperate service
Date Thu, 26 Jun 2014 21:31:26 GMT

    [ https://issues.apache.org/jira/browse/FLINK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14045222#comment-14045222

Daniel Warneke commented on FLINK-939:

I pushed the code to my private git repository for further discussion:


The new BLOB service is fully implemented, documented, and integrated. However, I still need
to write unit tests. Moreover, I have not been able to test the new service in a distributed

Comments are welcome.

> Distribute required JAR files with seperate service
> ---------------------------------------------------
>                 Key: FLINK-939
>                 URL: https://issues.apache.org/jira/browse/FLINK-939
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Ufuk Celebi
>            Assignee: Daniel Warneke
> Currently, required user JAR files are distributed via the RPC service in {{JobGraph.writeRequiredJarFiles(DataOutput,
AbstractJobVertex[])}}. The RPC service then tries to allocate a buffer on the client side
heap to write the on-disk JAR, which [can lead to problems|https://github.com/apache/incubator-flink/pull/18].
> This should be replaced with a seperate service.

This message was sent by Atlassian JIRA

View raw message