flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ji Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9542) ExEnv#registerCachedFile should accept Path
Date Thu, 11 Apr 2019 12:04:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815362#comment-16815362

Ji Liu commented on FLINK-9542:

[~Zentol] Is this issue still open? I quickly looked into the code and it seems that _DistributedCacheEntries_
still keeps String as file-path. I would like to provide a fix.

> ExEnv#registerCachedFile should accept Path
> -------------------------------------------
>                 Key: FLINK-9542
>                 URL: https://issues.apache.org/jira/browse/FLINK-9542
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / DataSet, API / DataStream
>            Reporter: Chesnay Schepler
>            Priority: Major
> Currently, {{registerCachedFile}} accepts {{Strings}} as file-paths.
> This is undesirable because invalid paths are detected much later than necessary; at
the moment this happens when we attempt to upload them to the blob store, i.e. during job
submission, when ideally it should fail right away.
> As an intermediate solution we can modify the {{DistributedCacheEntries}} to contain
{{Paths}} instead of {{Strings}}. This will not require API changes but still allow earlier

This message was sent by Atlassian JIRA

View raw message