beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2718) Add bundle retry logic to the DirectRunner
Date Thu, 07 Sep 2017 04:22:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156431#comment-16156431
] 

ASF GitHub Bot commented on BEAM-2718:
--------------------------------------

GitHub user mariapython opened a pull request:

    https://github.com/apache/beam/pull/3815

    [BEAM-2718] Improve performance of bundle retry

    In order to keep a consistent state while handling bundles, very time the state is accessed,
a copy is made and kept until the bundle is committed. Here a custom copy is used replicating
only the inner structures that are needed and shallow-copying the rest.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mariapython/incubator-beam retry_custom

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3815.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3815
    
----
commit eba397bbe42c05d33d09489b88dfaf55786fdd79
Author: Maria Garcia Herrero <mariagh@google.com>
Date:   2017-09-07T04:04:38Z

    Improve performance of bundle retry

----


> Add bundle retry logic to the DirectRunner
> ------------------------------------------
>
>                 Key: BEAM-2718
>                 URL: https://issues.apache.org/jira/browse/BEAM-2718
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py
>    Affects Versions: Not applicable
>            Reporter: María GH
>            Assignee: María GH
>            Priority: Minor
>             Fix For: Not applicable
>
>
> When processing of a bundle fails, the bundle should be retried 3 times (for a total
of 4 attempts to process it).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message