beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Kirpichov (JIRA)" <>
Subject [jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators
Date Thu, 23 Mar 2017 22:14:42 GMT


Eugene Kirpichov commented on BEAM-1148:

One option is to let PAssert output the failures (or success) to a file in the job's temp

Another option: in case of success the pipeline should simply terminate successfully (even
if it's being run using "streaming" mode, by a runner that has a concept of modes - according
to the termination semantics); so it only remains to make sure that in case of failure the
whole pipeline fails rather than hangs. There should be an API to fail a pipeline, or to watch
failures within it. The treatment of failures, e.g. by Dataflow batch vs. streaming runners,
is inconsistent. That's probably topic for a separate JIRA.

> Port PAssert away from Aggregators
> ----------------------------------
>                 Key: BEAM-1148
>                 URL:
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-core
>            Reporter: Kenneth Knowles
> One step in the removal of Aggregators (in favor of Metrics) is to remove our reliance
on them for PAssert checking.

This message was sent by Atlassian JIRA

View raw message