flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4098) Iteration support in Python API
Date Mon, 04 Jul 2016 14:10:10 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361365#comment-15361365

Chesnay Schepler commented on FLINK-4098:

It appears you stumbled on some (to me) unexpected behavior of the underlying iterators. Essentially,
when you call `hasNext()` on an empty iterator after it has returned "false" on a previous
call your job will lock up. (regardless of whether it is done in an iteration or not)

The check you removed isn't technically necessary and is mostly there for historic reasons.
But it's also a nice fail-safe in case the sender implementation changes, so i would prefer
keeping it even if it means creating a wrapper that exhibits a more expected behavior.

> Iteration support in Python API
> -------------------------------
>                 Key: FLINK-4098
>                 URL: https://issues.apache.org/jira/browse/FLINK-4098
>             Project: Flink
>          Issue Type: New Feature
>          Components: Python API
>    Affects Versions: 1.0.2
>            Reporter: Geoffrey Mon
>            Priority: Minor
> Bulk and delta iterations are not supported in the Python API. Currently working on this
at https://github.com/GEOFBOT/flink

This message was sent by Atlassian JIRA

View raw message