flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stefan Bunk (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1090) Join deadlocks when used inside Delta iteration
Date Fri, 05 Sep 2014 16:49:29 GMT
Stefan Bunk created FLINK-1090:

             Summary: Join deadlocks when used inside Delta iteration
                 Key: FLINK-1090
                 URL: https://issues.apache.org/jira/browse/FLINK-1090
             Project: Flink
          Issue Type: Bug
          Components: Distributed Runtime, Iterations, Scala API
    Affects Versions: 0.6-incubating
         Environment: Ubuntu 14.04, Flink 0.6-incubating
JVM 1.7 with 7 GB RAM assigned
            Reporter: Stefan Bunk

I have a join inside a delta iteration, which hangs, i.e.I think it's deadlocked.
If I do the join without a delta iteration, it works.

_Why I think it's a deadlock_:
- no output in the logs
- CPU idles
- no IO (measured using iotop)
- stacktrace (when starting in debug mode and stopping at arbitrary points) locks deadlockish

_Join properties_:
- size of the operands: 6.1 GB, 257 MB
- estimated result size: 50 MB
- the deadlock only occurs for big inputs, if I decrease the size of the first operand to
something smaller, e.g. 1MB, it works.

I am using the Scala API.

Let me know, which further information you need.

This message was sent by Atlassian JIRA

View raw message