flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-11049) Unable to execute partial DAG
Date Mon, 03 Dec 2018 03:04:00 GMT
Jeff Zhang created FLINK-11049:

             Summary: Unable to execute partial DAG
                 Key: FLINK-11049
                 URL: https://issues.apache.org/jira/browse/FLINK-11049
             Project: Flink
          Issue Type: Bug
          Components: Job-Submission
    Affects Versions: 1.7.0
            Reporter: Jeff Zhang

val benv = ExecutionEnvironment.getExecutionEnvironment
val btEnv = TableEnvironment.getTableEnvironment(benv)
val data = benv.fromElements("hello world", "hello flink", "hello hadoop")
data.writeAsText("/Users/jzhang/a.txt", FileSystem.WriteMode.OVERWRITE);
val table = data.flatMap(line=>line.split("\\s")).
  map(w => (w, 1)).
  toTable(btEnv, 'word, 'number)
btEnv.registerTable("wc", table)
btEnv.sqlQuery("select word, count(1) from wc group by word").

In the above example, the last statement will trigger the 2 job execution (writeAsText and
print), but what user expect is the print job. The root cause is that currently, flink unable
to submit partial dag. 

This message was sent by Atlassian JIRA

View raw message